2021-01-27T09:29:24.389 INFO:root:teuthology version: 1.0.0-fe79ba1b 2021-01-27T09:29:24.391 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_jcollin@teuthology --verbose --lock --description fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} --block --name jcollin-2021-01-27_09:11:59-fs-wip-jcollin-dispatch-queue-throttle-test-distro-basic-smithi --archive /home/teuthworker/archive/jcollin-2021-01-27_09:11:59-fs-wip-jcollin-dispatch-queue-throttle-test-distro-basic-smithi/5833404 -- /tmp/teuthology-worker.1d879svj.tmp 2021-01-27T09:29:24.440 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-01-27T09:29:24.514 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/jcollin-2021-01-27_09:11:59-fs-wip-jcollin-dispatch-queue-throttle-test-distro-basic-smithi/5833404 branch: wip-jcollin-dispatch-queue-throttle-test description: fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} email: jcollin@redhat.com first_in_suite: false job_id: '5833404' kernel: client: branch: testing kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: jcollin-2021-01-27_09:11:59-fs-wip-jcollin-dispatch-queue-throttle-test-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-jcollin-dispatch-queue-throttle-test ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 15m rados osd op timeout: 15m global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 filestore flush min: 0 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - Replacing daemon mds - Throttler Limit has been hit. Some message processing may be significantly delayed. - SLOW_OPS - slow request log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 164b0f632a5fe3384fa7cbb10929c65ed7cc0f12 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: sha1: 164b0f632a5fe3384fa7cbb10929c65ed7cc0f12 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-jcollin-dispatch-queue-throttle-test sha1: 164b0f632a5fe3384fa7cbb10929c65ed7cc0f12 owner: scheduled_jcollin@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 sha1: 164b0f632a5fe3384fa7cbb10929c65ed7cc0f12 sleep_before_teardown: 0 suite: fs suite_branch: wip-jcollin-dispatch-queue-throttle-test suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_wip-jcollin-dispatch-queue-throttle-test/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 164b0f632a5fe3384fa7cbb10929c65ed7cc0f12 tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - mds_thrash: null - workunit: clients: all: - suites/ffsb.sh teuthology_branch: master timestamp: 2021-01-27_09:11:59 tube: smithi user: jcollin verbose: true worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.9388 2021-01-27T09:29:24.515 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_wip-jcollin-dispatch-queue-throttle-test/qa; will attempt to use it 2021-01-27T09:29:24.516 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_wip-jcollin-dispatch-queue-throttle-test/qa/tasks 2021-01-27T09:29:24.516 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-01-27T09:29:24.518 INFO:teuthology.task.internal:Checking packages... 2021-01-27T09:29:24.538 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash '164b0f632a5fe3384fa7cbb10929c65ed7cc0f12' 2021-01-27T09:29:24.538 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-01-27T09:29:24.539 INFO:teuthology.packaging:ref: None 2021-01-27T09:29:24.539 INFO:teuthology.packaging:tag: None 2021-01-27T09:29:24.539 INFO:teuthology.packaging:branch: wip-jcollin-dispatch-queue-throttle-test 2021-01-27T09:29:24.540 INFO:teuthology.packaging:sha1: 164b0f632a5fe3384fa7cbb10929c65ed7cc0f12 2021-01-27T09:29:24.540 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-jcollin-dispatch-queue-throttle-test 2021-01-27T09:29:24.727 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-139-g164b0f63-1focal 2021-01-27T09:29:24.728 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-01-27T09:29:24.737 INFO:teuthology.task.internal:no buildpackages task found 2021-01-27T09:29:24.737 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2021-01-27T09:29:24.863 INFO:teuthology.task.internal.lock_machines:Locking machines... 2021-01-27T09:29:24.864 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-01-27T09:29:24.931 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T09:29:34.948 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_jcollin@teuthology', 'count': 2, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/jcollin-2021-01-27_09:11:59-fs-wip-jcollin-dispatch-queue-throttle-test-distro-basic-smithi/5833404'} 2021-01-27T09:29:34.969 DEBUG:teuthology.lock.ops:locked ubuntu@smithi146.front.sepia.ceph.com, ubuntu@smithi078.front.sepia.ceph.com 2021-01-27T09:29:35.027 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcc0eea7ae8>, signals=[15]) 2021-01-27T09:29:35.231 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of ubuntu 20.04 2021-01-27T09:29:35.246 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of ubuntu 20.04 2021-01-27T09:29:35.723 INFO:teuthology.orchestra.console:Power off smithi078 2021-01-27T09:29:35.724 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-01-27T09:29:35.764 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:29:35.829 INFO:teuthology.orchestra.console:Power off smithi146 2021-01-27T09:29:35.830 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-01-27T09:29:35.866 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:29:39.842 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:29:39.910 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:29:43.958 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:29:44.022 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:29:44.170 INFO:teuthology.orchestra.console:Power off for smithi078 completed 2021-01-27T09:29:44.272 INFO:teuthology.orchestra.console:Power on smithi078 2021-01-27T09:29:44.272 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-01-27T09:29:44.295 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:29:48.134 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:29:48.322 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:29:48.346 INFO:teuthology.orchestra.console:Power off for smithi146 completed 2021-01-27T09:29:48.447 INFO:teuthology.orchestra.console:Power on smithi146 2021-01-27T09:29:48.448 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-01-27T09:29:48.496 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:29:52.438 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:29:52.536 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:29:52.745 INFO:teuthology.orchestra.console:Power on for smithi078 completed 2021-01-27T09:29:52.847 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish 2021-01-27T09:29:56.652 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T09:29:56.864 INFO:teuthology.orchestra.console:Power on for smithi146 completed 2021-01-27T09:29:56.965 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish 2021-01-27T09:32:54.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:32:58.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:33:03.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:33:07.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:33:12.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:33:16.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:33:21.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:33:25.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:33:30.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:33:34.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:33:39.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:33:43.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:33:48.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:33:52.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:34:01.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:34:26.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:34:32.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:34:38.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:34:44.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:34:53.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:34:53.343 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-01-27T09:34:53.345 DEBUG:teuthology.orchestra.run.smithi078:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-01-27T09:34:54.015 INFO:teuthology.provision.fog.smithi078:Node is ready 2021-01-27T09:34:54.016 DEBUG:teuthology.orchestra.run.smithi078:> hostname 2021-01-27T09:34:54.023 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com 2021-01-27T09:34:54.024 DEBUG:teuthology.orchestra.run.smithi078:> grep smithi078.front.sepia.ceph.com /etc/hosts 2021-01-27T09:34:54.030 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078 2021-01-27T09:34:54.030 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2021-01-27T09:34:54.178 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hosts 2021-01-27T09:34:54.194 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/172.21.15.78/172.21.15.78/g' /etc/hosts 2021-01-27T09:34:54.205 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hostname 2021-01-27T09:34:54.264 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2021-01-27T09:34:54.279 INFO:teuthology.provision.fog.smithi078:Deploy complete! 2021-01-27T09:34:54.280 DEBUG:teuthology.parallel:result is None 2021-01-27T09:35:07.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:35:08.009 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-01-27T09:35:08.010 DEBUG:teuthology.orchestra.run.smithi146:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-01-27T09:35:08.456 INFO:teuthology.provision.fog.smithi146:Node is ready 2021-01-27T09:35:08.457 DEBUG:teuthology.orchestra.run.smithi146:> hostname 2021-01-27T09:35:08.463 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146.front.sepia.ceph.com 2021-01-27T09:35:08.463 DEBUG:teuthology.orchestra.run.smithi146:> grep smithi146.front.sepia.ceph.com /etc/hosts 2021-01-27T09:35:08.471 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146 2021-01-27T09:35:08.471 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2021-01-27T09:35:08.662 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hosts 2021-01-27T09:35:08.704 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/172.21.15.146/172.21.15.146/g' /etc/hosts 2021-01-27T09:35:08.788 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hostname 2021-01-27T09:35:08.867 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2021-01-27T09:35:08.940 INFO:teuthology.provision.fog.smithi146:Deploy complete! 2021-01-27T09:35:08.941 DEBUG:teuthology.parallel:result is None 2021-01-27T09:35:09.204 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com 2021-01-27T09:35:09.205 INFO:teuthology.lock.ops:New key found. Updating... 2021-01-27T09:35:09.226 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com 2021-01-27T09:35:09.226 INFO:teuthology.lock.ops:New key found. Updating... 2021-01-27T09:35:09.242 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server 2021-01-27T09:35:09.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:35:09.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:35:09.306 DEBUG:teuthology.orchestra.run.smithi146:> true 2021-01-27T09:35:09.428 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2021-01-27T09:35:09.474 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2021-01-27T09:35:09.475 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2021-01-27T09:35:09.481 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="Ubuntu" 2021-01-27T09:35:09.482 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-27T09:35:09.482 INFO:teuthology.orchestra.run.smithi146.stdout:ID=ubuntu 2021-01-27T09:35:09.482 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE=debian 2021-01-27T09:35:09.483 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-27T09:35:09.483 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="20.04" 2021-01-27T09:35:09.483 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-27T09:35:09.483 INFO:teuthology.orchestra.run.smithi146.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-27T09:35:09.483 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-27T09:35:09.484 INFO:teuthology.orchestra.run.smithi146.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-27T09:35:09.484 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_CODENAME=focal 2021-01-27T09:35:09.484 INFO:teuthology.orchestra.run.smithi146.stdout:UBUNTU_CODENAME=focal 2021-01-27T09:35:09.485 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2021-01-27T09:35:09.506 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server 2021-01-27T09:35:09.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:35:09.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:35:09.561 DEBUG:teuthology.orchestra.run.smithi078:> true 2021-01-27T09:35:09.679 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2021-01-27T09:35:09.733 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2021-01-27T09:35:09.733 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2021-01-27T09:35:09.740 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Ubuntu" 2021-01-27T09:35:09.740 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-27T09:35:09.740 INFO:teuthology.orchestra.run.smithi078.stdout:ID=ubuntu 2021-01-27T09:35:09.740 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE=debian 2021-01-27T09:35:09.741 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-27T09:35:09.741 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="20.04" 2021-01-27T09:35:09.741 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-27T09:35:09.741 INFO:teuthology.orchestra.run.smithi078.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-27T09:35:09.742 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-27T09:35:09.742 INFO:teuthology.orchestra.run.smithi078.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-27T09:35:09.742 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_CODENAME=focal 2021-01-27T09:35:09.742 INFO:teuthology.orchestra.run.smithi078.stdout:UBUNTU_CODENAME=focal 2021-01-27T09:35:09.743 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2021-01-27T09:35:09.758 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2021-01-27T09:35:09.798 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi078.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyrFlzi4uwS8PL4QOIWjUvs4VRQxYIteBp9IKQhu4tyBL9knFedSXBeTcQmzyVOA4/UMBRoDS4Jm7xu5mxwH8Ocx+C89sevcoWl0gf5dpbL2S1wU/MHKxJlZGmyzXLSZNBKHKQmbLhnspU6+Xo5wPn1RMny1gHRDBVIO4258j4x2TbUXFkuhXZJjFy+R/hVIRJkb9Q9JpCWQz/gCT0GEBy5d2WgiL1c5vuIwl+Qxf13gSGYOGWdxAXfi8O+kVy0m2KhD5pL5wZxQXZZ5xBv8a4uBUgBKaXdit+ecnINpjwPMqe1cuVZTcRx75YIoOWQZfsLepYHgPdJXCEQniabYwcnSS/esfvIDvXi2iD2iofUYe/FNzeYIXdqpdi6X/xxMU9ojtCRuhkAo61plk8EAfxxorQBx+t9LBJPYB/n9BTdJE+jt17YL+N5QakMQK9zhliGh92fynbVhRR0lLNTyXJ2TPIE7fxqK1HTcQeFrZEeq0MzjSZXom1bOuiIKpw3KU= smithi146.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDA3evINg9x2K0MA9X0CUPpqITBfMM/flucqtn5muhr5wUxXyxaewdkYGQm2UR/q7ukg0Z4IdG13LhTbeB8cW9ay6wPBYaOdPoKlclqZblLlTRUZu1QnJv45VOEmPDevUdMobvZGyKpRom1vRKfGrpX/qOpjNJHinzOjfblNoUr2P/b8GEe+w11tGeDApaLT/v7WmOo0X/LZ0iTH0kJZ2JwO1iL6mbYLoSUveD8uETgi7r8XpWjQ4I8/X8t2a1Gm167BRtKHu0zANq5VlFNZApqiqi8D1sHZPo0L/5MOk1Rm6WmN1JXIljn98KAAGMiWkfqr1ZyRbN3oipZFqD6rKWX3CwAqo+6hoJ0aA/vZDIpMQUWMxqqizU56hhlTkOrllZwCaAbeDWRrdDWEzSgfS32Rqhj0OqtuY3m8o1gjNIPfvxiw06R2ZQaIgIyoIoGKy6+d302avV1xfGpuh18qYmxH35zjGeBJnnKSagCtc/5pwBJU5tLYTuKaWrkko4vl7c= 2021-01-27T09:35:09.798 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-01-27T09:35:09.849 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-01-27T09:35:09.863 INFO:teuthology.task.internal:Saving configuration 2021-01-27T09:35:09.884 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-01-27T09:35:09.901 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-01-27T09:35:09.921 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-01-27 09:29:34.956055', 'description': '/home/teuthworker/archive/jcollin-2021-01-27_09:11:59-fs-wip-jcollin-dispatch-queue-throttle-test-distro-basic-smithi/5833404', 'locked_by': 'scheduled_jcollin@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINyWDoRAkeIiC8GWV1baI2hnhWA5rQOpJ8HCaXZXDLGG', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi146.front.sepia.ceph.com'} 2021-01-27T09:35:09.937 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-01-27 09:29:34.956076', 'description': '/home/teuthworker/archive/jcollin-2021-01-27_09:11:59-fs-wip-jcollin-dispatch-queue-throttle-test-distro-basic-smithi/5833404', 'locked_by': 'scheduled_jcollin@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIN1wQN3P362tNREDyJ3CfjPEVBO0a9McmmyHc67FMU9Q', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi078.front.sepia.ceph.com'} 2021-01-27T09:35:09.938 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-01-27T09:35:09.945 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2021-01-27T09:35:09.945 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2021-01-27T09:35:09.945 INFO:teuthology.run_tasks:Running task console_log... 2021-01-27T09:35:10.005 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcc0ee646a8>, signals=[15]) 2021-01-27T09:35:10.006 INFO:teuthology.run_tasks:Running task internal.connect... 2021-01-27T09:35:10.013 INFO:teuthology.task.internal:Opening connections... 2021-01-27T09:35:10.014 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi146.front.sepia.ceph.com 2021-01-27T09:35:10.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:35:10.076 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2021-01-27T09:35:10.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:35:10.130 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-01-27T09:35:10.138 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2021-01-27T09:35:10.152 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2021-01-27T09:35:10.153 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2021-01-27T09:35:10.202 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="Ubuntu" 2021-01-27T09:35:10.202 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-27T09:35:10.203 INFO:teuthology.orchestra.run.smithi146.stdout:ID=ubuntu 2021-01-27T09:35:10.203 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE=debian 2021-01-27T09:35:10.204 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-27T09:35:10.205 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="20.04" 2021-01-27T09:35:10.205 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-27T09:35:10.205 INFO:teuthology.orchestra.run.smithi146.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-27T09:35:10.205 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-27T09:35:10.205 INFO:teuthology.orchestra.run.smithi146.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-27T09:35:10.206 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_CODENAME=focal 2021-01-27T09:35:10.206 INFO:teuthology.orchestra.run.smithi146.stdout:UBUNTU_CODENAME=focal 2021-01-27T09:35:10.207 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2021-01-27T09:35:10.228 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2021-01-27T09:35:10.236 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2021-01-27T09:35:10.237 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2021-01-27T09:35:10.285 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Ubuntu" 2021-01-27T09:35:10.285 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-27T09:35:10.285 INFO:teuthology.orchestra.run.smithi078.stdout:ID=ubuntu 2021-01-27T09:35:10.286 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE=debian 2021-01-27T09:35:10.286 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-27T09:35:10.286 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="20.04" 2021-01-27T09:35:10.286 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-27T09:35:10.286 INFO:teuthology.orchestra.run.smithi078.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-27T09:35:10.287 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-27T09:35:10.287 INFO:teuthology.orchestra.run.smithi078.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-27T09:35:10.287 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_CODENAME=focal 2021-01-27T09:35:10.287 INFO:teuthology.orchestra.run.smithi078.stdout:UBUNTU_CODENAME=focal 2021-01-27T09:35:10.288 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2021-01-27T09:35:10.306 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-01-27T09:35:10.350 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-01-27T09:35:10.362 INFO:teuthology.task.internal:Checking for old test directory... 2021-01-27T09:35:10.362 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2021-01-27T09:35:10.365 DEBUG:teuthology.orchestra.run.smithi146:> test '!' -e /home/ubuntu/cephtest 2021-01-27T09:35:10.370 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-01-27T09:35:10.380 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-01-27T09:35:10.380 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2021-01-27T09:35:10.383 DEBUG:teuthology.orchestra.run.smithi146:> test -z $(ls -A /var/lib/ceph) 2021-01-27T09:35:10.407 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-01-27T09:35:10.463 INFO:teuthology.run_tasks:Running task kernel... 2021-01-27T09:35:10.480 DEBUG:teuthology.task.kernel:normalized config {'client.0': {'branch': 'testing'}} 2021-01-27T09:35:10.481 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2021-01-27T09:35:10.481 DEBUG:teuthology.orchestra.run.smithi146:> sudo lsb_release -is 2021-01-27T09:35:10.527 INFO:teuthology.orchestra.run.smithi146.stdout:Ubuntu 2021-01-27T09:35:10.532 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T09:35:10.533 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2021-01-27T09:35:10.757 DEBUG:teuthology.task.kernel:sha1 for client.0 is d418614dd912e485d716412dd3da6014a8961f9c 2021-01-27T09:35:10.757 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "d418614dd912e485d716412dd3da6014a8961f9c"... 2021-01-27T09:35:10.757 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2021-01-27T09:35:10.765 INFO:teuthology.orchestra.run.smithi146.stdout:5.4.0-64-generic 2021-01-27T09:35:10.765 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-64-generic vs d418614dd912e485d716412dd3da6014a8961f9c 2021-01-27T09:35:10.766 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2021-01-27T09:35:10.767 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2021-01-27T09:35:10.767 DEBUG:teuthology.orchestra.run.smithi146:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2021-01-27T09:35:10.811 INFO:teuthology.orchestra.run.smithi146.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2021-01-27T09:35:10.999 INFO:teuthology.orchestra.run.smithi146.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2021-01-27T09:35:11.002 DEBUG:teuthology.orchestra.run.smithi146:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2021-01-27T09:35:11.031 DEBUG:teuthology.orchestra.run.smithi146:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2021-01-27T09:35:11.090 DEBUG:teuthology.orchestra.run.smithi146:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/master 2021-01-27T09:35:22.567 INFO:teuthology.orchestra.run.smithi146.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2021-01-27T09:35:22.568 INFO:teuthology.orchestra.run.smithi146.stderr: * [new branch] main -> origin/main 2021-01-27T09:35:22.568 INFO:teuthology.orchestra.run.smithi146.stderr: * [new branch] master -> origin/master 2021-01-27T09:35:22.589 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20190312 -> 20190312 2021-01-27T09:35:22.589 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20190416 -> 20190416 2021-01-27T09:35:22.590 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20190514 -> 20190514 2021-01-27T09:35:22.590 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20190618 -> 20190618 2021-01-27T09:35:22.590 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20190717 -> 20190717 2021-01-27T09:35:22.591 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20190815 -> 20190815 2021-01-27T09:35:22.591 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20190923 -> 20190923 2021-01-27T09:35:22.591 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20191022 -> 20191022 2021-01-27T09:35:22.591 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20191215 -> 20191215 2021-01-27T09:35:22.592 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20200122 -> 20200122 2021-01-27T09:35:22.593 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20200316 -> 20200316 2021-01-27T09:35:22.593 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20200421 -> 20200421 2021-01-27T09:35:22.593 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20200519 -> 20200519 2021-01-27T09:35:22.594 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20200619 -> 20200619 2021-01-27T09:35:22.594 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20200721 -> 20200721 2021-01-27T09:35:22.594 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20200817 -> 20200817 2021-01-27T09:35:22.594 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20200918 -> 20200918 2021-01-27T09:35:22.595 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20201022 -> 20201022 2021-01-27T09:35:22.595 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20201118 -> 20201118 2021-01-27T09:35:22.595 INFO:teuthology.orchestra.run.smithi146.stderr: * [new tag] 20201218 -> 20201218 2021-01-27T09:35:24.658 INFO:teuthology.orchestra.run.smithi146.stderr:Updating files: 53% (1269/2368) Updating files: 54% (1279/2368) Updating files: 55% (1303/2368) Updating files: 56% (1327/2368) Updating files: 57% (1350/2368) Updating files: 58% (1374/2368) Updating files: 59% (1398/2368) Updating files: 60% (1421/2368) Updating files: 61% (1445/2368) Updating files: 62% (1469/2368) Updating files: 63% (1492/2368) Updating files: 64% (1516/2368) Updating files: 65% (1540/2368) Updating files: 66% (1563/2368) Updating files: 67% (1587/2368) Updating files: 68% (1611/2368) Updating files: 69% (1634/2368) Updating files: 70% (1658/2368) Updating files: 71% (1682/2368) Updating files: 72% (1705/2368) Updating files: 73% (1729/2368) Updating files: 74% (1753/2368) Updating files: 75% (1776/2368) Updating files: 76% (1800/2368) Updating files: 77% (1824/2368) Updating files: 78% (1848/2368) Updating files: 79% (1871/2368) Updating files: 80% (1895/2368) Updating files: 81% (1919/2368) Updating files: 82% (1942/2368) Updating files: 83% (1966/2368) Updating files: 84% (1990/2368) Updating files: 85% (2013/2368) Updating files: 86% (2037/2368) Updating files: 87% (2061/2368) Updating files: 88% (2084/2368) Updating files: 89% (2108/2368) Updating files: 90% (2132/2368) Updating files: 91% (2155/2368) Updating files: 92% (2179/2368) Updating files: 93% (2203/2368) Updating files: 94% (2226/2368) Updating files: 95% (2250/2368) Updating files: 96% (2274/2368) Updating files: 96% (2283/2368) Updating files: 97% (2297/2368) Updating files: 98% (2321/2368) Updating files: 99% (2345/2368) Updating files: 100% (2368/2368) Updating files: 100% (2368/2368), done. 2021-01-27T09:35:24.662 INFO:teuthology.orchestra.run.smithi146.stdout:HEAD is now at 0578970 brcm: Link RPi4's WiFi firmware with DMI machine name. 2021-01-27T09:35:24.672 INFO:teuthology.task.kernel:Downloading kernel d418614dd912e485d716412dd3da6014a8961f9c on client.0... 2021-01-27T09:35:24.673 DEBUG:teuthology.orchestra.run.smithi146:> sudo lsb_release -is 2021-01-27T09:35:24.712 INFO:teuthology.orchestra.run.smithi146.stdout:Ubuntu 2021-01-27T09:35:24.716 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T09:35:24.717 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=d418614dd912e485d716412dd3da6014a8961f9c 2021-01-27T09:35:24.885 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/d418614dd912e485d716412dd3da6014a8961f9c/ubuntu/focal/flavors/default/pool/main/l/linux-5.11.0-rc5-ceph-gd418614dd912/ 2021-01-27T09:35:24.886 DEBUG:teuthology.orchestra.run.smithi146:> rm -f /tmp/linux-image.deb && echo linux-image-5.11.0-rc5-ceph-gd418614dd912_5.11.0-rc5-ceph-gd418614dd912-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/d418614dd912e485d716412dd3da6014a8961f9c/ubuntu/focal/flavors/default/pool/main/l/linux-5.11.0-rc5-ceph-gd418614dd912/ --input-file=- 2021-01-27T09:35:24.888 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi146.front.sepia.ceph.com to complete... 2021-01-27T09:35:26.259 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27 09:35:26 URL:https://3.chacra.ceph.com/r/kernel/testing/d418614dd912e485d716412dd3da6014a8961f9c/ubuntu/focal/flavors/default/pool/main/l/linux-5.11.0-rc5-ceph-gd418614dd912/linux-image-5.11.0-rc5-ceph-gd418614dd912_5.11.0-rc5-ceph-gd418614dd912-1_amd64.deb [34060152/34060152] -> "/tmp/linux-image.deb" [1] 2021-01-27T09:35:26.260 INFO:teuthology.orchestra.run.smithi146.stderr:FINISHED --2021-01-27 09:35:26-- 2021-01-27T09:35:26.260 INFO:teuthology.orchestra.run.smithi146.stderr:Total wall clock time: 1.3s 2021-01-27T09:35:26.260 INFO:teuthology.orchestra.run.smithi146.stderr:Downloaded: 1 files, 32M in 1.2s (27.0 MB/s) 2021-01-27T09:35:26.262 INFO:teuthology.task.kernel:Installing kernel d418614dd912e485d716412dd3da6014a8961f9c on client.0... 2021-01-27T09:35:26.262 DEBUG:teuthology.orchestra.run.smithi146:> sudo dpkg -i /tmp/linux-image.deb 2021-01-27T09:35:26.517 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package linux-image-5.11.0-rc5-ceph-gd418614dd912. 2021-01-27T09:35:28.409 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... 114224 files and directories currently installed.) 2021-01-27T09:35:28.415 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack /tmp/linux-image.deb ... 2021-01-27T09:35:28.518 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking linux-image-5.11.0-rc5-ceph-gd418614dd912 (5.11.0-rc5-ceph-gd418614dd912-1) ... 2021-01-27T09:35:31.748 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up linux-image-5.11.0-rc5-ceph-gd418614dd912 (5.11.0-rc5-ceph-gd418614dd912-1) ... 2021-01-27T09:35:32.010 INFO:teuthology.orchestra.run.smithi146.stderr:update-initramfs: Generating /boot/initrd.img-5.11.0-rc5-ceph-gd418614dd912 2021-01-27T09:35:53.982 INFO:teuthology.orchestra.run.smithi146.stderr:Sourcing file `/etc/default/grub' 2021-01-27T09:35:53.990 INFO:teuthology.orchestra.run.smithi146.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-01-27T09:35:54.016 INFO:teuthology.orchestra.run.smithi146.stderr:Generating grub configuration file ... 2021-01-27T09:35:54.357 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-5.11.0-rc5-ceph-gd418614dd912 2021-01-27T09:35:54.389 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initrd.img-5.11.0-rc5-ceph-gd418614dd912 2021-01-27T09:35:54.730 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-5.4.0-64-generic 2021-01-27T09:35:54.743 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initrd.img-5.4.0-64-generic 2021-01-27T09:35:57.480 INFO:teuthology.orchestra.run.smithi146.stderr:done 2021-01-27T09:35:57.642 DEBUG:teuthology.orchestra.run.smithi146:> dpkg-deb -c /tmp/linux-image.deb 2021-01-27T09:35:57.652 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./ 2021-01-27T09:35:57.652 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./boot/ 2021-01-27T09:35:57.652 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 5185374 2021-01-25 17:59 ./boot/System.map-5.11.0-rc5-ceph-gd418614dd912 2021-01-27T09:35:57.716 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 154886 2021-01-25 17:59 ./boot/config-5.11.0-rc5-ceph-gd418614dd912 2021-01-27T09:35:57.718 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9909440 2021-01-25 17:59 ./boot/vmlinuz-5.11.0-rc5-ceph-gd418614dd912 2021-01-27T09:35:57.863 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./etc/ 2021-01-27T09:35:57.864 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./etc/kernel/ 2021-01-27T09:35:57.864 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./etc/kernel/postinst.d/ 2021-01-27T09:35:57.864 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./etc/kernel/postrm.d/ 2021-01-27T09:35:57.865 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./etc/kernel/preinst.d/ 2021-01-27T09:35:57.865 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./etc/kernel/prerm.d/ 2021-01-27T09:35:57.865 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/ 2021-01-27T09:35:57.865 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/ 2021-01-27T09:35:57.865 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/ 2021-01-27T09:35:57.866 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/ 2021-01-27T09:35:57.866 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/ 2021-01-27T09:35:57.866 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/ 2021-01-27T09:35:57.866 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/crypto/ 2021-01-27T09:35:57.867 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 488945 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/crypto/aesni-intel.ko 2021-01-27T09:35:57.867 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/crypto/blowfish-x86_64.ko 2021-01-27T09:35:57.868 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31833 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2021-01-27T09:35:57.868 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31209 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2021-01-27T09:35:57.868 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 86217 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/crypto/camellia-x86_64.ko 2021-01-27T09:35:57.869 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 98441 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2021-01-27T09:35:57.869 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 143057 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2021-01-27T09:35:57.870 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10049 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/crypto/crc32-pclmul.ko 2021-01-27T09:35:57.870 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10841 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2021-01-27T09:35:57.870 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 77305 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2021-01-27T09:35:57.871 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13889 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2021-01-27T09:35:57.871 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12841 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/crypto/glue_helper.ko 2021-01-27T09:35:57.871 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50201 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2021-01-27T09:35:57.872 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 48385 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/crypto/serpent-avx2.ko 2021-01-27T09:35:57.872 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 49489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2021-01-27T09:35:57.873 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33193 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/crypto/sha1-ssse3.ko 2021-01-27T09:35:57.873 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35321 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/crypto/sha256-ssse3.ko 2021-01-27T09:35:57.874 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53377 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/crypto/sha512-ssse3.ko 2021-01-27T09:35:57.875 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2021-01-27T09:35:57.875 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29777 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2021-01-27T09:35:57.875 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/crypto/twofish-x86_64.ko 2021-01-27T09:35:57.875 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/kernel/ 2021-01-27T09:35:57.876 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/kernel/cpu/ 2021-01-27T09:35:57.876 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/kernel/cpu/mce/ 2021-01-27T09:35:57.876 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34729 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2021-01-27T09:35:57.877 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12529 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/kernel/cpuid.ko 2021-01-27T09:35:57.877 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17057 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/kernel/msr.ko 2021-01-27T09:35:57.877 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/kvm/ 2021-01-27T09:35:57.877 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 283697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/kvm/kvm-amd.ko 2021-01-27T09:35:57.880 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 828921 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/kvm/kvm-intel.ko 2021-01-27T09:35:57.889 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1912081 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/kvm/kvm.ko 2021-01-27T09:35:57.913 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/oprofile/ 2021-01-27T09:35:57.913 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 137889 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/arch/x86/oprofile/oprofile.ko 2021-01-27T09:35:57.914 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/ 2021-01-27T09:35:57.914 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53137 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/af_alg.ko 2021-01-27T09:35:57.915 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24505 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/algif_hash.ko 2021-01-27T09:35:57.915 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20169 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/algif_skcipher.ko 2021-01-27T09:35:57.916 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15825 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/ansi_cprng.ko 2021-01-27T09:35:57.917 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/anubis.ko 2021-01-27T09:35:57.917 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/arc4.ko 2021-01-27T09:35:57.917 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/asymmetric_keys/ 2021-01-27T09:35:57.917 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9777 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2021-01-27T09:35:57.918 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/async_tx/ 2021-01-27T09:35:57.918 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10649 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/async_tx/async_memcpy.ko 2021-01-27T09:35:57.918 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18601 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/async_tx/async_pq.ko 2021-01-27T09:35:57.918 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21153 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/async_tx/async_raid6_recov.ko 2021-01-27T09:35:57.919 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13225 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/async_tx/async_tx.ko 2021-01-27T09:35:57.920 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17201 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/async_tx/async_xor.ko 2021-01-27T09:35:57.920 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/async_tx/raid6test.ko 2021-01-27T09:35:57.920 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19561 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/authenc.ko 2021-01-27T09:35:57.921 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21753 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/authencesn.ko 2021-01-27T09:35:57.921 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19585 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/blake2b_generic.ko 2021-01-27T09:35:57.921 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12289 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/blowfish_common.ko 2021-01-27T09:35:57.921 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9425 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/blowfish_generic.ko 2021-01-27T09:35:57.921 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 37537 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/camellia_generic.ko 2021-01-27T09:35:57.922 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26073 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/cast5_generic.ko 2021-01-27T09:35:57.922 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32761 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/cast6_generic.ko 2021-01-27T09:35:57.924 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9977 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/cast_common.ko 2021-01-27T09:35:57.924 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34369 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/ccm.ko 2021-01-27T09:35:57.924 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13585 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/cmac.ko 2021-01-27T09:35:57.924 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8809 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/crc32_generic.ko 2021-01-27T09:35:57.925 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 42929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/cryptd.ko 2021-01-27T09:35:57.925 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/crypto_engine.ko 2021-01-27T09:35:57.925 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25177 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/crypto_simd.ko 2021-01-27T09:35:57.925 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23609 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/crypto_user.ko 2021-01-27T09:35:57.925 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16721 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/cts.ko 2021-01-27T09:35:57.926 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10081 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/des_generic.ko 2021-01-27T09:35:57.926 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/dh_generic.ko 2021-01-27T09:35:57.926 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9921 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/echainiv.ko 2021-01-27T09:35:57.926 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24617 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/essiv.ko 2021-01-27T09:35:57.927 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17121 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/fcrypt.ko 2021-01-27T09:35:57.927 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26073 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/khazad.ko 2021-01-27T09:35:57.928 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14745 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/lrw.ko 2021-01-27T09:35:57.929 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10609 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/lz4.ko 2021-01-27T09:35:57.929 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/lz4hc.ko 2021-01-27T09:35:57.929 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11105 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/md4.ko 2021-01-27T09:35:57.929 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/michael_mic.ko 2021-01-27T09:35:57.930 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9857 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/pcbc.ko 2021-01-27T09:35:57.930 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17601 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/pcrypt.ko 2021-01-27T09:35:57.930 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13625 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/rmd128.ko 2021-01-27T09:35:57.930 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15481 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/rmd160.ko 2021-01-27T09:35:57.931 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13753 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/rmd256.ko 2021-01-27T09:35:57.931 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/rmd320.ko 2021-01-27T09:35:57.931 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10217 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/salsa20_generic.ko 2021-01-27T09:35:57.931 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28721 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/seed.ko 2021-01-27T09:35:57.932 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28241 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/serpent_generic.ko 2021-01-27T09:35:57.932 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 170793 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/tcrypt.ko 2021-01-27T09:35:57.934 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10105 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/tea.ko 2021-01-27T09:35:57.934 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22737 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/tgr192.ko 2021-01-27T09:35:57.935 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28193 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/twofish_common.ko 2021-01-27T09:35:57.935 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12033 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/twofish_generic.ko 2021-01-27T09:35:57.935 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16521 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/vmac.ko 2021-01-27T09:35:57.936 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35425 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/wp512.ko 2021-01-27T09:35:57.936 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13297 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/xcbc.ko 2021-01-27T09:35:57.936 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25313 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/xor.ko 2021-01-27T09:35:57.936 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17569 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/xts.ko 2021-01-27T09:35:57.937 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8721 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/crypto/xxhash_generic.ko 2021-01-27T09:35:57.937 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ 2021-01-27T09:35:57.937 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/acpi/ 2021-01-27T09:35:57.937 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18025 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/acpi/acpi_extlog.ko 2021-01-27T09:35:57.937 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25553 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/acpi/acpi_ipmi.ko 2021-01-27T09:35:57.938 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/acpi/acpi_pad.ko 2021-01-27T09:35:57.938 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/acpi/apei/ 2021-01-27T09:35:57.938 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/acpi/apei/einj.ko 2021-01-27T09:35:57.938 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12049 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/acpi/ec_sys.ko 2021-01-27T09:35:57.939 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/acpi/sbs.ko 2021-01-27T09:35:57.939 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18497 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/acpi/sbshc.ko 2021-01-27T09:35:57.939 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 82513 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/acpi/video.ko 2021-01-27T09:35:57.943 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/ 2021-01-27T09:35:57.943 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21161 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/acard-ahci.ko 2021-01-27T09:35:57.943 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 84873 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/ahci.ko 2021-01-27T09:35:57.944 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14033 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/ahci_platform.ko 2021-01-27T09:35:57.944 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 81841 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/libahci.ko 2021-01-27T09:35:57.944 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30185 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/libahci_platform.ko 2021-01-27T09:35:57.944 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16593 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_acpi.ko 2021-01-27T09:35:57.945 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29217 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_ali.ko 2021-01-27T09:35:57.946 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33409 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_amd.ko 2021-01-27T09:35:57.946 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20185 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_artop.ko 2021-01-27T09:35:57.947 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_atiixp.ko 2021-01-27T09:35:57.947 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21353 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_atp867x.ko 2021-01-27T09:35:57.947 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_cmd640.ko 2021-01-27T09:35:57.948 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24121 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_cmd64x.ko 2021-01-27T09:35:57.948 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13769 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_cypress.ko 2021-01-27T09:35:57.948 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16729 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_efar.ko 2021-01-27T09:35:57.948 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20193 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_hpt366.ko 2021-01-27T09:35:57.948 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35785 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_hpt37x.ko 2021-01-27T09:35:57.949 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_hpt3x2n.ko 2021-01-27T09:35:57.949 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16001 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_hpt3x3.ko 2021-01-27T09:35:57.949 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16017 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_it8213.ko 2021-01-27T09:35:57.949 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35361 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_it821x.ko 2021-01-27T09:35:57.950 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11985 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_jmicron.ko 2021-01-27T09:35:57.950 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 46593 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_legacy.ko 2021-01-27T09:35:57.950 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_marvell.ko 2021-01-27T09:35:57.950 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15233 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_mpiix.ko 2021-01-27T09:35:57.951 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11913 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_netcell.ko 2021-01-27T09:35:57.951 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15713 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_ninja32.ko 2021-01-27T09:35:57.951 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14529 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_ns87410.ko 2021-01-27T09:35:57.952 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16617 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_ns87415.ko 2021-01-27T09:35:57.952 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15593 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_oldpiix.ko 2021-01-27T09:35:57.952 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14201 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_opti.ko 2021-01-27T09:35:57.952 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20409 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_optidma.ko 2021-01-27T09:35:57.953 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31809 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_pcmcia.ko 2021-01-27T09:35:57.953 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26585 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_pdc2027x.ko 2021-01-27T09:35:57.956 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19553 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_pdc202xx_old.ko 2021-01-27T09:35:57.957 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13201 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_piccolo.ko 2021-01-27T09:35:57.957 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15921 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_platform.ko 2021-01-27T09:35:57.957 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14585 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_radisys.ko 2021-01-27T09:35:57.957 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18241 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_rdc.ko 2021-01-27T09:35:57.958 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14841 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_rz1000.ko 2021-01-27T09:35:57.958 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12937 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_sch.ko 2021-01-27T09:35:57.958 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22825 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_serverworks.ko 2021-01-27T09:35:57.958 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_sil680.ko 2021-01-27T09:35:57.959 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19057 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_sl82c105.ko 2021-01-27T09:35:57.959 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15905 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_triflex.ko 2021-01-27T09:35:57.959 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28169 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pata_via.ko 2021-01-27T09:35:57.959 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22137 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/pdc_adma.ko 2021-01-27T09:35:57.960 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28057 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/sata_inic162x.ko 2021-01-27T09:35:57.960 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 76225 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/sata_mv.ko 2021-01-27T09:35:57.960 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 61329 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/sata_nv.ko 2021-01-27T09:35:57.960 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35113 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/sata_promise.ko 2021-01-27T09:35:57.960 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21305 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/sata_qstor.ko 2021-01-27T09:35:57.961 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28769 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/sata_sil.ko 2021-01-27T09:35:57.961 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38121 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/sata_sil24.ko 2021-01-27T09:35:57.961 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17289 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/sata_sis.ko 2021-01-27T09:35:57.961 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17945 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/sata_svw.ko 2021-01-27T09:35:57.961 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27921 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/sata_sx4.ko 2021-01-27T09:35:57.962 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14505 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/sata_uli.ko 2021-01-27T09:35:57.962 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34577 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/sata_via.ko 2021-01-27T09:35:57.962 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18401 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ata/sata_vsc.ko 2021-01-27T09:35:57.962 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/auxdisplay/ 2021-01-27T09:35:57.963 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15433 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/auxdisplay/ks0108.ko 2021-01-27T09:35:57.963 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/bcma/ 2021-01-27T09:35:57.963 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 123833 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/bcma/bcma.ko 2021-01-27T09:35:57.963 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/block/ 2021-01-27T09:35:57.963 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/block/aoe/ 2021-01-27T09:35:57.964 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 114889 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/block/aoe/aoe.ko 2021-01-27T09:35:57.964 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12305 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/block/cryptoloop.ko 2021-01-27T09:35:57.964 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/block/drbd/ 2021-01-27T09:35:57.964 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1053561 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/block/drbd/drbd.ko 2021-01-27T09:35:57.968 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 177025 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/block/floppy.ko 2021-01-27T09:35:57.971 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/block/mtip32xx/ 2021-01-27T09:35:57.971 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 107065 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/block/mtip32xx/mtip32xx.ko 2021-01-27T09:35:57.972 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 111353 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/block/nbd.ko 2021-01-27T09:35:57.973 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/block/null_blk/ 2021-01-27T09:35:57.973 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 94065 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/block/null_blk/null_blk.ko 2021-01-27T09:35:57.974 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 83225 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/block/pktcdvd.ko 2021-01-27T09:35:57.975 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 257537 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/block/rbd.ko 2021-01-27T09:35:57.979 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/block/rsxx/ 2021-01-27T09:35:57.979 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 112793 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/block/rsxx/rsxx.ko 2021-01-27T09:35:57.980 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 141081 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/block/skd.ko 2021-01-27T09:35:57.983 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38441 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/block/sx8.ko 2021-01-27T09:35:57.983 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 42961 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/block/umem.ko 2021-01-27T09:35:57.984 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/block/xen-blkback/ 2021-01-27T09:35:57.984 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 97073 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/block/xen-blkback/xen-blkback.ko 2021-01-27T09:35:57.985 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/block/zram/ 2021-01-27T09:35:57.985 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 60433 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/block/zram/zram.ko 2021-01-27T09:35:57.986 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/ 2021-01-27T09:35:57.986 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30921 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/applicom.ko 2021-01-27T09:35:57.987 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11561 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/hangcheck-timer.ko 2021-01-27T09:35:57.987 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/hw_random/ 2021-01-27T09:35:57.988 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12809 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/hw_random/amd-rng.ko 2021-01-27T09:35:57.988 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17049 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/hw_random/intel-rng.ko 2021-01-27T09:35:57.988 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13185 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/hw_random/timeriomem-rng.ko 2021-01-27T09:35:57.988 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/hw_random/via-rng.ko 2021-01-27T09:35:57.989 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13601 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/hw_random/virtio-rng.ko 2021-01-27T09:35:57.989 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/ipmi/ 2021-01-27T09:35:57.989 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30417 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/ipmi/ipmi_devintf.ko 2021-01-27T09:35:57.989 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 138985 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2021-01-27T09:35:57.990 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25505 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2021-01-27T09:35:57.990 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 143017 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/ipmi/ipmi_si.ko 2021-01-27T09:35:57.992 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 70009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/ipmi/ipmi_ssif.ko 2021-01-27T09:35:57.993 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50977 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2021-01-27T09:35:57.993 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34953 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/lp.ko 2021-01-27T09:35:57.994 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/mwave/ 2021-01-27T09:35:57.994 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 88705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/mwave/mwave.ko 2021-01-27T09:35:57.996 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/nvram.ko 2021-01-27T09:35:57.996 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/pcmcia/ 2021-01-27T09:35:57.996 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 102273 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/pcmcia/cm4000_cs.ko 2021-01-27T09:35:57.997 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 52473 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/pcmcia/cm4040_cs.ko 2021-01-27T09:35:57.997 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 86745 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/pcmcia/synclink_cs.ko 2021-01-27T09:35:57.998 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/ppdev.ko 2021-01-27T09:35:57.999 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19193 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/raw.ko 2021-01-27T09:35:57.999 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50561 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/tlclk.ko 2021-01-27T09:35:58.000 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/tpm/ 2021-01-27T09:35:58.001 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15569 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/tpm/tpm_atmel.ko 2021-01-27T09:35:58.001 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15409 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2021-01-27T09:35:58.001 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23041 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2021-01-27T09:35:58.002 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31497 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2021-01-27T09:35:58.004 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/tpm/tpm_infineon.ko 2021-01-27T09:35:58.004 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22145 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/tpm/tpm_nsc.ko 2021-01-27T09:35:58.005 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22185 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/tpm/xen-tpmfront.ko 2021-01-27T09:35:58.005 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/xillybus/ 2021-01-27T09:35:58.005 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53793 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/xillybus/xillybus_core.ko 2021-01-27T09:35:58.005 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16625 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/char/xillybus/xillybus_pcie.ko 2021-01-27T09:35:58.005 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/clk/ 2021-01-27T09:35:58.006 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12225 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/clk/clk-palmas.ko 2021-01-27T09:35:58.006 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9273 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/clk/clk-s2mps11.ko 2021-01-27T09:35:58.006 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 49713 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/clk/clk-si5351.ko 2021-01-27T09:35:58.006 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11209 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/clk/clk-twl6040.ko 2021-01-27T09:35:58.007 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19169 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/clk/clk-wm831x.ko 2021-01-27T09:35:58.007 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/cpufreq/ 2021-01-27T09:35:58.007 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9145 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2021-01-27T09:35:58.007 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17593 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/cpufreq/p4-clockmod.ko 2021-01-27T09:35:58.007 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24921 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/cpufreq/speedstep-lib.ko 2021-01-27T09:35:58.008 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/crypto/ 2021-01-27T09:35:58.008 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/crypto/ccp/ 2021-01-27T09:35:58.008 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 70201 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/crypto/ccp/ccp-crypto.ko 2021-01-27T09:35:58.009 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 203865 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/crypto/ccp/ccp.ko 2021-01-27T09:35:58.009 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19313 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/crypto/padlock-aes.ko 2021-01-27T09:35:58.009 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20689 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/crypto/padlock-sha.ko 2021-01-27T09:35:58.009 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/crypto/qat/ 2021-01-27T09:35:58.010 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/crypto/qat/qat_common/ 2021-01-27T09:35:58.010 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 305625 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2021-01-27T09:35:58.012 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/crypto/qat/qat_dh895xcc/ 2021-01-27T09:35:58.013 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25497 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2021-01-27T09:35:58.013 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/crypto/virtio/ 2021-01-27T09:35:58.013 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50425 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/crypto/virtio/virtio_crypto.ko 2021-01-27T09:35:58.014 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/dca/ 2021-01-27T09:35:58.014 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27857 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/dca/dca.ko 2021-01-27T09:35:58.015 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/dma/ 2021-01-27T09:35:58.015 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/dma/dw/ 2021-01-27T09:35:58.015 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15321 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/dma/dw/dw_dmac.ko 2021-01-27T09:35:58.015 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/dma/ioat/ 2021-01-27T09:35:58.016 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 124209 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/dma/ioat/ioatdma.ko 2021-01-27T09:35:58.016 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/edac/ 2021-01-27T09:35:58.016 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 66497 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/edac/amd64_edac_mod.ko 2021-01-27T09:35:58.017 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36457 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/edac/e752x_edac.ko 2021-01-27T09:35:58.017 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 56537 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/edac/edac_mce_amd.ko 2021-01-27T09:35:58.018 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16657 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/edac/i3000_edac.ko 2021-01-27T09:35:58.018 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16321 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/edac/i3200_edac.ko 2021-01-27T09:35:58.019 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27753 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/edac/i5000_edac.ko 2021-01-27T09:35:58.019 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21913 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/edac/i5100_edac.ko 2021-01-27T09:35:58.019 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25265 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/edac/i5400_edac.ko 2021-01-27T09:35:58.020 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25049 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/edac/i7300_edac.ko 2021-01-27T09:35:58.020 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51825 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/edac/i7core_edac.ko 2021-01-27T09:35:58.021 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16857 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/edac/i82975x_edac.ko 2021-01-27T09:35:58.021 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18633 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/edac/ie31200_edac.ko 2021-01-27T09:35:58.021 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/edac/sb_edac.ko 2021-01-27T09:35:58.022 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/edac/x38_edac.ko 2021-01-27T09:35:58.022 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/extcon/ 2021-01-27T09:35:58.023 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12209 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/extcon/extcon-gpio.ko 2021-01-27T09:35:58.023 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28953 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/extcon/extcon-max14577.ko 2021-01-27T09:35:58.023 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31033 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/extcon/extcon-max77693.ko 2021-01-27T09:35:58.023 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28281 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/extcon/extcon-max8997.ko 2021-01-27T09:35:58.023 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26553 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/extcon/extcon-palmas.ko 2021-01-27T09:35:58.025 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26201 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/extcon/extcon-rt8973a.ko 2021-01-27T09:35:58.025 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23753 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/extcon/extcon-sm5502.ko 2021-01-27T09:35:58.025 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/firmware/ 2021-01-27T09:35:58.026 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33233 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/firmware/dmi-sysfs.ko 2021-01-27T09:35:58.026 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/firmware/efi/ 2021-01-27T09:35:58.026 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21457 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/firmware/efi/efi-pstore.ko 2021-01-27T09:35:58.026 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21153 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/firmware/iscsi_ibft.ko 2021-01-27T09:35:58.027 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/ 2021-01-27T09:35:58.027 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12049 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-adp5520.ko 2021-01-27T09:35:58.027 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-adp5588.ko 2021-01-27T09:35:58.027 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-amd8111.ko 2021-01-27T09:35:58.027 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14505 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-arizona.ko 2021-01-27T09:35:58.028 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13689 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-da9052.ko 2021-01-27T09:35:58.028 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11673 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-da9055.ko 2021-01-27T09:35:58.028 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22273 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-dln2.ko 2021-01-27T09:35:58.028 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 69313 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-f7188x.ko 2021-01-27T09:35:58.031 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28737 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-generic.ko 2021-01-27T09:35:58.032 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19001 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-ich.ko 2021-01-27T09:35:58.032 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11369 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-janz-ttl.ko 2021-01-27T09:35:58.032 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-kempld.ko 2021-01-27T09:35:58.032 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-lp3943.ko 2021-01-27T09:35:58.033 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8681 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-max7300.ko 2021-01-27T09:35:58.033 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-max730x.ko 2021-01-27T09:35:58.033 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19329 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-max732x.ko 2021-01-27T09:35:58.033 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28369 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-ml-ioh.ko 2021-01-27T09:35:58.033 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 43785 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-pca953x.ko 2021-01-27T09:35:58.034 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20993 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-pcf857x.ko 2021-01-27T09:35:58.034 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14193 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-rdc321x.ko 2021-01-27T09:35:58.034 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12105 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-sch.ko 2021-01-27T09:35:58.034 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19673 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-sch311x.ko 2021-01-27T09:35:58.034 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12089 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-tps65912.ko 2021-01-27T09:35:58.035 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22753 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-twl4030.ko 2021-01-27T09:35:58.035 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10497 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-twl6040.ko 2021-01-27T09:35:58.035 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20889 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-viperboard.ko 2021-01-27T09:35:58.035 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-vx855.ko 2021-01-27T09:35:58.035 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16385 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-wm831x.ko 2021-01-27T09:35:58.036 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11289 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-wm8350.ko 2021-01-27T09:35:58.036 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16745 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/gpio/gpio-wm8994.ko 2021-01-27T09:35:58.036 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/ 2021-01-27T09:35:58.036 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-a4tech.ko 2021-01-27T09:35:58.037 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26913 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-apple.ko 2021-01-27T09:35:58.037 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14825 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-appleir.ko 2021-01-27T09:35:58.037 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7905 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-aureal.ko 2021-01-27T09:35:58.037 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14529 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-axff.ko 2021-01-27T09:35:58.037 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-belkin.ko 2021-01-27T09:35:58.038 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10105 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-cherry.ko 2021-01-27T09:35:58.038 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15161 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-chicony.ko 2021-01-27T09:35:58.038 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 59209 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-cp2112.ko 2021-01-27T09:35:58.038 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10497 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-cypress.ko 2021-01-27T09:35:58.038 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15865 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-dr.ko 2021-01-27T09:35:58.039 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10193 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-elecom.ko 2021-01-27T09:35:58.039 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16889 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-elo.ko 2021-01-27T09:35:58.039 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12417 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-emsff.ko 2021-01-27T09:35:58.043 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9817 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-ezkey.ko 2021-01-27T09:35:58.043 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13457 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-gaff.ko 2021-01-27T09:35:58.043 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8569 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-generic.ko 2021-01-27T09:35:58.043 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16425 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-gt683r.ko 2021-01-27T09:35:58.044 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15881 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-gyration.ko 2021-01-27T09:35:58.044 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9025 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-holtek-kbd.ko 2021-01-27T09:35:58.044 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8713 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-holtek-mouse.ko 2021-01-27T09:35:58.044 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13185 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-holtekff.ko 2021-01-27T09:35:58.044 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18833 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-hyperv.ko 2021-01-27T09:35:58.045 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10137 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-icade.ko 2021-01-27T09:35:58.045 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8913 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-kensington.ko 2021-01-27T09:35:58.045 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7881 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-keytouch.ko 2021-01-27T09:35:58.045 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14505 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-kye.ko 2021-01-27T09:35:58.045 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12841 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-lcpower.ko 2021-01-27T09:35:58.046 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19921 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-led.ko 2021-01-27T09:35:58.046 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 42257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-lenovo.ko 2021-01-27T09:35:58.046 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29225 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-lg-g15.ko 2021-01-27T09:35:58.046 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-logitech-dj.ko 2021-01-27T09:35:58.047 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 87241 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-logitech-hidpp.ko 2021-01-27T09:35:58.047 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 93137 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-logitech.ko 2021-01-27T09:35:58.047 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24177 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-magicmouse.ko 2021-01-27T09:35:58.047 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22441 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-microsoft.ko 2021-01-27T09:35:58.047 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10265 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-monterey.ko 2021-01-27T09:35:58.048 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50753 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-multitouch.ko 2021-01-27T09:35:58.048 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33521 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-ntrig.ko 2021-01-27T09:35:58.048 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8633 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-ortek.ko 2021-01-27T09:35:58.048 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8745 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-penmount.ko 2021-01-27T09:35:58.048 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12793 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-petalynx.ko 2021-01-27T09:35:58.049 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 74257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-picolcd.ko 2021-01-27T09:35:58.049 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14577 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-pl.ko 2021-01-27T09:35:58.049 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12865 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-plantronics.ko 2021-01-27T09:35:58.049 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7937 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-primax.ko 2021-01-27T09:35:58.049 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34249 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-rmi.ko 2021-01-27T09:35:58.050 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20377 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-roccat-arvo.ko 2021-01-27T09:35:58.050 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13865 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-roccat-common.ko 2021-01-27T09:35:58.050 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-roccat-isku.ko 2021-01-27T09:35:58.050 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29641 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-roccat-kone.ko 2021-01-27T09:35:58.050 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27777 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-roccat-koneplus.ko 2021-01-27T09:35:58.051 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20081 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-roccat-konepure.ko 2021-01-27T09:35:58.051 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27529 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-roccat-kovaplus.ko 2021-01-27T09:35:58.051 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12449 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-roccat-lua.ko 2021-01-27T09:35:58.051 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26785 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-roccat-pyra.ko 2021-01-27T09:35:58.051 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26425 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-roccat-ryos.ko 2021-01-27T09:35:58.052 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18473 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-roccat-savu.ko 2021-01-27T09:35:58.054 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-roccat.ko 2021-01-27T09:35:58.054 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13041 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-saitek.ko 2021-01-27T09:35:58.054 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14873 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-samsung.ko 2021-01-27T09:35:58.054 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36601 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-sensor-hub.ko 2021-01-27T09:35:58.055 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13641 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-sjoy.ko 2021-01-27T09:35:58.055 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 70137 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-sony.ko 2021-01-27T09:35:58.055 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7553 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-speedlink.ko 2021-01-27T09:35:58.055 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-steelseries.ko 2021-01-27T09:35:58.055 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9625 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-sunplus.ko 2021-01-27T09:35:58.056 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-tivo.ko 2021-01-27T09:35:58.056 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-tmff.ko 2021-01-27T09:35:58.056 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17969 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-topseed.ko 2021-01-27T09:35:58.056 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20201 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-twinhan.ko 2021-01-27T09:35:58.057 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 48561 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-uclogic.ko 2021-01-27T09:35:58.057 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10161 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-waltop.ko 2021-01-27T09:35:58.057 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 133761 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-wiimote.ko 2021-01-27T09:35:58.057 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7449 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-xinmo.ko 2021-01-27T09:35:58.057 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11865 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-zpff.ko 2021-01-27T09:35:58.058 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid-zydacron.ko 2021-01-27T09:35:58.058 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 285009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/hid.ko 2021-01-27T09:35:58.058 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/i2c-hid/ 2021-01-27T09:35:58.058 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 52441 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/i2c-hid/i2c-hid.ko 2021-01-27T09:35:58.058 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/uhid.ko 2021-01-27T09:35:58.059 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/usbhid/ 2021-01-27T09:35:58.059 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 125185 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/usbhid/usbhid.ko 2021-01-27T09:35:58.060 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19065 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/usbhid/usbkbd.ko 2021-01-27T09:35:58.060 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14473 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/usbhid/usbmouse.ko 2021-01-27T09:35:58.060 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 222145 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hid/wacom.ko 2021-01-27T09:35:58.061 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hv/ 2021-01-27T09:35:58.061 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hv/hv_balloon.ko 2021-01-27T09:35:58.061 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 79521 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hv/hv_utils.ko 2021-01-27T09:35:58.061 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 281385 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hv/hv_vmbus.ko 2021-01-27T09:35:58.063 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/ 2021-01-27T09:35:58.063 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 65665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/abituguru.ko 2021-01-27T09:35:58.063 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 61489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/abituguru3.ko 2021-01-27T09:35:58.064 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/acpi_power_meter.ko 2021-01-27T09:35:58.065 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17041 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/ad7414.ko 2021-01-27T09:35:58.065 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/ad7418.ko 2021-01-27T09:35:58.065 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24409 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/adc128d818.ko 2021-01-27T09:35:58.066 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25249 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/adm1021.ko 2021-01-27T09:35:58.066 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31025 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/adm1025.ko 2021-01-27T09:35:58.066 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 98529 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/adm1026.ko 2021-01-27T09:35:58.067 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19273 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/adm1029.ko 2021-01-27T09:35:58.067 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44889 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/adm1031.ko 2021-01-27T09:35:58.068 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 39081 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/adm9240.ko 2021-01-27T09:35:58.068 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/ads7828.ko 2021-01-27T09:35:58.068 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/adt7410.ko 2021-01-27T09:35:58.068 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22289 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/adt7411.ko 2021-01-27T09:35:58.069 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 75753 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/adt7462.ko 2021-01-27T09:35:58.069 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 60353 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/adt7470.ko 2021-01-27T09:35:58.069 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 66073 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/adt7475.ko 2021-01-27T09:35:58.070 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22633 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/adt7x10.ko 2021-01-27T09:35:58.070 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41913 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/amc6821.ko 2021-01-27T09:35:58.071 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51657 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/applesmc.ko 2021-01-27T09:35:58.071 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 49281 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/asb100.ko 2021-01-27T09:35:58.072 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 60777 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/asc7621.ko 2021-01-27T09:35:58.072 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41585 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/asus_atk0110.ko 2021-01-27T09:35:58.073 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/atxp1.ko 2021-01-27T09:35:58.073 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26121 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/coretemp.ko 2021-01-27T09:35:58.073 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23745 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/da9052-hwmon.ko 2021-01-27T09:35:58.074 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16753 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/da9055-hwmon.ko 2021-01-27T09:35:58.074 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51049 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/dell-smm-hwmon.ko 2021-01-27T09:35:58.075 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 87617 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/dme1737.ko 2021-01-27T09:35:58.076 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/ds1621.ko 2021-01-27T09:35:58.076 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14561 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/ds620.ko 2021-01-27T09:35:58.076 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31025 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/emc1403.ko 2021-01-27T09:35:58.077 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33025 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/emc2103.ko 2021-01-27T09:35:58.077 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29785 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/emc6w201.ko 2021-01-27T09:35:58.077 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 66817 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/f71805f.ko 2021-01-27T09:35:58.078 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 94761 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/f71882fg.ko 2021-01-27T09:35:58.078 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40529 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/f75375s.ko 2021-01-27T09:35:58.079 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/fam15h_power.ko 2021-01-27T09:35:58.079 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 54825 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/fschmd.ko 2021-01-27T09:35:58.079 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13585 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/g760a.ko 2021-01-27T09:35:58.080 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23505 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/g762.ko 2021-01-27T09:35:58.080 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 45001 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/gl518sm.ko 2021-01-27T09:35:58.080 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44353 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/gl520sm.ko 2021-01-27T09:35:58.081 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/hih6130.ko 2021-01-27T09:35:58.081 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12001 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/hwmon-vid.ko 2021-01-27T09:35:58.082 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12953 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/i5500_temp.ko 2021-01-27T09:35:58.082 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22113 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/i5k_amb.ko 2021-01-27T09:35:58.082 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/ibmaem.ko 2021-01-27T09:35:58.082 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21225 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/ibmpex.ko 2021-01-27T09:35:58.082 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25273 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/ina209.ko 2021-01-27T09:35:58.083 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28161 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/ina2xx.ko 2021-01-27T09:35:58.084 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 109433 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/it87.ko 2021-01-27T09:35:58.084 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16777 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/jc42.ko 2021-01-27T09:35:58.084 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22425 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/k10temp.ko 2021-01-27T09:35:58.084 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13297 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/k8temp.ko 2021-01-27T09:35:58.085 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18681 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/lineage-pem.ko 2021-01-27T09:35:58.085 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 48217 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/lm63.ko 2021-01-27T09:35:58.086 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16377 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/lm73.ko 2021-01-27T09:35:58.086 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34817 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/lm75.ko 2021-01-27T09:35:58.086 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/lm77.ko 2021-01-27T09:35:58.086 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34193 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/lm78.ko 2021-01-27T09:35:58.087 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31409 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/lm80.ko 2021-01-27T09:35:58.087 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21089 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/lm83.ko 2021-01-27T09:35:58.087 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 74913 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/lm85.ko 2021-01-27T09:35:58.088 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 45633 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/lm87.ko 2021-01-27T09:35:58.088 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 48353 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/lm90.ko 2021-01-27T09:35:58.088 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19265 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/lm92.ko 2021-01-27T09:35:58.088 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 104777 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/lm93.ko 2021-01-27T09:35:58.090 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32913 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/lm95234.ko 2021-01-27T09:35:58.090 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/lm95241.ko 2021-01-27T09:35:58.090 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20025 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/lm95245.ko 2021-01-27T09:35:58.090 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/ltc2945.ko 2021-01-27T09:35:58.091 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13065 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/ltc4151.ko 2021-01-27T09:35:58.091 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14913 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/ltc4215.ko 2021-01-27T09:35:58.091 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14673 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/ltc4222.ko 2021-01-27T09:35:58.091 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14585 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/ltc4245.ko 2021-01-27T09:35:58.091 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12681 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/ltc4260.ko 2021-01-27T09:35:58.092 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14553 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/ltc4261.ko 2021-01-27T09:35:58.093 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32889 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/max16065.ko 2021-01-27T09:35:58.093 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18065 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/max1619.ko 2021-01-27T09:35:58.093 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23361 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/max1668.ko 2021-01-27T09:35:58.094 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19617 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/max197.ko 2021-01-27T09:35:58.094 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25289 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/max6639.ko 2021-01-27T09:35:58.094 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16297 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/max6642.ko 2021-01-27T09:35:58.094 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24513 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/max6650.ko 2021-01-27T09:35:58.094 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/max6697.ko 2021-01-27T09:35:58.095 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17505 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/mc13783-adc.ko 2021-01-27T09:35:58.095 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10233 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/mcp3021.ko 2021-01-27T09:35:58.095 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15385 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2021-01-27T09:35:58.095 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41641 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/nct6683.ko 2021-01-27T09:35:58.096 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 124657 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/nct6775.ko 2021-01-27T09:35:58.097 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 58785 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/nct7802.ko 2021-01-27T09:35:58.097 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/ntc_thermistor.ko 2021-01-27T09:35:58.098 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 79809 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/pc87360.ko 2021-01-27T09:35:58.098 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53561 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/pc87427.ko 2021-01-27T09:35:58.098 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17713 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/pcf8591.ko 2021-01-27T09:35:58.098 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/pmbus/ 2021-01-27T09:35:58.098 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23969 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/pmbus/adm1275.ko 2021-01-27T09:35:58.099 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16769 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/pmbus/lm25066.ko 2021-01-27T09:35:58.099 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/pmbus/ltc2978.ko 2021-01-27T09:35:58.099 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8769 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/pmbus/max16064.ko 2021-01-27T09:35:58.099 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18329 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/pmbus/max34440.ko 2021-01-27T09:35:58.101 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10161 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/pmbus/max8688.ko 2021-01-27T09:35:58.101 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13569 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/pmbus/pmbus.ko 2021-01-27T09:35:58.101 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 63833 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2021-01-27T09:35:58.102 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7865 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/pmbus/tps40422.ko 2021-01-27T09:35:58.102 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26505 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/pmbus/ucd9000.ko 2021-01-27T09:35:58.102 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14561 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/pmbus/ucd9200.ko 2021-01-27T09:35:58.102 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18913 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/pmbus/zl6100.ko 2021-01-27T09:35:58.102 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20449 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/powr1220.ko 2021-01-27T09:35:58.103 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29977 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/sch5627.ko 2021-01-27T09:35:58.103 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28337 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/sch5636.ko 2021-01-27T09:35:58.103 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23385 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/sch56xx-common.ko 2021-01-27T09:35:58.103 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32577 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/sht15.ko 2021-01-27T09:35:58.104 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12977 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/sht21.ko 2021-01-27T09:35:58.104 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/shtc1.ko 2021-01-27T09:35:58.104 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 39897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/sis5595.ko 2021-01-27T09:35:58.104 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31337 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/smm665.ko 2021-01-27T09:35:58.104 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18833 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/smsc47b397.ko 2021-01-27T09:35:58.106 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36953 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/smsc47m1.ko 2021-01-27T09:35:58.106 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36833 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/smsc47m192.ko 2021-01-27T09:35:58.106 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25881 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/thmc50.ko 2021-01-27T09:35:58.106 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16657 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/tmp102.ko 2021-01-27T09:35:58.107 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13985 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/tmp103.ko 2021-01-27T09:35:58.107 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30569 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/tmp401.ko 2021-01-27T09:35:58.107 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/tmp421.ko 2021-01-27T09:35:58.107 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/via-cputemp.ko 2021-01-27T09:35:58.108 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/via686a.ko 2021-01-27T09:35:58.108 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 52321 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/vt1211.ko 2021-01-27T09:35:58.108 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50081 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/vt8231.ko 2021-01-27T09:35:58.108 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 60089 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/w83627ehf.ko 2021-01-27T09:35:58.108 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 77593 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/w83627hf.ko 2021-01-27T09:35:58.109 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 68561 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/w83781d.ko 2021-01-27T09:35:58.109 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 62969 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/w83791d.ko 2021-01-27T09:35:58.110 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 71353 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/w83792d.ko 2021-01-27T09:35:58.110 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 101705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/w83793.ko 2021-01-27T09:35:58.110 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 119937 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/w83795.ko 2021-01-27T09:35:58.111 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16729 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/w83l785ts.ko 2021-01-27T09:35:58.112 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/w83l786ng.ko 2021-01-27T09:35:58.112 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13049 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/wm831x-hwmon.ko 2021-01-27T09:35:58.112 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9857 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/hwmon/wm8350-hwmon.ko 2021-01-27T09:35:58.112 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/ 2021-01-27T09:35:58.112 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/algos/ 2021-01-27T09:35:58.113 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20185 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2021-01-27T09:35:58.113 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2021-01-27T09:35:58.113 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/ 2021-01-27T09:35:58.113 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25769 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-ali1535.ko 2021-01-27T09:35:58.114 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27001 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-ali1563.ko 2021-01-27T09:35:58.114 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25961 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2021-01-27T09:35:58.114 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2021-01-27T09:35:58.116 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24953 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-amd756.ko 2021-01-27T09:35:58.116 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16561 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-amd8111.ko 2021-01-27T09:35:58.116 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14265 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2021-01-27T09:35:58.116 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13785 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2021-01-27T09:35:58.116 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44761 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-designware-core.ko 2021-01-27T09:35:58.117 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20225 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2021-01-27T09:35:58.117 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18329 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2021-01-27T09:35:58.117 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17081 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2021-01-27T09:35:58.117 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11857 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-dln2.ko 2021-01-27T09:35:58.117 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14793 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-gpio.ko 2021-01-27T09:35:58.118 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 64913 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-i801.ko 2021-01-27T09:35:58.118 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-isch.ko 2021-01-27T09:35:58.118 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 47809 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-ismt.ko 2021-01-27T09:35:58.118 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16393 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-kempld.ko 2021-01-27T09:35:58.119 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17033 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2021-01-27T09:35:58.121 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21329 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-nforce2.ko 2021-01-27T09:35:58.121 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-ocores.ko 2021-01-27T09:35:58.121 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23865 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-parport.ko 2021-01-27T09:35:58.121 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15753 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2021-01-27T09:35:58.122 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 42041 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-piix4.ko 2021-01-27T09:35:58.122 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2021-01-27T09:35:58.122 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18881 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-scmi.ko 2021-01-27T09:35:58.122 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11529 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-simtec.ko 2021-01-27T09:35:58.122 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23105 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-sis5595.ko 2021-01-27T09:35:58.123 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29673 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-sis630.ko 2021-01-27T09:35:58.123 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19953 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-sis96x.ko 2021-01-27T09:35:58.123 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18625 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2021-01-27T09:35:58.123 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19569 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2021-01-27T09:35:58.123 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13505 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-via.ko 2021-01-27T09:35:58.124 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26537 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-viapro.ko 2021-01-27T09:35:58.124 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19537 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-viperboard.ko 2021-01-27T09:35:58.124 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40777 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/busses/i2c-xiic.ko 2021-01-27T09:35:58.124 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22409 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/i2c-mux.ko 2021-01-27T09:35:58.124 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17873 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/i2c-smbus.ko 2021-01-27T09:35:58.125 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26873 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/i2c-stub.ko 2021-01-27T09:35:58.125 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/muxes/ 2021-01-27T09:35:58.125 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12521 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2021-01-27T09:35:58.125 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12985 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2021-01-27T09:35:58.126 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26401 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2021-01-27T09:35:58.126 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/ 2021-01-27T09:35:58.126 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/core/ 2021-01-27T09:35:58.127 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 258649 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/core/ib_cm.ko 2021-01-27T09:35:58.127 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 850529 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/core/ib_core.ko 2021-01-27T09:35:58.142 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 68905 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/core/ib_umad.ko 2021-01-27T09:35:58.143 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 311665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/core/ib_uverbs.ko 2021-01-27T09:35:58.143 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 102977 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/core/iw_cm.ko 2021-01-27T09:35:58.144 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 264793 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/core/rdma_cm.ko 2021-01-27T09:35:58.145 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 63369 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/core/rdma_ucm.ko 2021-01-27T09:35:58.145 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/hw/ 2021-01-27T09:35:58.146 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/hw/cxgb4/ 2021-01-27T09:35:58.146 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 508649 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2021-01-27T09:35:58.152 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/hw/mlx4/ 2021-01-27T09:35:58.153 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 421745 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2021-01-27T09:35:58.158 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/hw/mlx5/ 2021-01-27T09:35:58.159 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 719401 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2021-01-27T09:35:58.169 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/hw/mthca/ 2021-01-27T09:35:58.169 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 287593 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2021-01-27T09:35:58.173 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/hw/ocrdma/ 2021-01-27T09:35:58.173 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 162577 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2021-01-27T09:35:58.175 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/hw/usnic/ 2021-01-27T09:35:58.175 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 178713 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2021-01-27T09:35:58.177 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/ulp/ 2021-01-27T09:35:58.178 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/ulp/ipoib/ 2021-01-27T09:35:58.178 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 274105 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2021-01-27T09:35:58.181 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/ulp/iser/ 2021-01-27T09:35:58.182 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 105489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2021-01-27T09:35:58.182 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/ulp/isert/ 2021-01-27T09:35:58.183 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 117361 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2021-01-27T09:35:58.183 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/ulp/srp/ 2021-01-27T09:35:58.184 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 134153 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2021-01-27T09:35:58.185 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/ulp/srpt/ 2021-01-27T09:35:58.186 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 131841 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2021-01-27T09:35:58.187 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/ 2021-01-27T09:35:58.187 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10033 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/evbug.ko 2021-01-27T09:35:58.187 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24481 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/ff-memless.ko 2021-01-27T09:35:58.189 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/gameport/ 2021-01-27T09:35:58.189 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11481 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/gameport/emu10k1-gp.ko 2021-01-27T09:35:58.190 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11689 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/gameport/fm801-gp.ko 2021-01-27T09:35:58.190 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38497 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/gameport/gameport.ko 2021-01-27T09:35:58.191 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11681 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/gameport/lightning.ko 2021-01-27T09:35:58.191 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/gameport/ns558.ko 2021-01-27T09:35:58.192 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40873 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/joydev.ko 2021-01-27T09:35:58.195 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/ 2021-01-27T09:35:58.195 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12657 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/adp5520-keys.ko 2021-01-27T09:35:58.196 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25185 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/adp5588-keys.ko 2021-01-27T09:35:58.196 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25785 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/adp5589-keys.ko 2021-01-27T09:35:58.197 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22537 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2021-01-27T09:35:58.197 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35921 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/gpio_keys.ko 2021-01-27T09:35:58.197 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19217 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2021-01-27T09:35:58.197 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/lkkbd.ko 2021-01-27T09:35:58.197 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/lm8323.ko 2021-01-27T09:35:58.198 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14505 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/lm8333.ko 2021-01-27T09:35:58.198 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23881 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/matrix_keypad.ko 2021-01-27T09:35:58.198 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16385 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/max7359_keypad.ko 2021-01-27T09:35:58.198 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15281 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/mcs_touchkey.ko 2021-01-27T09:35:58.199 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2021-01-27T09:35:58.199 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11113 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/newtonkbd.ko 2021-01-27T09:35:58.199 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10313 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/opencores-kbd.ko 2021-01-27T09:35:58.199 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14481 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/qt1070.ko 2021-01-27T09:35:58.199 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21041 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/qt2160.ko 2021-01-27T09:35:58.200 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/samsung-keypad.ko 2021-01-27T09:35:58.200 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10713 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/stowaway.ko 2021-01-27T09:35:58.200 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17385 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/sunkbd.ko 2021-01-27T09:35:58.200 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20041 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/tca6416-keypad.ko 2021-01-27T09:35:58.200 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15785 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/tca8418_keypad.ko 2021-01-27T09:35:58.201 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16457 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/twl4030_keypad.ko 2021-01-27T09:35:58.201 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11225 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/keyboard/xtkbd.ko 2021-01-27T09:35:58.201 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12017 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/matrix-keymap.ko 2021-01-27T09:35:58.201 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/mouse/ 2021-01-27T09:35:58.202 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35569 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/mouse/appletouch.ko 2021-01-27T09:35:58.202 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34465 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/mouse/bcm5974.ko 2021-01-27T09:35:58.202 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 124801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/mouse/cyapatp.ko 2021-01-27T09:35:58.203 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 94673 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/mouse/elan_i2c.ko 2021-01-27T09:35:58.203 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13881 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/mouse/gpio_mouse.ko 2021-01-27T09:35:58.204 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 339321 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/mouse/psmouse.ko 2021-01-27T09:35:58.204 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/mouse/sermouse.ko 2021-01-27T09:35:58.204 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22545 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/mouse/synaptics_i2c.ko 2021-01-27T09:35:58.204 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22121 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/mouse/synaptics_usb.ko 2021-01-27T09:35:58.205 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15641 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/mouse/vsxxxaa.ko 2021-01-27T09:35:58.205 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/rmi4/ 2021-01-27T09:35:58.205 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 113473 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/rmi4/rmi_core.ko 2021-01-27T09:35:58.207 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/serio/ 2021-01-27T09:35:58.207 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11105 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/serio/altera_ps2.ko 2021-01-27T09:35:58.207 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16273 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/serio/arc_ps2.ko 2021-01-27T09:35:58.207 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14601 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/serio/ct82c710.ko 2021-01-27T09:35:58.208 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/serio/hyperv-keyboard.ko 2021-01-27T09:35:58.208 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14625 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/serio/parkbd.ko 2021-01-27T09:35:58.208 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/serio/pcips2.ko 2021-01-27T09:35:58.208 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/serio/ps2mult.ko 2021-01-27T09:35:58.208 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23753 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/serio/serio_raw.ko 2021-01-27T09:35:58.209 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/serio/serport.ko 2021-01-27T09:35:58.209 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12569 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/input/sparse-keymap.ko 2021-01-27T09:35:58.209 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/iommu/ 2021-01-27T09:35:58.209 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/iommu/amd/ 2021-01-27T09:35:58.209 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/iommu/amd/iommu_v2.ko 2021-01-27T09:35:58.210 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/ 2021-01-27T09:35:58.210 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-88pm860x.ko 2021-01-27T09:35:58.210 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11121 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-adp5520.ko 2021-01-27T09:35:58.210 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 48633 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-bd2802.ko 2021-01-27T09:35:58.215 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24553 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-blinkm.ko 2021-01-27T09:35:58.215 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16969 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-clevo-mail.ko 2021-01-27T09:35:58.216 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9841 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-da903x.ko 2021-01-27T09:35:58.216 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12161 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-da9052.ko 2021-01-27T09:35:58.216 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14673 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-gpio.ko 2021-01-27T09:35:58.216 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15393 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-lm3530.ko 2021-01-27T09:35:58.217 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30057 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-lm3533.ko 2021-01-27T09:35:58.217 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20089 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-lm355x.ko 2021-01-27T09:35:58.217 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19209 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-lm3642.ko 2021-01-27T09:35:58.217 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15865 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-lp3944.ko 2021-01-27T09:35:58.217 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10785 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-lp8788.ko 2021-01-27T09:35:58.218 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14601 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-max8997.ko 2021-01-27T09:35:58.218 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11721 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-mc13783.ko 2021-01-27T09:35:58.218 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12593 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-menf21bmc.ko 2021-01-27T09:35:58.218 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-pca9532.ko 2021-01-27T09:35:58.219 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18369 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-pca955x.ko 2021-01-27T09:35:58.219 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17249 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-pca963x.ko 2021-01-27T09:35:58.219 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-ss4200.ko 2021-01-27T09:35:58.219 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-tca6507.ko 2021-01-27T09:35:58.220 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15401 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-wm831x-status.ko 2021-01-27T09:35:58.220 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11465 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/leds-wm8350.ko 2021-01-27T09:35:58.221 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/trigger/ 2021-01-27T09:35:58.221 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8081 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/trigger/ledtrig-audio.ko 2021-01-27T09:35:58.221 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10113 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2021-01-27T09:35:58.221 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8145 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/trigger/ledtrig-camera.ko 2021-01-27T09:35:58.222 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6849 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2021-01-27T09:35:58.222 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14969 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2021-01-27T09:35:58.222 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13377 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2021-01-27T09:35:58.222 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13465 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2021-01-27T09:35:58.222 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11441 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/trigger/ledtrig-timer.ko 2021-01-27T09:35:58.223 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13217 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/leds/trigger/ledtrig-transient.ko 2021-01-27T09:35:58.223 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/ 2021-01-27T09:35:58.223 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/bcache/ 2021-01-27T09:35:58.223 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 635105 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/bcache/bcache.ko 2021-01-27T09:35:58.224 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34761 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/dm-bio-prison.ko 2021-01-27T09:35:58.224 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 77617 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/dm-bufio.ko 2021-01-27T09:35:58.225 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 45441 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/dm-cache-smq.ko 2021-01-27T09:35:58.225 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 146729 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/dm-cache.ko 2021-01-27T09:35:58.225 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 101801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/dm-crypt.ko 2021-01-27T09:35:58.226 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21233 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/dm-delay.ko 2021-01-27T09:35:58.226 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 55657 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/dm-era.ko 2021-01-27T09:35:58.226 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19961 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/dm-flakey.ko 2021-01-27T09:35:58.227 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 42561 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/dm-log-userspace.ko 2021-01-27T09:35:58.227 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32425 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/dm-log.ko 2021-01-27T09:35:58.228 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 48009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/dm-mirror.ko 2021-01-27T09:35:58.228 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 75633 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/dm-multipath.ko 2021-01-27T09:35:58.229 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15841 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/dm-queue-length.ko 2021-01-27T09:35:58.229 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 69345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/dm-raid.ko 2021-01-27T09:35:58.230 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/dm-region-hash.ko 2021-01-27T09:35:58.230 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15313 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/dm-round-robin.ko 2021-01-27T09:35:58.231 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16105 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/dm-service-time.ko 2021-01-27T09:35:58.231 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 113369 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/dm-snapshot.ko 2021-01-27T09:35:58.232 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/dm-switch.ko 2021-01-27T09:35:58.232 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 182441 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/dm-thin-pool.ko 2021-01-27T09:35:58.234 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44121 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/dm-verity.ko 2021-01-27T09:35:58.235 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7961 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/dm-zero.ko 2021-01-27T09:35:58.235 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14585 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/faulty.ko 2021-01-27T09:35:58.236 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20001 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/linear.ko 2021-01-27T09:35:58.236 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33161 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/multipath.ko 2021-01-27T09:35:58.237 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/persistent-data/ 2021-01-27T09:35:58.237 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 179537 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2021-01-27T09:35:58.238 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 39865 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/raid0.ko 2021-01-27T09:35:58.238 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 111705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/raid1.ko 2021-01-27T09:35:58.240 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 148689 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/raid10.ko 2021-01-27T09:35:58.242 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 385537 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/md/raid456.ko 2021-01-27T09:35:58.248 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/message/ 2021-01-27T09:35:58.248 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/message/fusion/ 2021-01-27T09:35:58.248 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 193961 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/message/fusion/mptbase.ko 2021-01-27T09:35:58.250 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 70425 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/message/fusion/mptctl.ko 2021-01-27T09:35:58.251 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44857 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/message/fusion/mptfc.ko 2021-01-27T09:35:58.252 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36529 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/message/fusion/mptlan.ko 2021-01-27T09:35:58.252 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 130345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/message/fusion/mptsas.ko 2021-01-27T09:35:58.254 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 90657 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/message/fusion/mptscsih.ko 2021-01-27T09:35:58.255 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53329 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/message/fusion/mptspi.ko 2021-01-27T09:35:58.256 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/ 2021-01-27T09:35:58.256 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17585 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/88pm800.ko 2021-01-27T09:35:58.257 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12249 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/88pm805.ko 2021-01-27T09:35:58.257 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10993 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/88pm80x.ko 2021-01-27T09:35:58.257 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15361 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/ab3100-otp.ko 2021-01-27T09:35:58.257 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11025 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/arizona-i2c.ko 2021-01-27T09:35:58.258 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11577 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/bcm590xx.ko 2021-01-27T09:35:58.259 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/cros_ec_dev.ko 2021-01-27T09:35:58.259 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34945 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/dln2.ko 2021-01-27T09:35:58.259 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/htc-pasic3.ko 2021-01-27T09:35:58.259 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16233 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/janz-cmodio.ko 2021-01-27T09:35:58.260 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51217 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/kempld-core.ko 2021-01-27T09:35:58.260 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32049 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/lm3533-core.ko 2021-01-27T09:35:58.260 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14585 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/lm3533-ctrlbank.ko 2021-01-27T09:35:58.260 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12041 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/lp3943.ko 2021-01-27T09:35:58.261 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 49393 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/lpc_ich.ko 2021-01-27T09:35:58.263 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12017 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/lpc_sch.ko 2021-01-27T09:35:58.263 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17321 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/max8907.ko 2021-01-27T09:35:58.263 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28793 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/mc13xxx-core.ko 2021-01-27T09:35:58.263 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11177 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/mc13xxx-i2c.ko 2021-01-27T09:35:58.263 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10609 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/menf21bmc.ko 2021-01-27T09:35:58.264 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16497 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/pcf50633-adc.ko 2021-01-27T09:35:58.264 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8497 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/pcf50633-gpio.ko 2021-01-27T09:35:58.264 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33737 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/pcf50633.ko 2021-01-27T09:35:58.264 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9561 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/rdc321x-southbridge.ko 2021-01-27T09:35:58.265 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19433 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/retu-mfd.ko 2021-01-27T09:35:58.265 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 76489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/si476x-core.ko 2021-01-27T09:35:58.265 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 48065 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/sm501.ko 2021-01-27T09:35:58.265 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17577 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/ti_am335x_tscadc.ko 2021-01-27T09:35:58.265 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50721 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/tps65010.ko 2021-01-27T09:35:58.266 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9721 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/tps6507x.ko 2021-01-27T09:35:58.266 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12881 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/viperboard.ko 2021-01-27T09:35:58.268 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10025 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/vx855.ko 2021-01-27T09:35:58.268 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16673 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/wl1273-core.ko 2021-01-27T09:35:58.269 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53961 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/mfd/wm8994.ko 2021-01-27T09:35:58.269 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/ 2021-01-27T09:35:58.269 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/ad525x_dpot-i2c.ko 2021-01-27T09:35:58.269 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38161 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/ad525x_dpot.ko 2021-01-27T09:35:58.269 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/altera-stapl/ 2021-01-27T09:35:58.270 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53921 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2021-01-27T09:35:58.270 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/apds9802als.ko 2021-01-27T09:35:58.270 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 37001 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/apds990x.ko 2021-01-27T09:35:58.270 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44585 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/bh1770glc.ko 2021-01-27T09:35:58.271 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/c2port/ 2021-01-27T09:35:58.271 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10217 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2021-01-27T09:35:58.271 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34217 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/c2port/core.ko 2021-01-27T09:35:58.271 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/cb710/ 2021-01-27T09:35:58.271 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24025 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/cb710/cb710.ko 2021-01-27T09:35:58.272 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17521 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/ds1682.ko 2021-01-27T09:35:58.272 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8481 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/dummy-irq.ko 2021-01-27T09:35:58.272 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/echo/ 2021-01-27T09:35:58.272 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13425 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/echo/echo.ko 2021-01-27T09:35:58.272 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/eeprom/ 2021-01-27T09:35:58.273 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36609 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/eeprom/at24.ko 2021-01-27T09:35:58.273 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/eeprom/eeprom.ko 2021-01-27T09:35:58.273 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13793 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2021-01-27T09:35:58.273 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13113 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/eeprom/max6875.ko 2021-01-27T09:35:58.273 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32121 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/enclosure.ko 2021-01-27T09:35:58.275 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/genwqe/ 2021-01-27T09:35:58.275 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 150873 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/genwqe/genwqe_card.ko 2021-01-27T09:35:58.275 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14145 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/hmc6352.ko 2021-01-27T09:35:58.276 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31689 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/hpilo.ko 2021-01-27T09:35:58.276 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/ibmasm/ 2021-01-27T09:35:58.276 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 71545 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/ibmasm/ibmasm.ko 2021-01-27T09:35:58.276 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19337 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/ics932s401.ko 2021-01-27T09:35:58.277 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18369 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/isl29003.ko 2021-01-27T09:35:58.277 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15369 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/isl29020.ko 2021-01-27T09:35:58.277 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/lis3lv02d/ 2021-01-27T09:35:58.277 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 42785 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2021-01-27T09:35:58.277 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13401 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2021-01-27T09:35:58.278 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/mei/ 2021-01-27T09:35:58.278 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 121585 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/mei/mei-me.ko 2021-01-27T09:35:58.278 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 56841 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/mei/mei-txe.ko 2021-01-27T09:35:58.279 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 282321 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/mei/mei.ko 2021-01-27T09:35:58.279 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31601 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/phantom.ko 2021-01-27T09:35:58.280 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9737 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/pvpanic.ko 2021-01-27T09:35:58.280 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/ti-st/ 2021-01-27T09:35:58.280 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 74937 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/ti-st/st_drv.ko 2021-01-27T09:35:58.281 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23761 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/tifm_7xx1.ko 2021-01-27T09:35:58.281 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26721 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/tifm_core.ko 2021-01-27T09:35:58.282 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18289 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/tsl2550.ko 2021-01-27T09:35:58.282 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 47785 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/vmw_balloon.ko 2021-01-27T09:35:58.282 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/vmw_vmci/ 2021-01-27T09:35:58.283 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 179489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2021-01-27T09:35:58.284 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ 2021-01-27T09:35:58.285 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/bonding/ 2021-01-27T09:35:58.285 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 434129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/bonding/bonding.ko 2021-01-27T09:35:58.291 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/dsa/ 2021-01-27T09:35:58.291 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/dsa/b53/ 2021-01-27T09:35:58.291 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 96945 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/dsa/b53/b53_common.ko 2021-01-27T09:35:58.293 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38633 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/dsa/bcm-sf2.ko 2021-01-27T09:35:58.293 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13457 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/dsa/mv88e6060.ko 2021-01-27T09:35:58.294 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/dsa/mv88e6xxx/ 2021-01-27T09:35:58.294 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 354137 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2021-01-27T09:35:58.296 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15569 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/dummy.ko 2021-01-27T09:35:58.297 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17721 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/eql.ko 2021-01-27T09:35:58.297 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/ 2021-01-27T09:35:58.297 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/3com/ 2021-01-27T09:35:58.298 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44081 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2021-01-27T09:35:58.298 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41225 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2021-01-27T09:35:58.298 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 123233 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/3com/3c59x.ko 2021-01-27T09:35:58.299 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 68729 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/3com/typhoon.ko 2021-01-27T09:35:58.300 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/8390/ 2021-01-27T09:35:58.300 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36729 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/8390/8390.ko 2021-01-27T09:35:58.301 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 56121 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2021-01-27T09:35:58.301 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27249 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2021-01-27T09:35:58.302 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 96897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2021-01-27T09:35:58.303 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/adaptec/ 2021-01-27T09:35:58.303 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 56633 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/adaptec/starfire.ko 2021-01-27T09:35:58.304 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/agere/ 2021-01-27T09:35:58.304 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 68945 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/agere/et131x.ko 2021-01-27T09:35:58.305 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/alteon/ 2021-01-27T09:35:58.305 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 58825 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/alteon/acenic.ko 2021-01-27T09:35:58.305 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/altera/ 2021-01-27T09:35:58.306 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40641 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/altera/altera_tse.ko 2021-01-27T09:35:58.307 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/amd/ 2021-01-27T09:35:58.307 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 52649 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/amd/amd8111e.ko 2021-01-27T09:35:58.307 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 49169 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2021-01-27T09:35:58.308 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 90345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/amd/pcnet32.ko 2021-01-27T09:35:58.308 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/atheros/ 2021-01-27T09:35:58.309 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/atheros/alx/ 2021-01-27T09:35:58.309 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 91633 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2021-01-27T09:35:58.310 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/atheros/atl1c/ 2021-01-27T09:35:58.310 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 98009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2021-01-27T09:35:58.311 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/atheros/atl1e/ 2021-01-27T09:35:58.311 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 89801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2021-01-27T09:35:58.312 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/atheros/atlx/ 2021-01-27T09:35:58.313 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 86753 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2021-01-27T09:35:58.313 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 70145 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2021-01-27T09:35:58.314 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/broadcom/ 2021-01-27T09:35:58.314 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 78081 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/broadcom/b44.ko 2021-01-27T09:35:58.315 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 167089 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2021-01-27T09:35:58.318 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2021-01-27T09:35:58.318 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1527641 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2021-01-27T09:35:58.340 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 130129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/broadcom/cnic.ko 2021-01-27T09:35:58.342 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/broadcom/genet/ 2021-01-27T09:35:58.342 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 129337 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2021-01-27T09:35:58.344 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 314705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/broadcom/tg3.ko 2021-01-27T09:35:58.349 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/brocade/ 2021-01-27T09:35:58.349 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/brocade/bna/ 2021-01-27T09:35:58.349 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 330369 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2021-01-27T09:35:58.353 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/chelsio/ 2021-01-27T09:35:58.353 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/chelsio/cxgb/ 2021-01-27T09:35:58.353 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 187313 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2021-01-27T09:35:58.356 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2021-01-27T09:35:58.356 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 350033 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2021-01-27T09:35:58.360 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2021-01-27T09:35:58.361 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1040929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2021-01-27T09:35:58.376 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2021-01-27T09:35:58.376 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 165353 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2021-01-27T09:35:58.377 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2021-01-27T09:35:58.377 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2021-01-27T09:35:58.378 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/cisco/ 2021-01-27T09:35:58.378 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/cisco/enic/ 2021-01-27T09:35:58.378 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 205241 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2021-01-27T09:35:58.380 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/dec/ 2021-01-27T09:35:58.380 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/dec/tulip/ 2021-01-27T09:35:58.380 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 70273 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2021-01-27T09:35:58.381 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 97817 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/dec/tulip/de4x5.ko 2021-01-27T09:35:58.382 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 57105 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2021-01-27T09:35:58.383 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 147233 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2021-01-27T09:35:58.384 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 49753 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2021-01-27T09:35:58.385 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 63761 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2021-01-27T09:35:58.386 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2021-01-27T09:35:58.386 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/dlink/ 2021-01-27T09:35:58.386 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 61209 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/dlink/dl2k.ko 2021-01-27T09:35:58.387 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 63265 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/dlink/sundance.ko 2021-01-27T09:35:58.388 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 45625 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/dnet.ko 2021-01-27T09:35:58.388 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/ec_bhf.ko 2021-01-27T09:35:58.389 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/emulex/ 2021-01-27T09:35:58.389 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/emulex/benet/ 2021-01-27T09:35:58.389 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 287249 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2021-01-27T09:35:58.392 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 49377 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/ethoc.ko 2021-01-27T09:35:58.393 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 52353 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/fealnx.ko 2021-01-27T09:35:58.394 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/fujitsu/ 2021-01-27T09:35:58.394 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44113 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2021-01-27T09:35:58.394 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/intel/ 2021-01-27T09:35:58.395 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 91713 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/intel/e100.ko 2021-01-27T09:35:58.395 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/intel/e1000/ 2021-01-27T09:35:58.395 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 293121 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2021-01-27T09:35:58.399 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/intel/e1000e/ 2021-01-27T09:35:58.399 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 550321 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2021-01-27T09:35:58.406 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/intel/fm10k/ 2021-01-27T09:35:58.407 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 247545 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2021-01-27T09:35:58.410 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/intel/i40e/ 2021-01-27T09:35:58.410 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 895169 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2021-01-27T09:35:58.422 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/intel/iavf/ 2021-01-27T09:35:58.423 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 250857 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2021-01-27T09:35:58.425 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/intel/igb/ 2021-01-27T09:35:58.426 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 509905 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/intel/igb/igb.ko 2021-01-27T09:35:58.432 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/intel/igbvf/ 2021-01-27T09:35:58.433 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 90841 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2021-01-27T09:35:58.433 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/intel/ixgb/ 2021-01-27T09:35:58.433 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 123929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2021-01-27T09:35:58.434 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/intel/ixgbe/ 2021-01-27T09:35:58.434 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 743521 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2021-01-27T09:35:58.444 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/intel/ixgbevf/ 2021-01-27T09:35:58.445 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 147089 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2021-01-27T09:35:58.446 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 82321 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/jme.ko 2021-01-27T09:35:58.447 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/marvell/ 2021-01-27T09:35:58.447 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18001 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2021-01-27T09:35:58.448 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 103049 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/marvell/skge.ko 2021-01-27T09:35:58.449 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 130137 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/marvell/sky2.ko 2021-01-27T09:35:58.450 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/mellanox/ 2021-01-27T09:35:58.451 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/mellanox/mlx4/ 2021-01-27T09:35:58.451 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 739625 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2021-01-27T09:35:58.462 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 274817 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2021-01-27T09:35:58.465 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/mellanox/mlx5/ 2021-01-27T09:35:58.465 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2021-01-27T09:35:58.465 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 921369 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2021-01-27T09:35:58.477 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/micrel/ 2021-01-27T09:35:58.478 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 52201 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/micrel/ks8842.ko 2021-01-27T09:35:58.479 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 48409 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/micrel/ks8851_mll.ko 2021-01-27T09:35:58.479 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 94721 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2021-01-27T09:35:58.479 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/myricom/ 2021-01-27T09:35:58.479 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/myricom/myri10ge/ 2021-01-27T09:35:58.479 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 112529 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2021-01-27T09:35:58.480 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/natsemi/ 2021-01-27T09:35:58.480 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 75745 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2021-01-27T09:35:58.482 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50593 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2021-01-27T09:35:58.482 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/neterion/ 2021-01-27T09:35:58.482 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 156729 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/neterion/s2io.ko 2021-01-27T09:35:58.483 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/neterion/vxge/ 2021-01-27T09:35:58.484 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 221961 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/neterion/vxge/vxge.ko 2021-01-27T09:35:58.487 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/nvidia/ 2021-01-27T09:35:58.487 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 141657 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2021-01-27T09:35:58.489 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/packetengines/ 2021-01-27T09:35:58.489 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50313 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2021-01-27T09:35:58.490 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 43297 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2021-01-27T09:35:58.490 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/qlogic/ 2021-01-27T09:35:58.491 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/qlogic/netxen/ 2021-01-27T09:35:58.491 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 242793 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2021-01-27T09:35:58.493 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 88425 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2021-01-27T09:35:58.494 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2021-01-27T09:35:58.494 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 706097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2021-01-27T09:35:58.504 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/rdc/ 2021-01-27T09:35:58.504 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/rdc/r6040.ko 2021-01-27T09:35:58.504 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/realtek/ 2021-01-27T09:35:58.504 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 67793 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/realtek/8139cp.ko 2021-01-27T09:35:58.505 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 83769 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/realtek/8139too.ko 2021-01-27T09:35:58.505 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28761 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/realtek/atp.ko 2021-01-27T09:35:58.506 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 173993 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/realtek/r8169.ko 2021-01-27T09:35:58.508 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/samsung/ 2021-01-27T09:35:58.508 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/samsung/sxgbe/ 2021-01-27T09:35:58.509 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 104641 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2021-01-27T09:35:58.510 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/sfc/ 2021-01-27T09:35:58.510 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 824825 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/sfc/sfc.ko 2021-01-27T09:35:58.521 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/silan/ 2021-01-27T09:35:58.521 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 46097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/silan/sc92031.ko 2021-01-27T09:35:58.522 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/sis/ 2021-01-27T09:35:58.522 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 52489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/sis/sis190.ko 2021-01-27T09:35:58.522 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 64577 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/sis/sis900.ko 2021-01-27T09:35:58.523 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/smsc/ 2021-01-27T09:35:58.523 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 62121 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/smsc/epic100.ko 2021-01-27T09:35:58.523 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 66993 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2021-01-27T09:35:58.524 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 74585 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2021-01-27T09:35:58.525 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 68777 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2021-01-27T09:35:58.526 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/stmicro/ 2021-01-27T09:35:58.526 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/stmicro/stmmac/ 2021-01-27T09:35:58.526 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2021-01-27T09:35:58.526 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27753 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2021-01-27T09:35:58.527 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11441 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2021-01-27T09:35:58.527 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 382593 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2021-01-27T09:35:58.531 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/sun/ 2021-01-27T09:35:58.532 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 106929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/sun/cassini.ko 2021-01-27T09:35:58.533 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 176721 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/sun/niu.ko 2021-01-27T09:35:58.536 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 68145 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/sun/sungem.ko 2021-01-27T09:35:58.537 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 55449 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/sun/sunhme.ko 2021-01-27T09:35:58.537 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/tehuti/ 2021-01-27T09:35:58.537 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50049 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2021-01-27T09:35:58.538 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/ti/ 2021-01-27T09:35:58.538 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 78257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/ti/tlan.ko 2021-01-27T09:35:58.539 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/via/ 2021-01-27T09:35:58.539 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 82465 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/via/via-rhine.ko 2021-01-27T09:35:58.540 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 86089 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/via/via-velocity.ko 2021-01-27T09:35:58.541 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/wiznet/ 2021-01-27T09:35:58.541 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 45681 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/wiznet/w5100.ko 2021-01-27T09:35:58.542 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30969 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/wiznet/w5300.ko 2021-01-27T09:35:58.542 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/xircom/ 2021-01-27T09:35:58.542 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 58297 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2021-01-27T09:35:58.543 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/fddi/ 2021-01-27T09:35:58.543 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38569 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/fddi/defxx.ko 2021-01-27T09:35:58.543 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/fddi/skfp/ 2021-01-27T09:35:58.543 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 236873 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/fddi/skfp/skfp.ko 2021-01-27T09:35:58.546 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 78073 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/geneve.ko 2021-01-27T09:35:58.547 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/hyperv/ 2021-01-27T09:35:58.548 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 227873 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/hyperv/hv_netvsc.ko 2021-01-27T09:35:58.550 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ieee802154/ 2021-01-27T09:35:58.551 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17537 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ieee802154/fakelb.ko 2021-01-27T09:35:58.551 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20433 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ifb.ko 2021-01-27T09:35:58.551 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ipvlan/ 2021-01-27T09:35:58.552 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 84801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ipvlan/ipvlan.ko 2021-01-27T09:35:58.553 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 57777 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/macvlan.ko 2021-01-27T09:35:58.553 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14545 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/macvtap.ko 2021-01-27T09:35:58.553 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/mdio/ 2021-01-27T09:35:58.553 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19121 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2021-01-27T09:35:58.553 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/mdio/mdio-bitbang.ko 2021-01-27T09:35:58.554 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12905 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/mdio/mdio-gpio.ko 2021-01-27T09:35:58.555 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16545 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/mdio.ko 2021-01-27T09:35:58.556 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/mii.ko 2021-01-27T09:35:58.556 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40385 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/netconsole.ko 2021-01-27T09:35:58.556 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12089 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/nlmon.ko 2021-01-27T09:35:58.556 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/pcs/ 2021-01-27T09:35:58.557 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16329 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/pcs/pcs-xpcs.ko 2021-01-27T09:35:58.557 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/phy/ 2021-01-27T09:35:58.557 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9049 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/phy/amd.ko 2021-01-27T09:35:58.557 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40209 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/phy/bcm-phy-lib.ko 2021-01-27T09:35:58.558 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32481 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/phy/bcm7xxx.ko 2021-01-27T09:35:58.558 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/phy/bcm87xx.ko 2021-01-27T09:35:58.558 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31969 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/phy/broadcom.ko 2021-01-27T09:35:58.558 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9769 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/phy/cicada.ko 2021-01-27T09:35:58.558 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11953 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/phy/davicom.ko 2021-01-27T09:35:58.559 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8609 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/phy/et1011c.ko 2021-01-27T09:35:58.559 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15977 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/phy/icplus.ko 2021-01-27T09:35:58.559 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14921 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/phy/lxt.ko 2021-01-27T09:35:58.561 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 67577 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/phy/marvell.ko 2021-01-27T09:35:58.562 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36193 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/phy/micrel.ko 2021-01-27T09:35:58.562 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11329 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/phy/national.ko 2021-01-27T09:35:58.562 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 77393 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/phy/phylink.ko 2021-01-27T09:35:58.562 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/phy/qsemi.ko 2021-01-27T09:35:58.563 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 39345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/phy/realtek.ko 2021-01-27T09:35:58.563 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/phy/smsc.ko 2021-01-27T09:35:58.563 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10049 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/phy/ste10Xp.ko 2021-01-27T09:35:58.563 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22593 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/phy/vitesse.ko 2021-01-27T09:35:58.564 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/plip/ 2021-01-27T09:35:58.564 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 43265 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/plip/plip.ko 2021-01-27T09:35:58.564 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ppp/ 2021-01-27T09:35:58.564 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15721 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ppp/bsd_comp.ko 2021-01-27T09:35:58.564 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29777 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ppp/ppp_async.ko 2021-01-27T09:35:58.565 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17457 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ppp/ppp_deflate.ko 2021-01-27T09:35:58.565 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18585 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ppp/ppp_mppe.ko 2021-01-27T09:35:58.565 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ppp/ppp_synctty.ko 2021-01-27T09:35:58.565 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 55857 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ppp/pppoe.ko 2021-01-27T09:35:58.565 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ppp/pppox.ko 2021-01-27T09:35:58.567 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30689 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/ppp/pptp.ko 2021-01-27T09:35:58.567 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28617 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/sb1000.ko 2021-01-27T09:35:58.567 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/slip/ 2021-01-27T09:35:58.568 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41329 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/slip/slip.ko 2021-01-27T09:35:58.568 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/sungem_phy.ko 2021-01-27T09:35:58.568 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 61761 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/tap.ko 2021-01-27T09:35:58.568 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/team/ 2021-01-27T09:35:58.569 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 102801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/team/team.ko 2021-01-27T09:35:58.569 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12233 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/team/team_mode_activebackup.ko 2021-01-27T09:35:58.569 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8913 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/team/team_mode_broadcast.ko 2021-01-27T09:35:58.569 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27409 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/team/team_mode_loadbalance.ko 2021-01-27T09:35:58.569 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8633 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/team/team_mode_random.ko 2021-01-27T09:35:58.570 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8177 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/team/team_mode_roundrobin.ko 2021-01-27T09:35:58.570 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 68305 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/veth.ko 2021-01-27T09:35:58.570 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/vmxnet3/ 2021-01-27T09:35:58.570 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 116937 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/vmxnet3/vmxnet3.ko 2021-01-27T09:35:58.571 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 172041 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/vxlan.ko 2021-01-27T09:35:58.571 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/xen-netback/ 2021-01-27T09:35:58.571 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 143881 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/net/xen-netback/xen-netback.ko 2021-01-27T09:35:58.572 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ntb/ 2021-01-27T09:35:58.572 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ntb/ntb.ko 2021-01-27T09:35:58.573 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/nvme/ 2021-01-27T09:35:58.573 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/nvme/host/ 2021-01-27T09:35:58.573 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 211353 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/nvme/host/nvme-core.ko 2021-01-27T09:35:58.575 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 94473 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/nvme/host/nvme.ko 2021-01-27T09:35:58.576 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/parport/ 2021-01-27T09:35:58.577 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 130833 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/parport/parport.ko 2021-01-27T09:35:58.578 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24057 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/parport/parport_ax88796.ko 2021-01-27T09:35:58.578 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14297 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/parport/parport_cs.ko 2021-01-27T09:35:58.579 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 84649 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/parport/parport_pc.ko 2021-01-27T09:35:58.580 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25017 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/parport/parport_serial.ko 2021-01-27T09:35:58.580 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/pci/ 2021-01-27T09:35:58.580 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/pci/hotplug/ 2021-01-27T09:35:58.580 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24561 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2021-01-27T09:35:58.581 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16545 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2021-01-27T09:35:58.581 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19889 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2021-01-27T09:35:58.582 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11201 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/pci/pci-stub.ko 2021-01-27T09:35:58.582 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 47657 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/pci/xen-pcifront.ko 2021-01-27T09:35:58.582 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/pcmcia/ 2021-01-27T09:35:58.582 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24457 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/pcmcia/i82092.ko 2021-01-27T09:35:58.583 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 150153 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/pcmcia/pcmcia.ko 2021-01-27T09:35:58.583 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 61097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/pcmcia/pcmcia_core.ko 2021-01-27T09:35:58.585 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34769 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2021-01-27T09:35:58.585 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31809 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/pcmcia/pd6729.ko 2021-01-27T09:35:58.586 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 111097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/pcmcia/yenta_socket.ko 2021-01-27T09:35:58.587 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/phy/ 2021-01-27T09:35:58.587 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/phy/broadcom/ 2021-01-27T09:35:58.587 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2021-01-27T09:35:58.587 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/phy/samsung/ 2021-01-27T09:35:58.588 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8073 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2021-01-27T09:35:58.588 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/pinctrl/ 2021-01-27T09:35:58.589 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/pinctrl/intel/ 2021-01-27T09:35:58.589 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 67457 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2021-01-27T09:35:58.590 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/ 2021-01-27T09:35:58.591 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/chrome/ 2021-01-27T09:35:58.591 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27481 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2021-01-27T09:35:58.591 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19553 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/chrome/cros_ec.ko 2021-01-27T09:35:58.592 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20817 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2021-01-27T09:35:58.592 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23337 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2021-01-27T09:35:58.592 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2021-01-27T09:35:58.592 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17713 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2021-01-27T09:35:58.592 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2021-01-27T09:35:58.593 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/ 2021-01-27T09:35:58.593 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 67705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/acer-wmi.ko 2021-01-27T09:35:58.593 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40681 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/acerhdf.ko 2021-01-27T09:35:58.594 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36657 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/alienware-wmi.ko 2021-01-27T09:35:58.595 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/apple-gmux.ko 2021-01-27T09:35:58.595 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 56281 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/asus-laptop.ko 2021-01-27T09:35:58.597 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31809 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/asus-nb-wmi.ko 2021-01-27T09:35:58.597 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 72897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/asus-wmi.ko 2021-01-27T09:35:58.597 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35945 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/classmate-laptop.ko 2021-01-27T09:35:58.597 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32521 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/dcdbas.ko 2021-01-27T09:35:58.598 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17057 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/dell-smo8800.ko 2021-01-27T09:35:58.599 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10849 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/dell-wmi-aio.ko 2021-01-27T09:35:58.599 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32177 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/dell_rbu.ko 2021-01-27T09:35:58.599 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 48017 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/eeepc-laptop.ko 2021-01-27T09:35:58.600 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14281 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/eeepc-wmi.ko 2021-01-27T09:35:58.600 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40233 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/fujitsu-laptop.ko 2021-01-27T09:35:58.600 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/fujitsu-tablet.ko 2021-01-27T09:35:58.601 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35737 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/hdaps.ko 2021-01-27T09:35:58.601 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9913 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/hp-wireless.ko 2021-01-27T09:35:58.601 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28673 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/hp-wmi.ko 2021-01-27T09:35:58.601 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/hp_accel.ko 2021-01-27T09:35:58.602 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18521 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/ibm_rtl.ko 2021-01-27T09:35:58.602 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11361 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/intel-rst.ko 2021-01-27T09:35:58.602 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/intel-smartconnect.ko 2021-01-27T09:35:58.604 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 43553 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/intel_ips.ko 2021-01-27T09:35:58.604 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21137 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/intel_menlow.ko 2021-01-27T09:35:58.605 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19961 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/msi-wmi.ko 2021-01-27T09:35:58.605 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9417 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/mxm-wmi.ko 2021-01-27T09:35:58.605 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/panasonic-laptop.ko 2021-01-27T09:35:58.605 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 45481 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/samsung-laptop.ko 2021-01-27T09:35:58.606 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13289 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/samsung-q10.ko 2021-01-27T09:35:58.606 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 263753 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/thinkpad_acpi.ko 2021-01-27T09:35:58.606 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16729 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/topstar-laptop.ko 2021-01-27T09:35:58.606 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13593 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2021-01-27T09:35:58.607 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16761 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/toshiba_haps.ko 2021-01-27T09:35:58.607 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9961 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/wmi-bmof.ko 2021-01-27T09:35:58.607 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 55089 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/platform/x86/wmi.ko 2021-01-27T09:35:58.607 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/ 2021-01-27T09:35:58.607 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/ 2021-01-27T09:35:58.608 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31721 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/88pm860x_battery.ko 2021-01-27T09:35:58.610 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/88pm860x_charger.ko 2021-01-27T09:35:58.610 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53809 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/bq2415x_charger.ko 2021-01-27T09:35:58.610 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 56225 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/bq24190_charger.ko 2021-01-27T09:35:58.611 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21953 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/bq24735-charger.ko 2021-01-27T09:35:58.611 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19281 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/da9030_battery.ko 2021-01-27T09:35:58.612 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20481 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/da9052-battery.ko 2021-01-27T09:35:58.613 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29745 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/ds2760_battery.ko 2021-01-27T09:35:58.613 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25873 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/ds2780_battery.ko 2021-01-27T09:35:58.613 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26081 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/ds2781_battery.ko 2021-01-27T09:35:58.613 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23201 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/ds2782_battery.ko 2021-01-27T09:35:58.613 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19873 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/gpio-charger.ko 2021-01-27T09:35:58.614 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17793 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/isp1704_charger.ko 2021-01-27T09:35:58.614 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19561 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/lp8727_charger.ko 2021-01-27T09:35:58.614 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12209 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/max14577_charger.ko 2021-01-27T09:35:58.614 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/max17040_battery.ko 2021-01-27T09:35:58.615 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31089 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/max17042_battery.ko 2021-01-27T09:35:58.615 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19513 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/max8903_charger.ko 2021-01-27T09:35:58.615 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25057 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/max8925_power.ko 2021-01-27T09:35:58.615 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/pcf50633-charger.ko 2021-01-27T09:35:58.615 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28225 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/pda_power.ko 2021-01-27T09:35:58.619 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44905 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/sbs-battery.ko 2021-01-27T09:35:58.620 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33513 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/smb347-charger.ko 2021-01-27T09:35:58.620 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29793 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/test_power.ko 2021-01-27T09:35:58.620 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18857 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/tps65090-charger.ko 2021-01-27T09:35:58.620 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/wm831x_backup.ko 2021-01-27T09:35:58.621 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25121 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/wm831x_power.ko 2021-01-27T09:35:58.621 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23017 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/power/supply/wm8350_power.ko 2021-01-27T09:35:58.621 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/powercap/ 2021-01-27T09:35:58.621 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 52745 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/powercap/intel_rapl_common.ko 2021-01-27T09:35:58.621 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16905 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/powercap/intel_rapl_msr.ko 2021-01-27T09:35:58.622 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/pps/ 2021-01-27T09:35:58.622 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/pps/clients/ 2021-01-27T09:35:58.622 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14649 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/pps/clients/pps-gpio.ko 2021-01-27T09:35:58.623 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13145 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/pps/clients/pps-ldisc.ko 2021-01-27T09:35:58.623 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15225 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/pps/clients/pps_parport.ko 2021-01-27T09:35:58.623 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41121 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/pps/pps_core.ko 2021-01-27T09:35:58.623 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ptp/ 2021-01-27T09:35:58.624 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 45817 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ptp/ptp.ko 2021-01-27T09:35:58.624 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13201 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ptp/ptp_kvm.ko 2021-01-27T09:35:58.624 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/ 2021-01-27T09:35:58.624 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22737 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-88pm80x.ko 2021-01-27T09:35:58.624 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24033 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-88pm860x.ko 2021-01-27T09:35:58.625 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13433 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-ab3100.ko 2021-01-27T09:35:58.625 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15921 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-bq32k.ko 2021-01-27T09:35:58.625 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12153 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-bq4802.ko 2021-01-27T09:35:58.625 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20953 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-da9052.ko 2021-01-27T09:35:58.626 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18873 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-da9055.ko 2021-01-27T09:35:58.626 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20193 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-da9063.ko 2021-01-27T09:35:58.626 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15737 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-ds1286.ko 2021-01-27T09:35:58.626 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 70049 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-ds1307.ko 2021-01-27T09:35:58.626 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20361 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-ds1374.ko 2021-01-27T09:35:58.627 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17777 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-ds1511.ko 2021-01-27T09:35:58.627 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-ds1553.ko 2021-01-27T09:35:58.627 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13825 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-ds1672.ko 2021-01-27T09:35:58.627 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-ds1742.ko 2021-01-27T09:35:58.628 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-ds2404.ko 2021-01-27T09:35:58.628 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23521 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-ds3232.ko 2021-01-27T09:35:58.628 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10753 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-em3027.ko 2021-01-27T09:35:58.628 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24745 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-fm3130.ko 2021-01-27T09:35:58.629 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16601 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-isl12022.ko 2021-01-27T09:35:58.629 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35833 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-isl1208.ko 2021-01-27T09:35:58.629 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14425 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-lp8788.ko 2021-01-27T09:35:58.629 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38265 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-m41t80.ko 2021-01-27T09:35:58.633 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11241 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-m48t35.ko 2021-01-27T09:35:58.634 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25457 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-m48t59.ko 2021-01-27T09:35:58.634 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13609 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-m48t86.ko 2021-01-27T09:35:58.634 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11209 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-max6900.ko 2021-01-27T09:35:58.634 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-max8907.ko 2021-01-27T09:35:58.635 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14617 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-max8925.ko 2021-01-27T09:35:58.635 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27161 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-max8997.ko 2021-01-27T09:35:58.635 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-max8998.ko 2021-01-27T09:35:58.635 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17497 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-mc13xxx.ko 2021-01-27T09:35:58.635 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10481 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-msm6242.ko 2021-01-27T09:35:58.636 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19817 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-palmas.ko 2021-01-27T09:35:58.636 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38145 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-pcf2127.ko 2021-01-27T09:35:58.636 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17769 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-pcf50633.ko 2021-01-27T09:35:58.637 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19889 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-pcf85063.ko 2021-01-27T09:35:58.637 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14849 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-pcf8523.ko 2021-01-27T09:35:58.637 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29353 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-pcf8563.ko 2021-01-27T09:35:58.637 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12617 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-pcf8583.ko 2021-01-27T09:35:58.637 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17385 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-rc5t583.ko 2021-01-27T09:35:58.638 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-rp5c01.ko 2021-01-27T09:35:58.638 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29985 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-rs5c372.ko 2021-01-27T09:35:58.638 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27833 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-rv3029c2.ko 2021-01-27T09:35:58.638 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24273 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-rx8025.ko 2021-01-27T09:35:58.639 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19313 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-rx8581.ko 2021-01-27T09:35:58.639 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23233 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-s35390a.ko 2021-01-27T09:35:58.639 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30585 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-s5m.ko 2021-01-27T09:35:58.639 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16153 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-stk17ta8.ko 2021-01-27T09:35:58.639 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17785 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-tps6586x.ko 2021-01-27T09:35:58.640 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21681 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-tps65910.ko 2021-01-27T09:35:58.640 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19233 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-tps80031.ko 2021-01-27T09:35:58.640 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24249 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-v3020.ko 2021-01-27T09:35:58.641 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20905 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-wm831x.ko 2021-01-27T09:35:58.641 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21497 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-wm8350.ko 2021-01-27T09:35:58.641 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28873 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/rtc/rtc-x1205.ko 2021-01-27T09:35:58.641 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/ 2021-01-27T09:35:58.641 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 79825 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/3w-9xxx.ko 2021-01-27T09:35:58.642 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 58713 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/3w-sas.ko 2021-01-27T09:35:58.642 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 61145 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/3w-xxxx.ko 2021-01-27T09:35:58.642 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 132041 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/BusLogic.ko 2021-01-27T09:35:58.642 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29169 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/a100u2w.ko 2021-01-27T09:35:58.643 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/aacraid/ 2021-01-27T09:35:58.643 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 281161 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/aacraid/aacraid.ko 2021-01-27T09:35:58.644 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 101345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/advansys.ko 2021-01-27T09:35:58.644 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/aic7xxx/ 2021-01-27T09:35:58.645 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 345113 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2021-01-27T09:35:58.645 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 295897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2021-01-27T09:35:58.647 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/aic94xx/ 2021-01-27T09:35:58.647 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 194233 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/aic94xx/aic94xx.ko 2021-01-27T09:35:58.649 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/am53c974.ko 2021-01-27T09:35:58.649 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/arcmsr/ 2021-01-27T09:35:58.650 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 116257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/arcmsr/arcmsr.ko 2021-01-27T09:35:58.651 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38225 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/atp870u.ko 2021-01-27T09:35:58.652 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/be2iscsi/ 2021-01-27T09:35:58.652 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 263289 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2021-01-27T09:35:58.655 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/bfa/ 2021-01-27T09:35:58.656 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1164569 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/bfa/bfa.ko 2021-01-27T09:35:58.670 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/bnx2fc/ 2021-01-27T09:35:58.670 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 253049 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2021-01-27T09:35:58.674 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/bnx2i/ 2021-01-27T09:35:58.674 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 119817 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/bnx2i/bnx2i.ko 2021-01-27T09:35:58.675 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40249 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/ch.ko 2021-01-27T09:35:58.675 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/csiostor/ 2021-01-27T09:35:58.676 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 312345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/csiostor/csiostor.ko 2021-01-27T09:35:58.679 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/cxgbi/ 2021-01-27T09:35:58.680 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/cxgbi/cxgb3i/ 2021-01-27T09:35:58.680 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 80265 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2021-01-27T09:35:58.680 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/cxgbi/cxgb4i/ 2021-01-27T09:35:58.681 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 110665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2021-01-27T09:35:58.682 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 153153 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2021-01-27T09:35:58.684 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 76977 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/dc395x.ko 2021-01-27T09:35:58.685 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 37985 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/dmx3191d.ko 2021-01-27T09:35:58.685 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 79993 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/dpt_i2o.ko 2021-01-27T09:35:58.686 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/esas2r/ 2021-01-27T09:35:58.687 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 212209 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/esas2r/esas2r.ko 2021-01-27T09:35:58.690 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 66665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/esp_scsi.ko 2021-01-27T09:35:58.690 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/fcoe/ 2021-01-27T09:35:58.691 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 78809 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/fcoe/fcoe.ko 2021-01-27T09:35:58.691 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 162929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/fcoe/libfcoe.ko 2021-01-27T09:35:58.694 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18993 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/fdomain.ko 2021-01-27T09:35:58.694 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/fnic/ 2021-01-27T09:35:58.694 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 280473 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/fnic/fnic.ko 2021-01-27T09:35:58.697 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 108009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/gdth.ko 2021-01-27T09:35:58.699 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 214105 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/hpsa.ko 2021-01-27T09:35:58.703 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50121 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/hptiop.ko 2021-01-27T09:35:58.705 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 46009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/hv_storvsc.ko 2021-01-27T09:35:58.705 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36137 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/imm.ko 2021-01-27T09:35:58.706 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 48505 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/initio.ko 2021-01-27T09:35:58.706 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 294209 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/ipr.ko 2021-01-27T09:35:58.708 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 110121 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/ips.ko 2021-01-27T09:35:58.710 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/isci/ 2021-01-27T09:35:58.711 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 333769 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/isci/isci.ko 2021-01-27T09:35:58.715 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25553 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2021-01-27T09:35:58.715 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 49049 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/iscsi_tcp.ko 2021-01-27T09:35:58.716 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/libfc/ 2021-01-27T09:35:58.716 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 323489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/libfc/libfc.ko 2021-01-27T09:35:58.720 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 144993 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/libiscsi.ko 2021-01-27T09:35:58.721 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 55289 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/libiscsi_tcp.ko 2021-01-27T09:35:58.722 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/libsas/ 2021-01-27T09:35:58.722 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 199657 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/libsas/libsas.ko 2021-01-27T09:35:58.724 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/lpfc/ 2021-01-27T09:35:58.725 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 2072169 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/lpfc/lpfc.ko 2021-01-27T09:35:58.752 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/megaraid/ 2021-01-27T09:35:58.753 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 80977 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2021-01-27T09:35:58.753 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33233 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2021-01-27T09:35:58.754 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 319769 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2021-01-27T09:35:58.758 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 85665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/megaraid.ko 2021-01-27T09:35:58.760 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/mpt3sas/ 2021-01-27T09:35:58.760 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 696361 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2021-01-27T09:35:58.769 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/mvsas/ 2021-01-27T09:35:58.770 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 122961 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/mvsas/mvsas.ko 2021-01-27T09:35:58.770 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 80969 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/mvumi.ko 2021-01-27T09:35:58.771 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/pcmcia/ 2021-01-27T09:35:58.772 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 81785 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2021-01-27T09:35:58.773 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11297 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2021-01-27T09:35:58.774 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20481 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2021-01-27T09:35:58.774 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23745 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2021-01-27T09:35:58.774 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/pm8001/ 2021-01-27T09:35:58.775 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 420737 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/pm8001/pm80xx.ko 2021-01-27T09:35:58.778 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 136545 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/pmcraid.ko 2021-01-27T09:35:58.780 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33769 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/ppa.ko 2021-01-27T09:35:58.780 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 58673 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/qla1280.ko 2021-01-27T09:35:58.781 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/qla2xxx/ 2021-01-27T09:35:58.782 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1704273 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2021-01-27T09:35:58.805 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 88913 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2021-01-27T09:35:58.806 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/qla4xxx/ 2021-01-27T09:35:58.806 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 610649 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2021-01-27T09:35:58.814 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17417 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/qlogicfas408.ko 2021-01-27T09:35:58.814 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18041 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/raid_class.ko 2021-01-27T09:35:58.814 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 238065 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/scsi_debug.ko 2021-01-27T09:35:58.817 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 171777 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/scsi_transport_fc.ko 2021-01-27T09:35:58.819 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 264929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/scsi_transport_iscsi.ko 2021-01-27T09:35:58.823 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 95033 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/scsi_transport_sas.ko 2021-01-27T09:35:58.823 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 73033 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/scsi_transport_spi.ko 2021-01-27T09:35:58.824 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 43601 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/scsi_transport_srp.ko 2021-01-27T09:35:58.826 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24905 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/ses.ko 2021-01-27T09:35:58.828 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 117977 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/st.ko 2021-01-27T09:35:58.830 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 47545 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/stex.ko 2021-01-27T09:35:58.832 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/sym53c8xx_2/ 2021-01-27T09:35:58.832 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 166369 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2021-01-27T09:35:58.834 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/ufs/ 2021-01-27T09:35:58.834 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 412257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/ufs/ufshcd-core.ko 2021-01-27T09:35:58.835 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20321 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/ufs/ufshcd-pci.ko 2021-01-27T09:35:58.835 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17513 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/ufs/ufshcd-pltfrm.ko 2021-01-27T09:35:58.835 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40369 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/virtio_scsi.ko 2021-01-27T09:35:58.836 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51633 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/vmw_pvscsi.ko 2021-01-27T09:35:58.836 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41673 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/wd719x.ko 2021-01-27T09:35:58.837 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50289 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/scsi/xen-scsifront.ko 2021-01-27T09:35:58.837 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ssb/ 2021-01-27T09:35:58.837 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 127337 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/ssb/ssb.ko 2021-01-27T09:35:58.838 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/target/ 2021-01-27T09:35:58.839 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/target/iscsi/ 2021-01-27T09:35:58.839 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 748329 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2021-01-27T09:35:58.846 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/target/loopback/ 2021-01-27T09:35:58.847 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 52585 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/target/loopback/tcm_loop.ko 2021-01-27T09:35:58.847 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41409 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/target/target_core_file.ko 2021-01-27T09:35:58.848 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38313 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/target/target_core_iblock.ko 2021-01-27T09:35:58.848 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 937033 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/target/target_core_mod.ko 2021-01-27T09:35:58.858 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 45465 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/target/target_core_pscsi.ko 2021-01-27T09:35:58.859 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 108193 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/target/target_core_user.ko 2021-01-27T09:35:58.860 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/target/tcm_fc/ 2021-01-27T09:35:58.860 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 73465 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/target/tcm_fc/tcm_fc.ko 2021-01-27T09:35:58.860 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/thermal/ 2021-01-27T09:35:58.861 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/thermal/intel/ 2021-01-27T09:35:58.861 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/thermal/intel/int340x_thermal/ 2021-01-27T09:35:58.861 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20313 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2021-01-27T09:35:58.863 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25049 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2021-01-27T09:35:58.863 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9505 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2021-01-27T09:35:58.863 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14529 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2021-01-27T09:35:58.863 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14625 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2021-01-27T09:35:58.863 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36161 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2021-01-27T09:35:58.864 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11961 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2021-01-27T09:35:58.864 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12513 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2021-01-27T09:35:58.864 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19649 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2021-01-27T09:35:58.864 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31817 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/thermal/intel/intel_powerclamp.ko 2021-01-27T09:35:58.865 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20337 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2021-01-27T09:35:58.865 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11105 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2021-01-27T09:35:58.866 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26457 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2021-01-27T09:35:58.866 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/ 2021-01-27T09:35:58.866 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 88377 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/cyclades.ko 2021-01-27T09:35:58.866 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/ipwireless/ 2021-01-27T09:35:58.866 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 79337 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/ipwireless/ipwireless.ko 2021-01-27T09:35:58.867 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50417 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/isicom.ko 2021-01-27T09:35:58.867 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53881 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/moxa.ko 2021-01-27T09:35:58.868 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 69009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/mxser.ko 2021-01-27T09:35:58.868 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 88697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/n_gsm.ko 2021-01-27T09:35:58.869 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32777 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/n_hdlc.ko 2021-01-27T09:35:58.870 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11825 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/n_tracerouter.ko 2021-01-27T09:35:58.870 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11321 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/n_tracesink.ko 2021-01-27T09:35:58.870 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 71705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/nozomi.ko 2021-01-27T09:35:58.871 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 85849 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/rocket.ko 2021-01-27T09:35:58.871 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/serial/ 2021-01-27T09:35:58.872 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/serial/8250/ 2021-01-27T09:35:58.872 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29457 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/serial/8250/8250_dw.ko 2021-01-27T09:35:58.873 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 59113 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/serial/8250/serial_cs.ko 2021-01-27T09:35:58.873 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17457 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/serial/altera_jtaguart.ko 2021-01-27T09:35:58.873 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21417 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/serial/altera_uart.ko 2021-01-27T09:35:58.873 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9137 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/serial/arc_uart.ko 2021-01-27T09:35:58.874 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 66489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/serial/fsl_lpuart.ko 2021-01-27T09:35:58.874 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/serial/jsm/ 2021-01-27T09:35:58.875 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 106953 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/serial/jsm/jsm.ko 2021-01-27T09:35:58.875 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30633 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/serial/rp2.ko 2021-01-27T09:35:58.876 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44729 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/serial/sc16is7xx.ko 2021-01-27T09:35:58.876 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 109849 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/tty/synclink_gt.ko 2021-01-27T09:35:58.878 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/uio/ 2021-01-27T09:35:58.878 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 42385 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/uio/uio.ko 2021-01-27T09:35:58.879 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11873 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/uio/uio_aec.ko 2021-01-27T09:35:58.879 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10393 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/uio/uio_cif.ko 2021-01-27T09:35:58.880 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/uio/uio_dmem_genirq.ko 2021-01-27T09:35:58.880 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12425 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/uio/uio_mf624.ko 2021-01-27T09:35:58.880 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/uio/uio_netx.ko 2021-01-27T09:35:58.880 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9737 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/uio/uio_pci_generic.ko 2021-01-27T09:35:58.880 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/uio/uio_pdrv_genirq.ko 2021-01-27T09:35:58.881 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12785 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/uio/uio_sercos3.ko 2021-01-27T09:35:58.881 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/ 2021-01-27T09:35:58.881 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/c67x00/ 2021-01-27T09:35:58.881 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 67769 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/c67x00/c67x00.ko 2021-01-27T09:35:58.882 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/chipidea/ 2021-01-27T09:35:58.883 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 139881 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/chipidea/ci_hdrc.ko 2021-01-27T09:35:58.883 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18249 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2021-01-27T09:35:58.883 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12233 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2021-01-27T09:35:58.883 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12377 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2021-01-27T09:35:58.883 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/class/ 2021-01-27T09:35:58.884 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 85617 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/class/cdc-acm.ko 2021-01-27T09:35:58.884 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50521 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/class/cdc-wdm.ko 2021-01-27T09:35:58.885 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 48177 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/class/usblp.ko 2021-01-27T09:35:58.885 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 93401 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/class/usbtmc.ko 2021-01-27T09:35:58.886 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/common/ 2021-01-27T09:35:58.886 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16185 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/common/ulpi.ko 2021-01-27T09:35:58.886 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/dwc2/ 2021-01-27T09:35:58.886 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11713 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/dwc2/dwc2_pci.ko 2021-01-27T09:35:58.887 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/dwc3/ 2021-01-27T09:35:58.887 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11289 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/dwc3/dwc3-haps.ko 2021-01-27T09:35:58.887 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24449 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/dwc3/dwc3-pci.ko 2021-01-27T09:35:58.887 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 431721 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/dwc3/dwc3.ko 2021-01-27T09:35:58.890 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/ 2021-01-27T09:35:58.891 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/function/ 2021-01-27T09:35:58.891 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 46081 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/function/u_ether.ko 2021-01-27T09:35:58.892 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 49769 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/function/u_serial.ko 2021-01-27T09:35:58.892 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2021-01-27T09:35:58.892 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 39185 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2021-01-27T09:35:58.893 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26689 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2021-01-27T09:35:58.893 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34393 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2021-01-27T09:35:58.894 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 91945 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2021-01-27T09:35:58.894 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 45401 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2021-01-27T09:35:58.895 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 120793 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2021-01-27T09:35:58.896 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 57497 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2021-01-27T09:35:58.896 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22113 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2021-01-27T09:35:58.897 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29417 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2021-01-27T09:35:58.897 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 59793 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2021-01-27T09:35:58.898 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 83193 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2021-01-27T09:35:58.898 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18913 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2021-01-27T09:35:58.899 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 58161 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2021-01-27T09:35:58.899 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 76969 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2021-01-27T09:35:58.900 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/legacy/ 2021-01-27T09:35:58.900 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20497 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2021-01-27T09:35:58.901 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17449 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2021-01-27T09:35:58.902 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17281 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2021-01-27T09:35:58.902 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21249 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/legacy/g_ether.ko 2021-01-27T09:35:58.902 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27745 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2021-01-27T09:35:58.902 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18353 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/legacy/g_hid.ko 2021-01-27T09:35:58.903 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19673 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2021-01-27T09:35:58.903 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16473 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2021-01-27T09:35:58.903 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31337 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2021-01-27T09:35:58.903 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15961 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/legacy/g_printer.ko 2021-01-27T09:35:58.903 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18689 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/legacy/g_serial.ko 2021-01-27T09:35:58.904 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/legacy/g_zero.ko 2021-01-27T09:35:58.904 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 60201 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2021-01-27T09:35:58.905 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14441 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2021-01-27T09:35:58.905 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 144049 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/libcomposite.ko 2021-01-27T09:35:58.905 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/udc/ 2021-01-27T09:35:58.906 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16569 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2021-01-27T09:35:58.906 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/udc/bdc/ 2021-01-27T09:35:58.906 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 160041 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2021-01-27T09:35:58.908 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34593 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/udc/fotg210-udc.ko 2021-01-27T09:35:58.908 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35473 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/udc/goku_udc.ko 2021-01-27T09:35:58.909 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 54937 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/udc/gr_udc.ko 2021-01-27T09:35:58.909 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 70833 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2021-01-27T09:35:58.911 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 57377 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/udc/mv_udc.ko 2021-01-27T09:35:58.912 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 73209 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/udc/net2272.ko 2021-01-27T09:35:58.912 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 75873 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/udc/net2280.ko 2021-01-27T09:35:58.913 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 73841 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/udc/pch_udc.ko 2021-01-27T09:35:58.914 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 66449 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2021-01-27T09:35:58.915 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 70897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2021-01-27T09:35:58.916 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 82841 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2021-01-27T09:35:58.917 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 144345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/gadget/udc/udc-core.ko 2021-01-27T09:35:58.919 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/host/ 2021-01-27T09:35:58.919 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10585 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/host/bcma-hcd.ko 2021-01-27T09:35:58.919 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 128721 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/host/fotg210-hcd.ko 2021-01-27T09:35:58.921 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 76017 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/host/isp116x-hcd.ko 2021-01-27T09:35:58.922 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 88865 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/host/oxu210hp-hcd.ko 2021-01-27T09:35:58.923 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 79161 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/host/r8a66597-hcd.ko 2021-01-27T09:35:58.924 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50409 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/host/sl811-hcd.ko 2021-01-27T09:35:58.926 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15505 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/host/sl811_cs.ko 2021-01-27T09:35:58.927 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12601 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/host/ssb-hcd.ko 2021-01-27T09:35:58.927 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 97945 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/host/u132-hcd.ko 2021-01-27T09:35:58.927 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20977 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/host/xhci-plat-hcd.ko 2021-01-27T09:35:58.927 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/image/ 2021-01-27T09:35:58.928 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 37513 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/image/mdc800.ko 2021-01-27T09:35:58.929 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21649 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/image/microtek.ko 2021-01-27T09:35:58.929 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/ 2021-01-27T09:35:58.929 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41985 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/adutux.ko 2021-01-27T09:35:58.930 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20761 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/appledisplay.ko 2021-01-27T09:35:58.930 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16945 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/cypress_cy7c63.ko 2021-01-27T09:35:58.930 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22441 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/cytherm.ko 2021-01-27T09:35:58.930 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12041 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/ehset.ko 2021-01-27T09:35:58.930 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13409 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/emi26.ko 2021-01-27T09:35:58.931 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15161 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/emi62.ko 2021-01-27T09:35:58.931 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11481 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/ezusb.ko 2021-01-27T09:35:58.931 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 77105 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/ftdi-elan.ko 2021-01-27T09:35:58.933 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/idmouse.ko 2021-01-27T09:35:58.933 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36601 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/iowarrior.ko 2021-01-27T09:35:58.933 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11353 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/isight_firmware.ko 2021-01-27T09:35:58.933 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36849 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/ldusb.ko 2021-01-27T09:35:58.934 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36657 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/legousbtower.ko 2021-01-27T09:35:58.934 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26033 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/lvstest.ko 2021-01-27T09:35:58.934 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/sisusbvga/ 2021-01-27T09:35:58.934 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 68305 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2021-01-27T09:35:58.935 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12193 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/trancevibrator.ko 2021-01-27T09:35:58.935 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18633 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/usb3503.ko 2021-01-27T09:35:58.935 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25145 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/usblcd.ko 2021-01-27T09:35:58.936 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21729 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/usbsevseg.ko 2021-01-27T09:35:58.936 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 71161 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/usbtest.ko 2021-01-27T09:35:58.937 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 43089 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/uss720.ko 2021-01-27T09:35:58.937 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30913 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/misc/yurex.ko 2021-01-27T09:35:58.937 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/mon/ 2021-01-27T09:35:58.937 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 70041 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/mon/usbmon.ko 2021-01-27T09:35:58.938 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/musb/ 2021-01-27T09:35:58.938 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 293401 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/musb/musb_hdrc.ko 2021-01-27T09:35:58.939 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/phy/ 2021-01-27T09:35:58.940 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19809 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/phy/phy-generic.ko 2021-01-27T09:35:58.941 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2021-01-27T09:35:58.941 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/phy/phy-isp1301.ko 2021-01-27T09:35:58.941 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/phy/phy-tahvo.ko 2021-01-27T09:35:58.941 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/ 2021-01-27T09:35:58.941 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12529 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/aircable.ko 2021-01-27T09:35:58.942 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28513 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/ark3116.ko 2021-01-27T09:35:58.943 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26905 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/belkin_sa.ko 2021-01-27T09:35:58.944 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38425 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/ch341.ko 2021-01-27T09:35:58.944 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 62737 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/cp210x.ko 2021-01-27T09:35:58.944 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31449 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/cyberjack.ko 2021-01-27T09:35:58.944 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 59185 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/cypress_m8.ko 2021-01-27T09:35:58.944 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51049 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/digi_acceleport.ko 2021-01-27T09:35:58.945 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9145 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/empeg.ko 2021-01-27T09:35:58.945 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44673 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/f81232.ko 2021-01-27T09:35:58.946 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 177081 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/ftdi_sio.ko 2021-01-27T09:35:58.947 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53985 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/garmin_gps.ko 2021-01-27T09:35:58.948 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 140433 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/io_edgeport.ko 2021-01-27T09:35:58.948 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 124169 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/io_ti.ko 2021-01-27T09:35:58.949 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 67345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/ipaq.ko 2021-01-27T09:35:58.950 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18953 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/ipw.ko 2021-01-27T09:35:58.950 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27857 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/ir-usb.ko 2021-01-27T09:35:58.951 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 57537 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/iuu_phoenix.ko 2021-01-27T09:35:58.951 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 106281 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/keyspan.ko 2021-01-27T09:35:58.952 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34817 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/keyspan_pda.ko 2021-01-27T09:35:58.953 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/kl5kusb105.ko 2021-01-27T09:35:58.953 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33265 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/kobil_sct.ko 2021-01-27T09:35:58.954 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/mct_u232.ko 2021-01-27T09:35:58.954 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21545 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/metro-usb.ko 2021-01-27T09:35:58.954 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 65297 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/mos7720.ko 2021-01-27T09:35:58.955 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 78929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/mos7840.ko 2021-01-27T09:35:58.956 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 52017 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/mxuport.ko 2021-01-27T09:35:58.956 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13465 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/navman.ko 2021-01-27T09:35:58.956 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10689 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/omninet.ko 2021-01-27T09:35:58.956 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24049 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/opticon.ko 2021-01-27T09:35:58.957 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 177913 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/option.ko 2021-01-27T09:35:58.957 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 39681 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/oti6858.ko 2021-01-27T09:35:58.958 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 52425 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/pl2303.ko 2021-01-27T09:35:58.958 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9065 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/qcaux.ko 2021-01-27T09:35:58.958 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 37217 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/qcserial.ko 2021-01-27T09:35:58.959 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35193 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/quatech2.ko 2021-01-27T09:35:58.959 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14457 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/safe_serial.ko 2021-01-27T09:35:58.960 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 52017 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/sierra.ko 2021-01-27T09:35:58.960 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/spcp8x5.ko 2021-01-27T09:35:58.961 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29777 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/ssu100.ko 2021-01-27T09:35:58.961 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16689 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/symbolserial.ko 2021-01-27T09:35:58.961 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 63665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2021-01-27T09:35:58.962 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21073 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/usb-serial-simple.ko 2021-01-27T09:35:58.962 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9473 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/usb_debug.ko 2021-01-27T09:35:58.962 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35361 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/usb_wwan.ko 2021-01-27T09:35:58.963 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 118241 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/usbserial.ko 2021-01-27T09:35:58.963 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29081 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/visor.ko 2021-01-27T09:35:58.964 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 37129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/whiteheat.ko 2021-01-27T09:35:58.964 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9937 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/wishbone-serial.ko 2021-01-27T09:35:58.964 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8521 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/serial/xsens_mt.ko 2021-01-27T09:35:58.965 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/storage/ 2021-01-27T09:35:58.966 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51905 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/storage/uas.ko 2021-01-27T09:35:58.967 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25201 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/storage/ums-alauda.ko 2021-01-27T09:35:58.967 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12201 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/storage/ums-cypress.ko 2021-01-27T09:35:58.967 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21337 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/storage/ums-datafab.ko 2021-01-27T09:35:58.968 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35857 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/storage/ums-eneub6250.ko 2021-01-27T09:35:58.968 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/storage/ums-freecom.ko 2021-01-27T09:35:58.968 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20449 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/storage/ums-isd200.ko 2021-01-27T09:35:58.968 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20409 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/storage/ums-jumpshot.ko 2021-01-27T09:35:58.969 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12873 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/storage/ums-karma.ko 2021-01-27T09:35:58.969 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17545 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/storage/ums-onetouch.ko 2021-01-27T09:35:58.969 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27625 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/storage/ums-realtek.ko 2021-01-27T09:35:58.969 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27593 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/storage/ums-sddr09.ko 2021-01-27T09:35:58.969 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20977 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/storage/ums-sddr55.ko 2021-01-27T09:35:58.970 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33633 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/storage/ums-usbat.ko 2021-01-27T09:35:58.970 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 174097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/storage/usb-storage.ko 2021-01-27T09:35:58.971 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/usbip/ 2021-01-27T09:35:58.971 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 66673 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/usbip/usbip-core.ko 2021-01-27T09:35:58.971 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 71145 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/usbip/usbip-host.ko 2021-01-27T09:35:58.971 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 108041 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/usb/usbip/vhci-hcd.ko 2021-01-27T09:35:58.972 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/vfio/ 2021-01-27T09:35:58.973 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/vfio/pci/ 2021-01-27T09:35:58.973 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 151969 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/vfio/pci/vfio-pci.ko 2021-01-27T09:35:58.975 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 73265 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/vfio/vfio.ko 2021-01-27T09:35:58.975 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 71521 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/vfio/vfio_iommu_type1.ko 2021-01-27T09:35:58.976 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14433 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/vfio/vfio_virqfd.ko 2021-01-27T09:35:58.977 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/vhost/ 2021-01-27T09:35:58.977 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 99713 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/vhost/vhost.ko 2021-01-27T09:35:58.978 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13737 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/vhost/vhost_iotlb.ko 2021-01-27T09:35:58.978 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53945 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/vhost/vhost_net.ko 2021-01-27T09:35:58.979 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 89489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/vhost/vhost_scsi.ko 2021-01-27T09:35:58.980 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/video/ 2021-01-27T09:35:58.980 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/video/backlight/ 2021-01-27T09:35:58.980 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15217 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/video/backlight/88pm860x_bl.ko 2021-01-27T09:35:58.981 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12377 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/video/backlight/aat2870_bl.ko 2021-01-27T09:35:58.981 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20657 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/video/backlight/adp5520_bl.ko 2021-01-27T09:35:58.982 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/video/backlight/adp8860_bl.ko 2021-01-27T09:35:58.983 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32577 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/video/backlight/adp8870_bl.ko 2021-01-27T09:35:58.983 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18145 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/video/backlight/apple_bl.ko 2021-01-27T09:35:58.983 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17025 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/video/backlight/as3711_bl.ko 2021-01-27T09:35:58.983 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11793 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/video/backlight/bd6107.ko 2021-01-27T09:35:58.984 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10937 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/video/backlight/da903x_bl.ko 2021-01-27T09:35:58.984 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10777 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/video/backlight/da9052_bl.ko 2021-01-27T09:35:58.984 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11577 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/video/backlight/gpio_backlight.ko 2021-01-27T09:35:58.984 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14289 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/video/backlight/kb3886_bl.ko 2021-01-27T09:35:58.984 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20793 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/video/backlight/lcd.ko 2021-01-27T09:35:58.985 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22993 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/video/backlight/lm3533_bl.ko 2021-01-27T09:35:58.985 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20337 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/video/backlight/lm3639_bl.ko 2021-01-27T09:35:58.985 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11145 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/video/backlight/lv5207lp.ko 2021-01-27T09:35:58.985 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/video/backlight/max8925_bl.ko 2021-01-27T09:35:58.986 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10865 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/video/backlight/pandora_bl.ko 2021-01-27T09:35:58.986 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9873 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/video/backlight/pcf50633-backlight.ko 2021-01-27T09:35:58.986 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10337 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/video/backlight/platform_lcd.ko 2021-01-27T09:35:58.988 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12441 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/video/backlight/wm831x_bl.ko 2021-01-27T09:35:58.988 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/virtio/ 2021-01-27T09:35:58.989 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 78961 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/virtio/virtio_mem.ko 2021-01-27T09:35:58.989 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/w1/ 2021-01-27T09:35:58.989 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/w1/masters/ 2021-01-27T09:35:58.990 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36913 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/w1/masters/ds1wm.ko 2021-01-27T09:35:58.990 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18233 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/w1/masters/ds2482.ko 2021-01-27T09:35:58.990 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28825 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/w1/masters/ds2490.ko 2021-01-27T09:35:58.990 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/w1/masters/matrox_w1.ko 2021-01-27T09:35:58.991 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12201 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/w1/masters/w1-gpio.ko 2021-01-27T09:35:58.991 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/w1/slaves/ 2021-01-27T09:35:58.991 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11273 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/w1/slaves/w1_ds2406.ko 2021-01-27T09:35:58.991 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22217 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/w1/slaves/w1_ds2408.ko 2021-01-27T09:35:58.992 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14977 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/w1/slaves/w1_ds2413.ko 2021-01-27T09:35:58.992 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10369 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/w1/slaves/w1_ds2423.ko 2021-01-27T09:35:58.992 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13961 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/w1/slaves/w1_ds2431.ko 2021-01-27T09:35:58.992 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11153 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/w1/slaves/w1_ds2433.ko 2021-01-27T09:35:58.992 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12401 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/w1/slaves/w1_ds2780.ko 2021-01-27T09:35:58.993 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12401 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/w1/slaves/w1_ds2781.ko 2021-01-27T09:35:58.993 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18521 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/w1/slaves/w1_ds28e04.ko 2021-01-27T09:35:58.993 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6633 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/w1/slaves/w1_smem.ko 2021-01-27T09:35:58.993 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 59185 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/w1/slaves/w1_therm.ko 2021-01-27T09:35:58.993 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 100033 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/w1/wire.ko 2021-01-27T09:35:58.994 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/ 2021-01-27T09:35:58.994 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17849 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/acquirewdt.ko 2021-01-27T09:35:58.998 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18977 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/advantechwdt.ko 2021-01-27T09:35:58.998 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18161 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/alim1535_wdt.ko 2021-01-27T09:35:58.999 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22313 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/alim7101_wdt.ko 2021-01-27T09:35:58.999 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18817 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/cpu5wdt.ko 2021-01-27T09:35:58.999 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12417 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/da9052_wdt.ko 2021-01-27T09:35:58.999 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11953 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/da9055_wdt.ko 2021-01-27T09:35:58.999 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14233 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/da9063_wdt.ko 2021-01-27T09:35:59.000 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20233 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/dw_wdt.ko 2021-01-27T09:35:59.000 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19617 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/eurotechwdt.ko 2021-01-27T09:35:59.000 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30865 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/f71808e_wdt.ko 2021-01-27T09:35:59.000 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26913 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/hpwdt.ko 2021-01-27T09:35:59.000 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15401 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/i6300esb.ko 2021-01-27T09:35:59.001 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9889 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/iTCO_vendor_support.ko 2021-01-27T09:35:59.001 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/iTCO_wdt.ko 2021-01-27T09:35:59.001 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18401 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/ib700wdt.ko 2021-01-27T09:35:59.001 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18001 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/ibmasr.ko 2021-01-27T09:35:59.002 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19041 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/ie6xx_wdt.ko 2021-01-27T09:35:59.002 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20849 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/it8712f_wdt.ko 2021-01-27T09:35:59.002 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13153 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/it87_wdt.ko 2021-01-27T09:35:59.002 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20689 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/kempld_wdt.ko 2021-01-27T09:35:59.002 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18177 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/machzwd.ko 2021-01-27T09:35:59.003 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14473 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/mena21_wdt.ko 2021-01-27T09:35:59.003 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12465 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/menf21bmc_wdt.ko 2021-01-27T09:35:59.003 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23545 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/nv_tco.ko 2021-01-27T09:35:59.003 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/of_xilinx_wdt.ko 2021-01-27T09:35:59.003 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/pc87413_wdt.ko 2021-01-27T09:35:59.004 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38225 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/pcwd_pci.ko 2021-01-27T09:35:59.004 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32809 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/pcwd_usb.ko 2021-01-27T09:35:59.004 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11833 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/retu_wdt.ko 2021-01-27T09:35:59.004 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19529 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/sbc60xxwdt.ko 2021-01-27T09:35:59.004 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13465 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/sbc_epx_c3.ko 2021-01-27T09:35:59.005 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16793 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2021-01-27T09:35:59.005 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/sc1200wdt.ko 2021-01-27T09:35:59.005 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21977 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/sch311x_wdt.ko 2021-01-27T09:35:59.005 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20025 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/smsc37b787_wdt.ko 2021-01-27T09:35:59.005 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16505 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/softdog.ko 2021-01-27T09:35:59.006 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/sp5100_tco.ko 2021-01-27T09:35:59.006 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11889 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/twl4030_wdt.ko 2021-01-27T09:35:59.006 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17169 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/via_wdt.ko 2021-01-27T09:35:59.006 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/w83627hf_wdt.ko 2021-01-27T09:35:59.006 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19449 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/w83877f_wdt.ko 2021-01-27T09:35:59.007 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22017 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/w83977f_wdt.ko 2021-01-27T09:35:59.007 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17017 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/wafer5823wdt.ko 2021-01-27T09:35:59.007 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27873 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/wdt_pci.ko 2021-01-27T09:35:59.007 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15841 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/wm831x_wdt.ko 2021-01-27T09:35:59.008 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13681 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/wm8350_wdt.ko 2021-01-27T09:35:59.008 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15001 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/watchdog/xen_wdt.ko 2021-01-27T09:35:59.008 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/xen/ 2021-01-27T09:35:59.008 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23321 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/xen/xen-evtchn.ko 2021-01-27T09:35:59.008 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26417 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/xen/xen-gntalloc.ko 2021-01-27T09:35:59.009 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44329 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/xen/xen-gntdev.ko 2021-01-27T09:35:59.009 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/xen/xen-pciback/ 2021-01-27T09:35:59.009 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 178665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2021-01-27T09:35:59.010 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40377 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/xen/xen-privcmd.ko 2021-01-27T09:35:59.010 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 72185 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/xen/xen-scsiback.ko 2021-01-27T09:35:59.011 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/xen/xenfs/ 2021-01-27T09:35:59.011 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18617 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/drivers/xen/xenfs/xenfs.ko 2021-01-27T09:35:59.011 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/ 2021-01-27T09:35:59.011 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/9p/ 2021-01-27T09:35:59.011 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 152337 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/9p/9p.ko 2021-01-27T09:35:59.012 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/adfs/ 2021-01-27T09:35:59.012 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 60249 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/adfs/adfs.ko 2021-01-27T09:35:59.012 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/affs/ 2021-01-27T09:35:59.012 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 162481 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/affs/affs.ko 2021-01-27T09:35:59.012 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/afs/ 2021-01-27T09:35:59.013 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 975537 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/afs/kafs.ko 2021-01-27T09:35:59.017 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/autofs/ 2021-01-27T09:35:59.017 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 106841 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/autofs/autofs4.ko 2021-01-27T09:35:59.018 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/befs/ 2021-01-27T09:35:59.018 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 63753 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/befs/befs.ko 2021-01-27T09:35:59.020 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/bfs/ 2021-01-27T09:35:59.020 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40769 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/bfs/bfs.ko 2021-01-27T09:35:59.021 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/binfmt_misc.ko 2021-01-27T09:35:59.021 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/btrfs/ 2021-01-27T09:35:59.021 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 3183801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/btrfs/btrfs.ko 2021-01-27T09:35:59.060 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/cachefiles/ 2021-01-27T09:35:59.060 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 194113 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/cachefiles/cachefiles.ko 2021-01-27T09:35:59.062 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/ceph/ 2021-01-27T09:35:59.062 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1129313 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/ceph/ceph.ko 2021-01-27T09:35:59.075 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/cifs/ 2021-01-27T09:35:59.075 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 2605905 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/cifs/cifs.ko 2021-01-27T09:35:59.102 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/coda/ 2021-01-27T09:35:59.103 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 98281 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/coda/coda.ko 2021-01-27T09:35:59.103 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/configfs/ 2021-01-27T09:35:59.104 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 102985 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/configfs/configfs.ko 2021-01-27T09:35:59.104 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/cramfs/ 2021-01-27T09:35:59.105 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28593 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/cramfs/cramfs.ko 2021-01-27T09:35:59.105 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/dlm/ 2021-01-27T09:35:59.106 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 438625 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/dlm/dlm.ko 2021-01-27T09:35:59.110 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/efs/ 2021-01-27T09:35:59.111 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 37529 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/efs/efs.ko 2021-01-27T09:35:59.111 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/f2fs/ 2021-01-27T09:35:59.112 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1389761 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/f2fs/f2fs.ko 2021-01-27T09:35:59.127 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/fat/ 2021-01-27T09:35:59.128 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/fat/msdos.ko 2021-01-27T09:35:59.128 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/freevxfs/ 2021-01-27T09:35:59.129 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44529 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/freevxfs/freevxfs.ko 2021-01-27T09:35:59.129 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/fscache/ 2021-01-27T09:35:59.129 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 317953 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/fscache/fscache.ko 2021-01-27T09:35:59.131 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/fuse/ 2021-01-27T09:35:59.132 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24457 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/fuse/cuse.ko 2021-01-27T09:35:59.132 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/gfs2/ 2021-01-27T09:35:59.132 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1198281 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/gfs2/gfs2.ko 2021-01-27T09:35:59.143 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/hfs/ 2021-01-27T09:35:59.144 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 141657 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/hfs/hfs.ko 2021-01-27T09:35:59.145 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/hfsplus/ 2021-01-27T09:35:59.145 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 229753 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/hfsplus/hfsplus.ko 2021-01-27T09:35:59.148 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/hpfs/ 2021-01-27T09:35:59.149 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 193745 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/hpfs/hpfs.ko 2021-01-27T09:35:59.151 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/isofs/ 2021-01-27T09:35:59.151 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 75889 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/isofs/isofs.ko 2021-01-27T09:35:59.152 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/jfs/ 2021-01-27T09:35:59.152 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 414201 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/jfs/jfs.ko 2021-01-27T09:35:59.158 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/lockd/ 2021-01-27T09:35:59.159 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 268273 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/lockd/lockd.ko 2021-01-27T09:35:59.161 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/minix/ 2021-01-27T09:35:59.161 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 83113 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/minix/minix.ko 2021-01-27T09:35:59.162 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nfs/ 2021-01-27T09:35:59.162 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nfs/blocklayout/ 2021-01-27T09:35:59.163 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 87209 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2021-01-27T09:35:59.163 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nfs/filelayout/ 2021-01-27T09:35:59.163 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 64433 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2021-01-27T09:35:59.164 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nfs/flexfilelayout/ 2021-01-27T09:35:59.164 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 123849 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2021-01-27T09:35:59.165 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 914385 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nfs/nfs.ko 2021-01-27T09:35:59.175 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 65537 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nfs/nfsv2.ko 2021-01-27T09:35:59.176 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 113721 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nfs/nfsv3.ko 2021-01-27T09:35:59.177 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1868145 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nfs/nfsv4.ko 2021-01-27T09:35:59.195 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nfs_common/ 2021-01-27T09:35:59.196 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18945 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nfs_common/grace.ko 2021-01-27T09:35:59.196 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13233 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nfs_common/nfs_acl.ko 2021-01-27T09:35:59.196 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7745 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nfs_common/nfs_ssc.ko 2021-01-27T09:35:59.196 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nfsd/ 2021-01-27T09:35:59.198 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1344849 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nfsd/nfsd.ko 2021-01-27T09:35:59.211 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nilfs2/ 2021-01-27T09:35:59.211 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 560761 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nilfs2/nilfs2.ko 2021-01-27T09:35:59.220 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/ 2021-01-27T09:35:59.220 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12953 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/mac-celtic.ko 2021-01-27T09:35:59.220 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12337 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/mac-centeuro.ko 2021-01-27T09:35:59.220 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12961 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/mac-croatian.ko 2021-01-27T09:35:59.221 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12025 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/mac-cyrillic.ko 2021-01-27T09:35:59.221 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12649 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/mac-gaelic.ko 2021-01-27T09:35:59.221 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12025 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/mac-greek.ko 2021-01-27T09:35:59.221 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12961 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/mac-iceland.ko 2021-01-27T09:35:59.222 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12329 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/mac-inuit.ko 2021-01-27T09:35:59.222 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13265 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/mac-roman.ko 2021-01-27T09:35:59.222 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12961 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/mac-romanian.ko 2021-01-27T09:35:59.222 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12961 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/mac-turkish.ko 2021-01-27T09:35:59.222 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10457 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_ascii.ko 2021-01-27T09:35:59.223 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_cp1250.ko 2021-01-27T09:35:59.223 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11393 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_cp1251.ko 2021-01-27T09:35:59.223 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12089 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_cp1255.ko 2021-01-27T09:35:59.223 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_cp737.ko 2021-01-27T09:35:59.223 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_cp775.ko 2021-01-27T09:35:59.224 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11393 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_cp850.ko 2021-01-27T09:35:59.224 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11393 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_cp852.ko 2021-01-27T09:35:59.224 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11393 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_cp855.ko 2021-01-27T09:35:59.225 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11081 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_cp857.ko 2021-01-27T09:35:59.225 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12017 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_cp860.ko 2021-01-27T09:35:59.225 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12329 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_cp861.ko 2021-01-27T09:35:59.225 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12641 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_cp862.ko 2021-01-27T09:35:59.226 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12329 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_cp863.ko 2021-01-27T09:35:59.226 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12017 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_cp864.ko 2021-01-27T09:35:59.226 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12329 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_cp865.ko 2021-01-27T09:35:59.227 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_cp866.ko 2021-01-27T09:35:59.227 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11393 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_cp869.ko 2021-01-27T09:35:59.227 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11153 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_cp874.ko 2021-01-27T09:35:59.227 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 93257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_cp932.ko 2021-01-27T09:35:59.228 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 141841 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_cp936.ko 2021-01-27T09:35:59.228 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 164977 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_cp949.ko 2021-01-27T09:35:59.229 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 117353 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_cp950.ko 2021-01-27T09:35:59.233 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11721 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_euc-jp.ko 2021-01-27T09:35:59.234 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10473 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_iso8859-1.ko 2021-01-27T09:35:59.234 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_iso8859-13.ko 2021-01-27T09:35:59.234 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_iso8859-14.ko 2021-01-27T09:35:59.234 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_iso8859-15.ko 2021-01-27T09:35:59.235 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_iso8859-2.ko 2021-01-27T09:35:59.235 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_iso8859-3.ko 2021-01-27T09:35:59.235 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_iso8859-4.ko 2021-01-27T09:35:59.235 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_iso8859-5.ko 2021-01-27T09:35:59.235 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10785 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_iso8859-6.ko 2021-01-27T09:35:59.236 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11409 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_iso8859-7.ko 2021-01-27T09:35:59.236 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10785 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_iso8859-9.ko 2021-01-27T09:35:59.236 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_koi8-r.ko 2021-01-27T09:35:59.236 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7233 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_koi8-ru.ko 2021-01-27T09:35:59.237 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_koi8-u.ko 2021-01-27T09:35:59.237 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7497 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/nls/nls_utf8.ko 2021-01-27T09:35:59.237 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/ntfs/ 2021-01-27T09:35:59.237 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 213505 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/ntfs/ntfs.ko 2021-01-27T09:35:59.238 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/ocfs2/ 2021-01-27T09:35:59.239 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/ocfs2/cluster/ 2021-01-27T09:35:59.239 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 235969 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2021-01-27T09:35:59.239 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/ocfs2/dlm/ 2021-01-27T09:35:59.239 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 435361 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2021-01-27T09:35:59.245 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/ocfs2/dlmfs/ 2021-01-27T09:35:59.245 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51313 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2021-01-27T09:35:59.246 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 2564401 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/ocfs2/ocfs2.ko 2021-01-27T09:35:59.273 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2021-01-27T09:35:59.273 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31105 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/ocfs2/ocfs2_stack_user.ko 2021-01-27T09:35:59.274 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34881 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/ocfs2/ocfs2_stackglue.ko 2021-01-27T09:35:59.274 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/omfs/ 2021-01-27T09:35:59.274 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 52609 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/omfs/omfs.ko 2021-01-27T09:35:59.275 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/overlayfs/ 2021-01-27T09:35:59.275 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 291801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/overlayfs/overlay.ko 2021-01-27T09:35:59.278 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/pstore/ 2021-01-27T09:35:59.278 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 55065 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/pstore/ramoops.ko 2021-01-27T09:35:59.280 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/qnx4/ 2021-01-27T09:35:59.280 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26393 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/qnx4/qnx4.ko 2021-01-27T09:35:59.280 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/qnx6/ 2021-01-27T09:35:59.280 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 45945 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/qnx6/qnx6.ko 2021-01-27T09:35:59.281 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/quota/ 2021-01-27T09:35:59.281 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28529 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/quota/quota_tree.ko 2021-01-27T09:35:59.281 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13793 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/quota/quota_v1.ko 2021-01-27T09:35:59.282 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21297 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/quota/quota_v2.ko 2021-01-27T09:35:59.282 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/reiserfs/ 2021-01-27T09:35:59.283 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 521913 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/reiserfs/reiserfs.ko 2021-01-27T09:35:59.288 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/romfs/ 2021-01-27T09:35:59.288 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27737 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/romfs/romfs.ko 2021-01-27T09:35:59.289 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/squashfs/ 2021-01-27T09:35:59.289 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 125785 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/squashfs/squashfs.ko 2021-01-27T09:35:59.290 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/sysv/ 2021-01-27T09:35:59.290 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 86889 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/sysv/sysv.ko 2021-01-27T09:35:59.291 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/udf/ 2021-01-27T09:35:59.291 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 249025 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/udf/udf.ko 2021-01-27T09:35:59.294 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/ufs/ 2021-01-27T09:35:59.294 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 158081 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/ufs/ufs.ko 2021-01-27T09:35:59.296 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/xfs/ 2021-01-27T09:35:59.297 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 3655401 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/fs/xfs/xfs.ko 2021-01-27T09:35:59.337 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/kernel/ 2021-01-27T09:35:59.338 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/kernel/locking/ 2021-01-27T09:35:59.338 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 57313 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/kernel/locking/locktorture.ko 2021-01-27T09:35:59.338 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/kernel/time/ 2021-01-27T09:35:59.338 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/kernel/time/test_udelay.ko 2021-01-27T09:35:59.339 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 48897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/kernel/torture.ko 2021-01-27T09:35:59.341 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/ 2021-01-27T09:35:59.341 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6441 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/crc-itu-t.ko 2021-01-27T09:35:59.341 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7633 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/crc64.ko 2021-01-27T09:35:59.342 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6137 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/crc7.ko 2021-01-27T09:35:59.342 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6497 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/crc8.ko 2021-01-27T09:35:59.342 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/crypto/ 2021-01-27T09:35:59.342 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6657 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/crypto/libarc4.ko 2021-01-27T09:35:59.343 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36473 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/crypto/libdes.ko 2021-01-27T09:35:59.343 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12921 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/interval_tree_test.ko 2021-01-27T09:35:59.343 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8041 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/libcrc32c.ko 2021-01-27T09:35:59.344 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24993 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/lru_cache.ko 2021-01-27T09:35:59.344 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/lz4/ 2021-01-27T09:35:59.344 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35841 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/lz4/lz4_compress.ko 2021-01-27T09:35:59.345 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22033 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/lz4/lz4hc_compress.ko 2021-01-27T09:35:59.345 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/math/ 2021-01-27T09:35:59.346 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6425 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/math/cordic.ko 2021-01-27T09:35:59.346 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7433 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/memory-notifier-error-inject.ko 2021-01-27T09:35:59.347 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10297 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/notifier-error-inject.ko 2021-01-27T09:35:59.347 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12473 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/percpu_test.ko 2021-01-27T09:35:59.347 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7513 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/pm-notifier-error-inject.ko 2021-01-27T09:35:59.347 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/raid6/ 2021-01-27T09:35:59.347 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 141745 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/raid6/raid6_pq.ko 2021-01-27T09:35:59.349 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18441 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/rbtree_test.ko 2021-01-27T09:35:59.349 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/reed_solomon/ 2021-01-27T09:35:59.349 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18065 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/reed_solomon/reed_solomon.ko 2021-01-27T09:35:59.350 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36993 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/test-kstrtox.ko 2021-01-27T09:35:59.351 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21657 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/test-string_helpers.ko 2021-01-27T09:35:59.351 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1715129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/test_bpf.ko 2021-01-27T09:35:59.352 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40681 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/test_firmware.ko 2021-01-27T09:35:59.352 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 5561 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/test_module.ko 2021-01-27T09:35:59.352 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20513 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/test_user_copy.ko 2021-01-27T09:35:59.353 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/ts_bm.ko 2021-01-27T09:35:59.353 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11017 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/ts_fsm.ko 2021-01-27T09:35:59.354 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8969 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/ts_kmp.ko 2021-01-27T09:35:59.354 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/xz/ 2021-01-27T09:35:59.354 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13337 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/xz/xz_dec_test.ko 2021-01-27T09:35:59.354 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/zstd/ 2021-01-27T09:35:59.355 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 259089 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/lib/zstd/zstd_compress.ko 2021-01-27T09:35:59.356 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/mm/ 2021-01-27T09:35:59.356 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13945 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/mm/hwpoison-inject.ko 2021-01-27T09:35:59.357 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ 2021-01-27T09:35:59.357 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/6lowpan/ 2021-01-27T09:35:59.358 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 58697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/6lowpan/6lowpan.ko 2021-01-27T09:35:59.358 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6673 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/6lowpan/nhc_dest.ko 2021-01-27T09:35:59.358 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/6lowpan/nhc_fragment.ko 2021-01-27T09:35:59.358 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/6lowpan/nhc_hop.ko 2021-01-27T09:35:59.358 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6609 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/6lowpan/nhc_ipv6.ko 2021-01-27T09:35:59.359 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/6lowpan/nhc_mobility.ko 2021-01-27T09:35:59.359 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6689 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/6lowpan/nhc_routing.ko 2021-01-27T09:35:59.359 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/6lowpan/nhc_udp.ko 2021-01-27T09:35:59.359 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/802/ 2021-01-27T09:35:59.360 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29425 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/802/garp.ko 2021-01-27T09:35:59.361 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33569 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/802/mrp.ko 2021-01-27T09:35:59.362 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8201 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/802/p8022.ko 2021-01-27T09:35:59.362 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14857 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/802/psnap.ko 2021-01-27T09:35:59.363 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11081 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/802/stp.ko 2021-01-27T09:35:59.363 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/8021q/ 2021-01-27T09:35:59.363 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 82841 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/8021q/8021q.ko 2021-01-27T09:35:59.363 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/9p/ 2021-01-27T09:35:59.364 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 207401 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/9p/9pnet.ko 2021-01-27T09:35:59.365 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26305 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/9p/9pnet_rdma.ko 2021-01-27T09:35:59.365 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30609 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/9p/9pnet_virtio.ko 2021-01-27T09:35:59.365 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/batman-adv/ 2021-01-27T09:35:59.365 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 646361 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/batman-adv/batman-adv.ko 2021-01-27T09:35:59.370 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/ 2021-01-27T09:35:59.371 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 81497 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/br_netfilter.ko 2021-01-27T09:35:59.372 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 611953 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/bridge.ko 2021-01-27T09:35:59.383 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/ 2021-01-27T09:35:59.384 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6921 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/ebt_802_3.ko 2021-01-27T09:35:59.384 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/ebt_among.ko 2021-01-27T09:35:59.384 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8425 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/ebt_arp.ko 2021-01-27T09:35:59.385 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8433 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/ebt_arpreply.ko 2021-01-27T09:35:59.385 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8561 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/ebt_dnat.ko 2021-01-27T09:35:59.386 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7993 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/ebt_ip.ko 2021-01-27T09:35:59.386 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/ebt_ip6.ko 2021-01-27T09:35:59.387 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9361 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/ebt_limit.ko 2021-01-27T09:35:59.387 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12169 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/ebt_log.ko 2021-01-27T09:35:59.387 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8265 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/ebt_mark.ko 2021-01-27T09:35:59.388 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8465 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/ebt_mark_m.ko 2021-01-27T09:35:59.388 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7585 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/ebt_nflog.ko 2021-01-27T09:35:59.389 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/ebt_pkttype.ko 2021-01-27T09:35:59.389 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8457 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/ebt_redirect.ko 2021-01-27T09:35:59.389 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7921 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/ebt_snat.ko 2021-01-27T09:35:59.390 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/ebt_stp.ko 2021-01-27T09:35:59.390 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11681 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/ebt_vlan.ko 2021-01-27T09:35:59.391 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9841 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/ebtable_broute.ko 2021-01-27T09:35:59.391 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8681 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/ebtable_filter.ko 2021-01-27T09:35:59.392 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8649 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/ebtable_nat.ko 2021-01-27T09:35:59.392 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 60217 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/ebtables.ko 2021-01-27T09:35:59.392 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8577 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/nf_log_bridge.ko 2021-01-27T09:35:59.393 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11497 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2021-01-27T09:35:59.393 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13121 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2021-01-27T09:35:59.393 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ceph/ 2021-01-27T09:35:59.394 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1028585 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ceph/libceph.ko 2021-01-27T09:35:59.395 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/core/ 2021-01-27T09:35:59.395 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 127489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/core/pktgen.ko 2021-01-27T09:35:59.396 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/dccp/ 2021-01-27T09:35:59.397 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 201145 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/dccp/dccp.ko 2021-01-27T09:35:59.399 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/dccp/dccp_diag.ko 2021-01-27T09:35:59.399 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53465 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/dccp/dccp_ipv4.ko 2021-01-27T09:35:59.400 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 54689 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/dccp/dccp_ipv6.ko 2021-01-27T09:35:59.400 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/decnet/ 2021-01-27T09:35:59.400 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 264009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/decnet/decnet.ko 2021-01-27T09:35:59.404 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/decnet/netfilter/ 2021-01-27T09:35:59.404 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10169 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/decnet/netfilter/dn_rtmsg.ko 2021-01-27T09:35:59.404 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/dsa/ 2021-01-27T09:35:59.404 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 145609 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/dsa/dsa_core.ko 2021-01-27T09:35:59.406 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10441 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/dsa/tag_brcm.ko 2021-01-27T09:35:59.406 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11369 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/dsa/tag_dsa.ko 2021-01-27T09:35:59.406 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/dsa/tag_trailer.ko 2021-01-27T09:35:59.407 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/hsr/ 2021-01-27T09:35:59.407 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 91345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/hsr/hsr.ko 2021-01-27T09:35:59.408 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ieee802154/ 2021-01-27T09:35:59.408 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ieee802154/6lowpan/ 2021-01-27T09:35:59.408 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44145 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2021-01-27T09:35:59.409 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 220897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ieee802154/ieee802154.ko 2021-01-27T09:35:59.410 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 45457 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ieee802154/ieee802154_socket.ko 2021-01-27T09:35:59.411 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/ 2021-01-27T09:35:59.411 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/ah4.ko 2021-01-27T09:35:59.411 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35305 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/esp4.ko 2021-01-27T09:35:59.412 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 51961 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/fou.ko 2021-01-27T09:35:59.412 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17313 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/gre.ko 2021-01-27T09:35:59.413 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 47433 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/inet_diag.ko 2021-01-27T09:35:59.413 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 63897 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/ip_gre.ko 2021-01-27T09:35:59.414 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 64609 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/ip_tunnel.ko 2021-01-27T09:35:59.415 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/ip_vti.ko 2021-01-27T09:35:59.415 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12313 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/ipcomp.ko 2021-01-27T09:35:59.415 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28321 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/ipip.ko 2021-01-27T09:35:59.419 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/ 2021-01-27T09:35:59.420 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 45033 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/arp_tables.ko 2021-01-27T09:35:59.420 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8185 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/arpt_mangle.ko 2021-01-27T09:35:59.420 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9265 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/arptable_filter.ko 2021-01-27T09:35:59.421 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53561 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/ip_tables.ko 2021-01-27T09:35:59.421 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 45673 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/ipt_CLUSTERIP.ko 2021-01-27T09:35:59.421 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9585 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/ipt_ECN.ko 2021-01-27T09:35:59.421 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9657 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2021-01-27T09:35:59.422 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15361 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2021-01-27T09:35:59.422 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10497 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/ipt_ah.ko 2021-01-27T09:35:59.422 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14305 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2021-01-27T09:35:59.422 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10425 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/iptable_filter.ko 2021-01-27T09:35:59.423 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10729 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/iptable_mangle.ko 2021-01-27T09:35:59.423 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10209 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/iptable_nat.ko 2021-01-27T09:35:59.423 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11017 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/iptable_raw.ko 2021-01-27T09:35:59.423 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9649 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/iptable_security.ko 2021-01-27T09:35:59.424 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10777 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2021-01-27T09:35:59.424 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8073 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2021-01-27T09:35:59.424 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7033 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/nf_flow_table_ipv4.ko 2021-01-27T09:35:59.424 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11441 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/nf_log_arp.ko 2021-01-27T09:35:59.425 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16993 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/nf_log_ipv4.ko 2021-01-27T09:35:59.425 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29409 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2021-01-27T09:35:59.425 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18105 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2021-01-27T09:35:59.425 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12641 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2021-01-27T09:35:59.426 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18889 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2021-01-27T09:35:59.426 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8841 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2021-01-27T09:35:59.433 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14481 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2021-01-27T09:35:59.433 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9321 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2021-01-27T09:35:59.433 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15521 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2021-01-27T09:35:59.433 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8281 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2021-01-27T09:35:59.434 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/tcp_bic.ko 2021-01-27T09:35:59.434 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11297 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/tcp_dctcp.ko 2021-01-27T09:35:59.434 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14417 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/tcp_diag.ko 2021-01-27T09:35:59.434 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8441 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/tcp_highspeed.ko 2021-01-27T09:35:59.435 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11521 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/tcp_htcp.ko 2021-01-27T09:35:59.435 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8921 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/tcp_hybla.ko 2021-01-27T09:35:59.435 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10225 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/tcp_illinois.ko 2021-01-27T09:35:59.435 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9777 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/tcp_lp.ko 2021-01-27T09:35:59.436 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7505 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/tcp_scalable.ko 2021-01-27T09:35:59.436 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12905 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/tcp_vegas.ko 2021-01-27T09:35:59.436 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9001 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/tcp_veno.ko 2021-01-27T09:35:59.437 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9625 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/tcp_westwood.ko 2021-01-27T09:35:59.437 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8969 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/tcp_yeah.ko 2021-01-27T09:35:59.437 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21465 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/tunnel4.ko 2021-01-27T09:35:59.437 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15761 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/udp_diag.ko 2021-01-27T09:35:59.438 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 40537 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/udp_tunnel.ko 2021-01-27T09:35:59.438 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv4/xfrm4_tunnel.ko 2021-01-27T09:35:59.440 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/ 2021-01-27T09:35:59.441 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25041 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/ah6.ko 2021-01-27T09:35:59.441 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36273 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/esp6.ko 2021-01-27T09:35:59.441 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13889 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/fou6.ko 2021-01-27T09:35:59.441 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 93497 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/ip6_gre.ko 2021-01-27T09:35:59.442 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 101265 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/ip6_tunnel.ko 2021-01-27T09:35:59.442 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9873 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/ip6_udp_tunnel.ko 2021-01-27T09:35:59.442 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 61993 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/ip6_vti.ko 2021-01-27T09:35:59.443 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12865 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/ipcomp6.ko 2021-01-27T09:35:59.443 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21025 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/mip6.ko 2021-01-27T09:35:59.443 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/ 2021-01-27T09:35:59.443 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 54121 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/ip6_tables.ko 2021-01-27T09:35:59.444 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11073 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2021-01-27T09:35:59.444 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9729 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2021-01-27T09:35:59.444 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15449 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2021-01-27T09:35:59.444 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13673 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/ip6t_ah.ko 2021-01-27T09:35:59.445 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7065 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2021-01-27T09:35:59.445 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15681 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/ip6t_frag.ko 2021-01-27T09:35:59.445 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15385 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2021-01-27T09:35:59.445 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8137 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2021-01-27T09:35:59.446 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9201 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/ip6t_mh.ko 2021-01-27T09:35:59.446 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10281 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2021-01-27T09:35:59.446 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19481 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/ip6t_rt.ko 2021-01-27T09:35:59.447 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10441 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/ip6table_filter.ko 2021-01-27T09:35:59.447 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10073 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2021-01-27T09:35:59.447 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10225 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/ip6table_nat.ko 2021-01-27T09:35:59.447 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11033 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/ip6table_raw.ko 2021-01-27T09:35:59.448 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/ip6table_security.ko 2021-01-27T09:35:59.448 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34689 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2021-01-27T09:35:59.448 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7817 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2021-01-27T09:35:59.448 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7041 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/nf_flow_table_ipv6.ko 2021-01-27T09:35:59.449 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/nf_log_ipv6.ko 2021-01-27T09:35:59.449 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24225 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2021-01-27T09:35:59.449 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9689 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2021-01-27T09:35:59.449 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14809 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2021-01-27T09:35:59.450 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9057 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2021-01-27T09:35:59.450 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14073 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2021-01-27T09:35:59.450 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8281 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2021-01-27T09:35:59.450 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 90393 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/sit.ko 2021-01-27T09:35:59.451 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22841 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/tunnel6.ko 2021-01-27T09:35:59.451 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/ipv6/xfrm6_tunnel.ko 2021-01-27T09:35:59.451 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/key/ 2021-01-27T09:35:59.451 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 94785 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/key/af_key.ko 2021-01-27T09:35:59.455 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/l2tp/ 2021-01-27T09:35:59.455 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 127697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/l2tp/l2tp_core.ko 2021-01-27T09:35:59.455 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/l2tp/l2tp_debugfs.ko 2021-01-27T09:35:59.456 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24065 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/l2tp/l2tp_eth.ko 2021-01-27T09:35:59.456 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33873 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/l2tp/l2tp_ip.ko 2021-01-27T09:35:59.456 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35089 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/l2tp/l2tp_ip6.ko 2021-01-27T09:35:59.456 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32073 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/l2tp/l2tp_netlink.ko 2021-01-27T09:35:59.457 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53065 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/l2tp/l2tp_ppp.ko 2021-01-27T09:35:59.457 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/lapb/ 2021-01-27T09:35:59.457 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 46329 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/lapb/lapb.ko 2021-01-27T09:35:59.457 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/llc/ 2021-01-27T09:35:59.458 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21713 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/llc/llc.ko 2021-01-27T09:35:59.458 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 263801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/llc/llc2.ko 2021-01-27T09:35:59.458 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/mac802154/ 2021-01-27T09:35:59.458 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 218929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/mac802154/mac802154.ko 2021-01-27T09:35:59.459 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/mpls/ 2021-01-27T09:35:59.459 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/mpls/mpls_gso.ko 2021-01-27T09:35:59.459 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ 2021-01-27T09:35:59.459 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipset/ 2021-01-27T09:35:59.460 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 135689 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipset/ip_set.ko 2021-01-27T09:35:59.460 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27721 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2021-01-27T09:35:59.460 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26305 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2021-01-27T09:35:59.460 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25113 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2021-01-27T09:35:59.461 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 102129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2021-01-27T09:35:59.461 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 103257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2021-01-27T09:35:59.461 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 104065 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2021-01-27T09:35:59.461 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 105281 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2021-01-27T09:35:59.462 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 112521 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2021-01-27T09:35:59.462 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 60753 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2021-01-27T09:35:59.462 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 108945 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2021-01-27T09:35:59.462 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 112409 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2021-01-27T09:35:59.463 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 110873 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2021-01-27T09:35:59.463 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 111065 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2021-01-27T09:35:59.463 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 112825 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2021-01-27T09:35:59.463 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29721 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipset/ip_set_list_set.ko 2021-01-27T09:35:59.465 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipvs/ 2021-01-27T09:35:59.466 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 384345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipvs/ip_vs.ko 2021-01-27T09:35:59.466 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11121 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2021-01-27T09:35:59.466 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6865 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2021-01-27T09:35:59.466 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17569 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2021-01-27T09:35:59.467 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16977 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2021-01-27T09:35:59.467 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2021-01-27T09:35:59.467 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6865 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2021-01-27T09:35:59.467 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2021-01-27T09:35:59.468 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2021-01-27T09:35:59.468 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8481 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2021-01-27T09:35:59.468 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6937 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2021-01-27T09:35:59.469 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2021-01-27T09:35:59.469 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6937 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2021-01-27T09:35:59.469 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2021-01-27T09:35:59.469 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 47169 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_conncount.ko 2021-01-27T09:35:59.470 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 414825 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_conntrack.ko 2021-01-27T09:35:59.471 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15249 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_conntrack_amanda.ko 2021-01-27T09:35:59.471 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9241 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_conntrack_broadcast.ko 2021-01-27T09:35:59.471 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32961 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_conntrack_ftp.ko 2021-01-27T09:35:59.472 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 118889 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_conntrack_h323.ko 2021-01-27T09:35:59.472 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21161 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_conntrack_irc.ko 2021-01-27T09:35:59.472 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8081 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2021-01-27T09:35:59.472 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 105305 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_conntrack_netlink.ko 2021-01-27T09:35:59.473 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34249 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_conntrack_pptp.ko 2021-01-27T09:35:59.474 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17577 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_conntrack_sane.ko 2021-01-27T09:35:59.474 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 61385 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_conntrack_sip.ko 2021-01-27T09:35:59.474 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_conntrack_snmp.ko 2021-01-27T09:35:59.475 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18105 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_conntrack_tftp.ko 2021-01-27T09:35:59.475 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_dup_netdev.ko 2021-01-27T09:35:59.475 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 75873 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_flow_table.ko 2021-01-27T09:35:59.476 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7857 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_flow_table_inet.ko 2021-01-27T09:35:59.477 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15329 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_log_common.ko 2021-01-27T09:35:59.477 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 86137 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_nat.ko 2021-01-27T09:35:59.477 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9401 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_nat_amanda.ko 2021-01-27T09:35:59.477 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12177 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_nat_ftp.ko 2021-01-27T09:35:59.478 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11401 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_nat_irc.ko 2021-01-27T09:35:59.478 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 27433 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_nat_sip.ko 2021-01-27T09:35:59.478 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8001 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_nat_tftp.ko 2021-01-27T09:35:59.478 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 53185 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_synproxy_core.ko 2021-01-27T09:35:59.479 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 499769 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nf_tables.ko 2021-01-27T09:35:59.484 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33281 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nfnetlink.ko 2021-01-27T09:35:59.485 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34905 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nfnetlink_acct.ko 2021-01-27T09:35:59.485 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26409 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nfnetlink_cttimeout.ko 2021-01-27T09:35:59.486 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 46569 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nfnetlink_log.ko 2021-01-27T09:35:59.486 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21681 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nfnetlink_osf.ko 2021-01-27T09:35:59.487 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 60321 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nfnetlink_queue.ko 2021-01-27T09:35:59.487 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nft_chain_nat.ko 2021-01-27T09:35:59.488 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nft_compat.ko 2021-01-27T09:35:59.488 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19233 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nft_counter.ko 2021-01-27T09:35:59.489 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38817 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nft_ct.ko 2021-01-27T09:35:59.489 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8817 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nft_dup_netdev.ko 2021-01-27T09:35:59.490 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10585 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nft_fib.ko 2021-01-27T09:35:59.490 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nft_fwd_netdev.ko 2021-01-27T09:35:59.490 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nft_hash.ko 2021-01-27T09:35:59.490 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16777 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nft_limit.ko 2021-01-27T09:35:59.491 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14409 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nft_log.ko 2021-01-27T09:35:59.491 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14689 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nft_masq.ko 2021-01-27T09:35:59.492 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13881 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nft_nat.ko 2021-01-27T09:35:59.492 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13225 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nft_numgen.ko 2021-01-27T09:35:59.492 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10969 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nft_osf.ko 2021-01-27T09:35:59.493 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13065 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nft_queue.ko 2021-01-27T09:35:59.493 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nft_redir.ko 2021-01-27T09:35:59.502 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9953 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nft_reject.ko 2021-01-27T09:35:59.502 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9289 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nft_reject_inet.ko 2021-01-27T09:35:59.503 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11241 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nft_socket.ko 2021-01-27T09:35:59.503 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22849 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nft_synproxy.ko 2021-01-27T09:35:59.503 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13201 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/nft_tproxy.ko 2021-01-27T09:35:59.503 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 92289 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/x_tables.ko 2021-01-27T09:35:59.503 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11697 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_AUDIT.ko 2021-01-27T09:35:59.504 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9289 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_CHECKSUM.ko 2021-01-27T09:35:59.505 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6993 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_CLASSIFY.ko 2021-01-27T09:35:59.505 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10825 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_CONNSECMARK.ko 2021-01-27T09:35:59.505 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17657 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_CT.ko 2021-01-27T09:35:59.505 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10041 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_DSCP.ko 2021-01-27T09:35:59.506 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8713 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_HL.ko 2021-01-27T09:35:59.506 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12809 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_HMARK.ko 2021-01-27T09:35:59.506 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 38089 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_IDLETIMER.ko 2021-01-27T09:35:59.506 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13553 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_LED.ko 2021-01-27T09:35:59.507 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10065 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_LOG.ko 2021-01-27T09:35:59.507 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10985 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_MASQUERADE.ko 2021-01-27T09:35:59.507 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10881 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_NETMAP.ko 2021-01-27T09:35:59.507 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8209 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_NFLOG.ko 2021-01-27T09:35:59.507 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14033 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_NFQUEUE.ko 2021-01-27T09:35:59.508 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 21641 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_RATEEST.ko 2021-01-27T09:35:59.508 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9985 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_REDIRECT.ko 2021-01-27T09:35:59.508 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12761 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_SECMARK.ko 2021-01-27T09:35:59.508 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14745 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_TCPMSS.ko 2021-01-27T09:35:59.508 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2021-01-27T09:35:59.509 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19513 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_TEE.ko 2021-01-27T09:35:59.509 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20049 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_TPROXY.ko 2021-01-27T09:35:59.509 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7369 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_TRACE.ko 2021-01-27T09:35:59.509 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12769 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_addrtype.ko 2021-01-27T09:35:59.509 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13545 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_bpf.ko 2021-01-27T09:35:59.510 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16793 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_cgroup.ko 2021-01-27T09:35:59.510 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_cluster.ko 2021-01-27T09:35:59.510 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6761 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_comment.ko 2021-01-27T09:35:59.510 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9569 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_connbytes.ko 2021-01-27T09:35:59.510 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10553 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_connlabel.ko 2021-01-27T09:35:59.511 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8601 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_connlimit.ko 2021-01-27T09:35:59.511 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12809 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_connmark.ko 2021-01-27T09:35:59.511 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12057 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_conntrack.ko 2021-01-27T09:35:59.511 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7089 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_cpu.ko 2021-01-27T09:35:59.512 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_dccp.ko 2021-01-27T09:35:59.512 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_devgroup.ko 2021-01-27T09:35:59.512 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_dscp.ko 2021-01-27T09:35:59.512 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10329 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_ecn.ko 2021-01-27T09:35:59.512 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10793 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_esp.ko 2021-01-27T09:35:59.513 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 49345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_hashlimit.ko 2021-01-27T09:35:59.513 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10857 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_helper.ko 2021-01-27T09:35:59.513 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7241 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_hl.ko 2021-01-27T09:35:59.513 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11553 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_ipcomp.ko 2021-01-27T09:35:59.513 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10729 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_iprange.ko 2021-01-27T09:35:59.514 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11785 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_ipvs.ko 2021-01-27T09:35:59.514 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 16289 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_l2tp.ko 2021-01-27T09:35:59.514 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7201 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_length.ko 2021-01-27T09:35:59.514 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11577 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_limit.ko 2021-01-27T09:35:59.514 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6809 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_mac.ko 2021-01-27T09:35:59.515 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7825 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_mark.ko 2021-01-27T09:35:59.515 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11129 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_multiport.ko 2021-01-27T09:35:59.515 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13833 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_nat.ko 2021-01-27T09:35:59.515 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9705 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_nfacct.ko 2021-01-27T09:35:59.515 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7537 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_osf.ko 2021-01-27T09:35:59.516 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8825 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_owner.ko 2021-01-27T09:35:59.516 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9257 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_physdev.ko 2021-01-27T09:35:59.516 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6889 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_pkttype.ko 2021-01-27T09:35:59.516 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_policy.ko 2021-01-27T09:35:59.516 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8737 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_quota.ko 2021-01-27T09:35:59.517 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9585 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_rateest.ko 2021-01-27T09:35:59.517 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7569 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_realm.ko 2021-01-27T09:35:59.517 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_recent.ko 2021-01-27T09:35:59.517 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12649 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_sctp.ko 2021-01-27T09:35:59.517 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30841 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_set.ko 2021-01-27T09:35:59.518 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_socket.ko 2021-01-27T09:35:59.518 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9105 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_state.ko 2021-01-27T09:35:59.518 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8769 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_statistic.ko 2021-01-27T09:35:59.518 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8009 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_string.ko 2021-01-27T09:35:59.519 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_tcpmss.ko 2021-01-27T09:35:59.519 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13057 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_tcpudp.ko 2021-01-27T09:35:59.519 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10585 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_time.ko 2021-01-27T09:35:59.519 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8425 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netfilter/xt_u32.ko 2021-01-27T09:35:59.519 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netlink/ 2021-01-27T09:35:59.520 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 13345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/netlink/netlink_diag.ko 2021-01-27T09:35:59.520 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/nsh/ 2021-01-27T09:35:59.520 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 11745 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/nsh/nsh.ko 2021-01-27T09:35:59.520 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/openvswitch/ 2021-01-27T09:35:59.520 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 368833 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/openvswitch/openvswitch.ko 2021-01-27T09:35:59.522 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9393 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/openvswitch/vport-geneve.ko 2021-01-27T09:35:59.522 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 8521 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/openvswitch/vport-gre.ko 2021-01-27T09:35:59.522 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/openvswitch/vport-vxlan.ko 2021-01-27T09:35:59.523 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/packet/ 2021-01-27T09:35:59.523 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12377 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/packet/af_packet_diag.ko 2021-01-27T09:35:59.523 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/phonet/ 2021-01-27T09:35:59.523 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 123497 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/phonet/phonet.ko 2021-01-27T09:35:59.523 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 54865 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/phonet/pn_pep.ko 2021-01-27T09:35:59.524 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/rds/ 2021-01-27T09:35:59.524 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 239857 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/rds/rds.ko 2021-01-27T09:35:59.524 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 161361 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/rds/rds_rdma.ko 2021-01-27T09:35:59.524 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 67689 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/rds/rds_tcp.ko 2021-01-27T09:35:59.524 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/rxrpc/ 2021-01-27T09:35:59.525 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 691345 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/rxrpc/rxrpc.ko 2021-01-27T09:35:59.526 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/ 2021-01-27T09:35:59.526 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35137 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/act_csum.ko 2021-01-27T09:35:59.527 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26729 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/act_gact.ko 2021-01-27T09:35:59.527 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 37065 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/act_ipt.ko 2021-01-27T09:35:59.527 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 36681 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/act_mirred.ko 2021-01-27T09:35:59.527 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26313 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/act_nat.ko 2021-01-27T09:35:59.528 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30945 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/act_pedit.ko 2021-01-27T09:35:59.528 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29953 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/act_police.ko 2021-01-27T09:35:59.528 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25593 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/act_simple.ko 2021-01-27T09:35:59.528 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28953 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/act_skbedit.ko 2021-01-27T09:35:59.528 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29985 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/act_vlan.ko 2021-01-27T09:35:59.529 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 24657 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/cls_basic.ko 2021-01-27T09:35:59.529 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34289 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/cls_bpf.ko 2021-01-27T09:35:59.529 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18601 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/cls_cgroup.ko 2021-01-27T09:35:59.531 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 31025 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/cls_flow.ko 2021-01-27T09:35:59.531 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28801 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/cls_fw.ko 2021-01-27T09:35:59.531 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 34489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/cls_route.ko 2021-01-27T09:35:59.531 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35425 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/cls_rsvp.ko 2021-01-27T09:35:59.531 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 35081 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/cls_rsvp6.ko 2021-01-27T09:35:59.532 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 41169 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/cls_tcindex.ko 2021-01-27T09:35:59.532 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 54529 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/cls_u32.ko 2021-01-27T09:35:59.532 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6617 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/em_cmp.ko 2021-01-27T09:35:59.532 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 12641 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/em_ipset.ko 2021-01-27T09:35:59.532 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32001 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/em_meta.ko 2021-01-27T09:35:59.533 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7073 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/em_nbyte.ko 2021-01-27T09:35:59.533 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9873 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/em_text.ko 2021-01-27T09:35:59.533 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 6425 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/em_u32.ko 2021-01-27T09:35:59.533 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 46233 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_cbq.ko 2021-01-27T09:35:59.535 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19033 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_choke.ko 2021-01-27T09:35:59.535 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19865 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_codel.ko 2021-01-27T09:35:59.535 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 30593 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_drr.ko 2021-01-27T09:35:59.535 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 32873 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_dsmark.ko 2021-01-27T09:35:59.536 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29625 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_fq.ko 2021-01-27T09:35:59.536 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28753 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_fq_codel.ko 2021-01-27T09:35:59.536 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29665 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_gred.ko 2021-01-27T09:35:59.536 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 45929 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_hfsc.ko 2021-01-27T09:35:59.536 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 20097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_hhf.ko 2021-01-27T09:35:59.537 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 50577 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_htb.ko 2021-01-27T09:35:59.537 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15089 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_ingress.ko 2021-01-27T09:35:59.537 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22857 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_mqprio.ko 2021-01-27T09:35:59.538 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23721 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_multiq.ko 2021-01-27T09:35:59.539 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 33377 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_netem.ko 2021-01-27T09:35:59.539 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 23385 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_pie.ko 2021-01-27T09:35:59.539 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9505 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_plug.ko 2021-01-27T09:35:59.539 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 22985 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_prio.ko 2021-01-27T09:35:59.540 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 44273 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_qfq.ko 2021-01-27T09:35:59.540 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 28649 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_red.ko 2021-01-27T09:35:59.540 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25025 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_sfb.ko 2021-01-27T09:35:59.540 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 29145 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_sfq.ko 2021-01-27T09:35:59.540 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 26105 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_tbf.ko 2021-01-27T09:35:59.541 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 25729 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sched/sch_teql.ko 2021-01-27T09:35:59.541 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sctp/ 2021-01-27T09:35:59.541 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 891641 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sctp/sctp.ko 2021-01-27T09:35:59.550 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 18097 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sctp/sctp_diag.ko 2021-01-27T09:35:59.551 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sunrpc/ 2021-01-27T09:35:59.551 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sunrpc/auth_gss/ 2021-01-27T09:35:59.551 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 335521 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2021-01-27T09:35:59.554 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 62481 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2021-01-27T09:35:59.569 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1421809 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sunrpc/sunrpc.ko 2021-01-27T09:35:59.610 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sunrpc/xprtrdma/ 2021-01-27T09:35:59.611 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 647025 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2021-01-27T09:35:59.616 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/tipc/ 2021-01-27T09:35:59.617 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9225 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/tipc/diag.ko 2021-01-27T09:35:59.617 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 1118537 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/tipc/tipc.ko 2021-01-27T09:35:59.630 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/unix/ 2021-01-27T09:35:59.630 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 15217 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/unix/unix_diag.ko 2021-01-27T09:35:59.630 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/vmw_vsock/ 2021-01-27T09:35:59.631 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 73161 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2021-01-27T09:35:59.631 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 67209 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2021-01-27T09:35:59.631 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 77561 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/vmw_vsock/vsock.ko 2021-01-27T09:35:59.632 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 9969 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/vmw_vsock/vsock_diag.ko 2021-01-27T09:35:59.632 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 17313 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/vmw_vsock/vsock_loopback.ko 2021-01-27T09:35:59.633 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/x25/ 2021-01-27T09:35:59.633 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 128169 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/x25/x25.ko 2021-01-27T09:35:59.634 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/xfrm/ 2021-01-27T09:35:59.634 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19673 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/xfrm/xfrm_algo.ko 2021-01-27T09:35:59.635 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 19809 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/xfrm/xfrm_ipcomp.ko 2021-01-27T09:35:59.635 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 82417 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/net/xfrm/xfrm_user.ko 2021-01-27T09:35:59.636 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/virt/ 2021-01-27T09:35:59.636 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/virt/lib/ 2021-01-27T09:35:59.636 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 14489 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/kernel/virt/lib/irqbypass.ko 2021-01-27T09:35:59.636 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 617416 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/modules.alias 2021-01-27T09:35:59.640 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 603043 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/modules.alias.bin 2021-01-27T09:35:59.646 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 7779 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/modules.builtin 2021-01-27T09:35:59.646 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 10249 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/modules.builtin.bin 2021-01-27T09:35:59.647 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 63495 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/modules.builtin.modinfo 2021-01-27T09:35:59.647 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 146691 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/modules.dep 2021-01-27T09:35:59.648 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 236053 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/modules.dep.bin 2021-01-27T09:35:59.650 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 210 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/modules.devname 2021-01-27T09:35:59.651 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 74777 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/modules.order 2021-01-27T09:35:59.651 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 574 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/modules.softdep 2021-01-27T09:35:59.651 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 241040 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/modules.symbols 2021-01-27T09:35:59.654 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 292750 2021-01-25 17:59 ./lib/modules/5.11.0-rc5-ceph-gd418614dd912/modules.symbols.bin 2021-01-27T09:35:59.658 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./usr/ 2021-01-27T09:35:59.658 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./usr/share/ 2021-01-27T09:35:59.658 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./usr/share/doc/ 2021-01-27T09:35:59.658 INFO:teuthology.orchestra.run.smithi146.stdout:drwxr-xr-x root/root 0 2021-01-25 17:59 ./usr/share/doc/linux-image-5.11.0-rc5-ceph-gd418614dd912/ 2021-01-27T09:35:59.658 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 177 2021-01-25 17:59 ./usr/share/doc/linux-image-5.11.0-rc5-ceph-gd418614dd912/changelog.Debian.gz 2021-01-27T09:35:59.659 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r-- root/root 692 2021-01-25 17:59 ./usr/share/doc/linux-image-5.11.0-rc5-ceph-gd418614dd912/copyright 2021-01-27T09:35:59.660 DEBUG:teuthology.task.kernel:get_image_version: 5.11.0-rc5-ceph-gd418614dd912 2021-01-27T09:35:59.660 INFO:teuthology.task.kernel:searching for kernel 5.11.0-rc5-ceph-gd418614dd912 2021-01-27T09:35:59.661 DEBUG:teuthology.orchestra.run.smithi146:> egrep '(submenu|menuentry.*5.11.0-rc5-ceph-gd418614dd912).*{' /boot/grub/grub.cfg 2021-01-27T09:35:59.666 INFO:teuthology.orchestra.run.smithi146.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-ae02d76a-c1bf-47f7-9641-985fab1b2f70' { 2021-01-27T09:35:59.667 INFO:teuthology.orchestra.run.smithi146.stdout: menuentry 'Ubuntu, with Linux 5.11.0-rc5-ceph-gd418614dd912' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-5.11.0-rc5-ceph-gd418614dd912-advanced-ae02d76a-c1bf-47f7-9641-985fab1b2f70' { 2021-01-27T09:35:59.667 INFO:teuthology.orchestra.run.smithi146.stdout: menuentry 'Ubuntu, with Linux 5.11.0-rc5-ceph-gd418614dd912 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-5.11.0-rc5-ceph-gd418614dd912-recovery-ae02d76a-c1bf-47f7-9641-985fab1b2f70' { 2021-01-27T09:35:59.668 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2021-01-27T09:35:59.668 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 5.11.0-rc5-ceph-gd418614dd912 2021-01-27T09:35:59.668 DEBUG:teuthology.orchestra.run.smithi146:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2021-01-27T09:35:59.671 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi146.front.sepia.ceph.com to complete... 2021-01-27T09:36:00.386 INFO:teuthology.orchestra.run.smithi146.stderr:Sourcing file `/etc/default/grub' 2021-01-27T09:36:00.388 INFO:teuthology.orchestra.run.smithi146.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-01-27T09:36:00.392 INFO:teuthology.orchestra.run.smithi146.stderr:Generating grub configuration file ... 2021-01-27T09:36:00.669 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-5.11.0-rc5-ceph-gd418614dd912 2021-01-27T09:36:00.680 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initrd.img-5.11.0-rc5-ceph-gd418614dd912 2021-01-27T09:36:01.061 INFO:teuthology.orchestra.run.smithi146.stderr:Found linux image: /boot/vmlinuz-5.4.0-64-generic 2021-01-27T09:36:01.072 INFO:teuthology.orchestra.run.smithi146.stderr:Found initrd image: /boot/initrd.img-5.4.0-64-generic 2021-01-27T09:36:02.713 INFO:teuthology.orchestra.run.smithi146.stderr:done 2021-01-27T09:36:33.833 INFO:teuthology.misc:Re-opening connections... 2021-01-27T09:36:33.835 INFO:teuthology.misc:trying to connect to ubuntu@smithi146.front.sepia.ceph.com 2021-01-27T09:36:33.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:36:33.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:37:08.290 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2021-01-27T09:37:08.291 INFO:teuthology.misc:trying to connect to ubuntu@smithi078.front.sepia.ceph.com 2021-01-27T09:37:08.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:37:08.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:37:08.339 DEBUG:teuthology.orchestra.run.smithi078:> true 2021-01-27T09:37:08.456 DEBUG:teuthology.misc:waited 34.62095880508423 2021-01-27T09:37:09.457 INFO:teuthology.misc:trying to connect to ubuntu@smithi146.front.sepia.ceph.com 2021-01-27T09:37:09.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:37:09.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:37:12.518 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2021-01-27T09:37:12.519 DEBUG:teuthology.misc:waited 38.68411636352539 2021-01-27T09:37:13.519 INFO:teuthology.misc:trying to connect to ubuntu@smithi146.front.sepia.ceph.com 2021-01-27T09:37:13.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:37:13.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:38:13.522 DEBUG:teuthology.orchestra.remote:timed out 2021-01-27T09:38:13.524 DEBUG:teuthology.misc:waited 99.68941688537598 2021-01-27T09:38:14.525 INFO:teuthology.misc:trying to connect to ubuntu@smithi146.front.sepia.ceph.com 2021-01-27T09:38:14.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:38:14.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:38:14.664 DEBUG:teuthology.orchestra.run.smithi146:> true 2021-01-27T09:38:15.169 DEBUG:teuthology.misc:waited 101.33392906188965 2021-01-27T09:38:16.171 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2021-01-27T09:38:16.172 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.11.0-rc5-ceph-gd418614dd912"... 2021-01-27T09:38:16.172 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2021-01-27T09:38:16.191 INFO:teuthology.orchestra.run.smithi146.stdout:5.11.0-rc5-ceph-gd418614dd912 2021-01-27T09:38:16.191 DEBUG:teuthology.task.kernel:current kernel version is 5.11.0-rc5-ceph-gd418614dd912 vs 5.11.0-rc5-ceph-gd418614dd912 2021-01-27T09:38:16.192 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-01-27T09:38:16.192 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-01-27T09:38:17.193 INFO:teuthology.run_tasks:Running task internal.base... 2021-01-27T09:38:17.201 INFO:teuthology.task.internal:Creating test directory... 2021-01-27T09:38:17.202 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-01-27T09:38:17.205 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-01-27T09:38:17.224 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-01-27T09:38:17.233 INFO:teuthology.run_tasks:Running task internal.archive... 2021-01-27T09:38:17.242 INFO:teuthology.task.internal:Creating archive directory... 2021-01-27T09:38:17.243 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-01-27T09:38:17.245 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-01-27T09:38:17.588 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-01-27T09:38:17.598 INFO:teuthology.task.internal:Enabling coredump saving... 2021-01-27T09:38:17.599 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-01-27T09:38:17.601 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-01-27T09:38:17.631 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-27T09:38:17.642 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-27T09:38:17.702 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-27T09:38:17.731 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-27T09:38:17.736 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-01-27T09:38:17.746 INFO:teuthology.task.internal:Configuring sudo... 2021-01-27T09:38:17.746 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-01-27T09:38:17.748 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-01-27T09:38:17.789 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-01-27T09:38:17.800 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-01-27T09:38:17.801 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-01-27T09:38:17.807 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-01-27T09:38:17.825 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-01-27T09:38:17.887 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-01-27T09:38:17.904 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:38:17.905 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-01-27T09:38:17.950 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-01-27T09:38:17.957 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-01-27T09:38:18.006 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2021-01-27T09:38:18.007 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-01-27T09:38:18.042 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2021-01-27T09:38:18.045 DEBUG:teuthology.orchestra.run.smithi146:> sudo service rsyslog restart 2021-01-27T09:38:18.140 INFO:teuthology.run_tasks:Running task internal.timer... 2021-01-27T09:38:18.150 INFO:teuthology.task.internal:Starting timer... 2021-01-27T09:38:18.150 INFO:teuthology.run_tasks:Running task pcp... 2021-01-27T09:38:18.165 INFO:teuthology.run_tasks:Running task selinux... 2021-01-27T09:38:18.184 DEBUG:teuthology.task.selinux:Excluding smithi146: OS 'ubuntu' does not support SELinux 2021-01-27T09:38:18.185 DEBUG:teuthology.task.selinux:Excluding smithi078: OS 'ubuntu' does not support SELinux 2021-01-27T09:38:18.185 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-01-27T09:38:18.185 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-01-27T09:38:18.186 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-01-27T09:38:18.186 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-01-27T09:38:18.200 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2021-01-27T09:38:18.206 INFO:teuthology.repo_utils:Fetching master from origin 2021-01-27T09:38:18.249 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2021-01-27T09:38:18.263 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-01-27T09:38:18.266 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi146.front.sepia.ceph.com,smithi078.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-01-27T09:38:18.636 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-01-27T09:38:19.626 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-01-27T09:38:22.315 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-01-27T09:38:22.341 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:22 +0000 (0:00:00.078) 0:00:00.078 ***** 2021-01-27T09:38:22.358 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:22 +0000 (0:00:00.016) 0:00:00.094 ***** 2021-01-27T09:38:24.573 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi078.front.sepia.ceph.com] 2021-01-27T09:38:24.655 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:24 +0000 (0:00:02.296) 0:00:02.391 ***** 2021-01-27T09:38:24.903 INFO:teuthology.task.ansible.out: 2021-01-27T09:38:24.905 INFO:teuthology.task.ansible.out:TASK [ansible-managed : Create the sudo group.] ******************************** ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-27T09:38:24.942 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:24 +0000 (0:00:00.287) 0:00:02.679 ***** 2021-01-27T09:38:25.478 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-01-27T09:38:25.480 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-01-27T09:38:25.515 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:25 +0000 (0:00:00.572) 0:00:03.252 ***** 2021-01-27T09:38:25.686 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi146.front.sepia.ceph.com] 2021-01-27T09:38:25.788 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:25 +0000 (0:00:00.273) 0:00:03.525 ***** 2021-01-27T09:38:25.859 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-01-27T09:38:25.864 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.070322", "end": "2021-01-27 09:38:25.835636", "rc": 0, "start": "2021-01-27 09:38:25.765314", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-01-27T09:38:25.904 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:25 +0000 (0:00:00.115) 0:00:03.640 ***** 2021-01-27T09:38:25.995 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-01-27T09:38:25.996 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-27T09:38:26.041 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:26 +0000 (0:00:00.137) 0:00:03.778 ***** 2021-01-27T09:38:26.164 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-01-27T09:38:26.166 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T09:38:26.203 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:26 +0000 (0:00:00.161) 0:00:03.940 ***** 2021-01-27T09:38:26.456 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-01-27T09:38:26.458 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-01-27T09:38:26.501 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:26 +0000 (0:00:00.297) 0:00:04.238 ***** 2021-01-27T09:38:26.793 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-01-27T09:38:26.795 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.096461", "end": "2021-01-27 09:38:26.957773", "rc": 0, "start": "2021-01-27 09:38:26.861312", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-01-27T09:38:26.839 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:26 +0000 (0:00:00.338) 0:00:04.576 ***** 2021-01-27T09:38:27.035 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-01-27T09:38:27.037 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T09:38:27.081 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:27 +0000 (0:00:00.241) 0:00:04.817 ***** 2021-01-27T09:38:27.087 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-01-27T09:38:27.089 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611740306.2197728-33207864399213/source", "state": "file", "uid": 0} 2021-01-27T09:38:27.136 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:27 +0000 (0:00:00.054) 0:00:04.871 ***** 2021-01-27T09:38:27.559 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-01-27T09:38:27.561 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-01-27T09:38:27.564 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-01-27T09:38:27.848 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-01-27T09:38:27.849 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611740307.094744-140522297222025/source", "state": "file", "uid": 0} 2021-01-27T09:38:27.889 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:27 +0000 (0:00:00.753) 0:00:05.625 ***** 2021-01-27T09:38:28.183 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-01-27T09:38:28.185 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-01-27T09:38:28.187 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-01-27T09:38:28.329 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** 2021-01-27T09:38:28.331 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2021-01-27T09:38:28.341 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-01-27T09:38:28.518 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:28 +0000 (0:00:00.629) 0:00:06.255 ***** 2021-01-27T09:38:28.561 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:28 +0000 (0:00:00.043) 0:00:06.298 ***** 2021-01-27T09:38:29.450 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi078.front.sepia.ceph.com] 2021-01-27T09:38:29.555 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-01-27T09:38:29.557 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:29 +0000 (0:00:00.994) 0:00:07.293 ***** 2021-01-27T09:38:30.096 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi078.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.178411", "end": "2021-01-27 09:38:30.068529", "rc": 0, "start": "2021-01-27 09:38:29.890118", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-01-27T09:38:30.134 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:30 +0000 (0:00:00.577) 0:00:07.870 ***** 2021-01-27T09:38:30.314 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi146.front.sepia.ceph.com] 2021-01-27T09:38:30.416 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:30 +0000 (0:00:00.282) 0:00:08.153 ***** 2021-01-27T09:38:31.012 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-01-27T09:38:31.013 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.240507", "end": "2021-01-27 09:38:30.960410", "rc": 0, "start": "2021-01-27 09:38:30.719903", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-01-27T09:38:31.092 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:31 +0000 (0:00:00.674) 0:00:08.828 ***** 2021-01-27T09:38:31.297 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-01-27T09:38:31.303 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:01.010461", "end": "2021-01-27 09:38:31.262251", "failed_when_result": false, "rc": 0, "start": "2021-01-27 09:38:30.251790", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-01-27T09:38:31.341 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:31 +0000 (0:00:00.249) 0:00:09.078 ***** 2021-01-27T09:38:31.403 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2021-01-27T09:38:31.405 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2021-01-27T09:38:31.438 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:31 +0000 (0:00:00.097) 0:00:09.175 ***** 2021-01-27T09:38:31.445 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-01-27T09:38:31.447 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.028320", "end": "2021-01-27 09:38:31.561625", "failed_when_result": false, "rc": 0, "start": "2021-01-27 09:38:31.533305", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-01-27T09:38:31.489 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:31 +0000 (0:00:00.051) 0:00:09.226 ***** 2021-01-27T09:38:31.496 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2021-01-27T09:38:31.498 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:31.538 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:31 +0000 (0:00:00.048) 0:00:09.275 ***** 2021-01-27T09:38:31.577 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2021-01-27T09:38:31.580 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2021-01-27T09:38:31.632 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:31 +0000 (0:00:00.093) 0:00:09.368 ***** 2021-01-27T09:38:31.639 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2021-01-27T09:38:31.641 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:31.681 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:31 +0000 (0:00:00.050) 0:00:09.418 ***** 2021-01-27T09:38:31.699 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2021-01-27T09:38:31.701 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:31.754 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:31 +0000 (0:00:00.069) 0:00:09.487 ***** 2021-01-27T09:38:31.763 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2021-01-27T09:38:31.765 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:31.803 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:31 +0000 (0:00:00.052) 0:00:09.539 ***** 2021-01-27T09:38:31.813 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2021-01-27T09:38:31.815 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:31.860 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:31 +0000 (0:00:00.057) 0:00:09.597 ***** 2021-01-27T09:38:31.867 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2021-01-27T09:38:31.870 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:31.919 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:31 +0000 (0:00:00.058) 0:00:09.656 ***** 2021-01-27T09:38:31.929 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2021-01-27T09:38:31.931 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:31.983 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:31 +0000 (0:00:00.064) 0:00:09.720 ***** 2021-01-27T09:38:31.990 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-01-27T09:38:31.992 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.036 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:32 +0000 (0:00:00.052) 0:00:09.773 ***** 2021-01-27T09:38:32.046 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2021-01-27T09:38:32.048 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.102 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:32 +0000 (0:00:00.066) 0:00:09.839 ***** 2021-01-27T09:38:32.112 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-01-27T09:38:32.114 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.114 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.115 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ 2021-01-27T09:38:32.117 INFO:teuthology.task.ansible.out:ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.126 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.129 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.139 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.140 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.151 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.153 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.163 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-01-27T09:38:32.165 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.228 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:32 +0000 (0:00:00.126) 0:00:09.965 ***** 2021-01-27T09:38:32.236 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.242 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.257 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "ite 2021-01-27T09:38:32.260 INFO:teuthology.task.ansible.out:m", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9e 2021-01-27T09:38:32.261 INFO:teuthology.task.ansible.out:defafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw ea 2021-01-27T09:38:32.263 INFO:teuthology.task.ansible.out:ddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.270 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.272 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.282 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.284 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.294 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.295 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.305 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.307 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuob 2021-01-27T09:38:32.310 INFO:teuthology.task.ansible.out:kfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.318 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.320 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.330 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.332 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.344 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.353 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.354 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.366 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.368 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.378 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.379 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@e 2021-01-27T09:38:32.381 INFO:teuthology.task.ansible.out:lectric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.392 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAAR 2021-01-27T09:38:32.394 INFO:teuthology.task.ansible.out:Y/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.403 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.405 INFO:teuthology.task.ansible.out: skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.405 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7 2021-01-27T09:38:32.407 INFO:teuthology.task.ansible.out:baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.418 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.419 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item 2021-01-27T09:38:32.421 INFO:teuthology.task.ansible.out:={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.430 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.432 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.443 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.445 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.455 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.457 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.468 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.469 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.479 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.481 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.491 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.493 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.504 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.505 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.515 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.517 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.527 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.529 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.539 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.541 INFO:teuthology.task.ansible.out: 2021-01-27T09:38:32.542 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.547 INFO:teuthology.task.ansible.out: skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.554 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.556 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.577 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.578 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.589 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.591 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.592 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.593 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.604 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.608 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.609 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.619 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.621 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.632 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.635 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.647 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.649 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.660 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.661 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.672 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.674 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.684 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.686 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.696 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.698 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.700 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.711 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.713 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.723 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.725 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.735 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.737 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.747 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.749 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.759 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.760 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.773 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.783 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.785 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.794 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.806 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.817 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.819 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.829 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.830 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.843 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.844 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.845 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.845 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.856 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.868 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.869 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.879 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.891 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.892 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.902 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.904 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.915 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.917 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.927 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.929 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.930 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.930 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@cen 2021-01-27T09:38:32.932 INFO:teuthology.task.ansible.out:tos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.943 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.945 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.955 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.957 INFO:teuthology.task.ansible.out: 2021-01-27T09:38:32.958 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.959 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.970 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.972 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.983 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.984 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.995 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.997 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:32.997 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.008 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.010 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.012 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.012 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.024 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.025 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.036 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.038 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.048 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.050 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.050 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.062 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.073 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.076 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.076 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.087 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.089 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.089 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.100 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.102 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.121 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.127 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.182 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:33 +0000 (0:00:00.954) 0:00:10.919 ***** 2021-01-27T09:38:33.192 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.192 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.200 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.202 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.205 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCY 2021-01-27T09:38:33.207 INFO:teuthology.task.ansible.out:M5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.216 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.218 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.228 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-01-27T09:38:33.230 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.282 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:33 +0000 (0:00:00.099) 0:00:11.019 ***** 2021-01-27T09:38:33.292 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.292 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.294 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.296 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.298 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.300 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.302 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.303 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.305 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.316 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.331 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.332 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.334 INFO:teuthology.task.ansible.out: 2021-01-27T09:38:33.345 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.347 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.357 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.358 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.369 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.371 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.421 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:33 +0000 (0:00:00.139) 0:00:11.158 ***** 2021-01-27T09:38:33.429 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.431 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.433 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.434 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.439 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.507 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:33 +0000 (0:00:00.085) 0:00:11.244 ***** 2021-01-27T09:38:33.514 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-01-27T09:38:33.516 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.556 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:33 +0000 (0:00:00.049) 0:00:11.293 ***** 2021-01-27T09:38:33.574 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-01-27T09:38:33.636 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:33 +0000 (0:00:00.080) 0:00:11.373 ***** 2021-01-27T09:38:33.644 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-01-27T09:38:33.646 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.691 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:33 +0000 (0:00:00.054) 0:00:11.427 ***** 2021-01-27T09:38:33.711 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-01-27T09:38:33.713 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.783 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:33 +0000 (0:00:00.090) 0:00:11.518 ***** 2021-01-27T09:38:33.788 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-01-27T09:38:33.790 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.826 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:33 +0000 (0:00:00.044) 0:00:11.563 ***** 2021-01-27T09:38:33.841 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-01-27T09:38:33.843 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.892 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:33 +0000 (0:00:00.065) 0:00:11.628 ***** 2021-01-27T09:38:33.899 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2021-01-27T09:38:33.900 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:33.940 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:33 +0000 (0:00:00.048) 0:00:11.677 ***** 2021-01-27T09:38:33.957 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-01-27T09:38:33.959 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.016 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:34 +0000 (0:00:00.075) 0:00:11.752 ***** 2021-01-27T09:38:34.022 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-01-27T09:38:34.024 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.025 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.026 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.026 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.027 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.027 INFO:teuthology.task.ansible.out: 2021-01-27T09:38:34.029 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.040 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.046 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.069 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.077 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.079 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.088 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-01-27T09:38:34.090 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi078.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.154 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:34 +0000 (0:00:00.138) 0:00:11.890 ***** 2021-01-27T09:38:34.164 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.168 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.174 INFO:teuthology.task.ansible.out: skipping: [smithi078.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.176 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.188 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.190 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.209 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.213 INFO:teuthology.task.ansible.out: 2021-01-27T09:38:34.215 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.219 INFO:teuthology.task.ansible.out: 2021-01-27T09:38:34.220 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.226 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.229 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi078.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.280 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:34 +0000 (0:00:00.126) 0:00:12.017 ***** 2021-01-27T09:38:34.292 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.294 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.294 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.296 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.297 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.298 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.375 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:34 +0000 (0:00:00.094) 0:00:12.112 ***** 2021-01-27T09:38:34.382 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.384 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.397 INFO:teuthology.task.ansible.out: 2021-01-27T09:38:34.398 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.412 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.428 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.439 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.450 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.465 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.472 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.474 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.483 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.494 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.505 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.516 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.518 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.528 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.530 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.540 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.542 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.551 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.562 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.564 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.574 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.576 INFO:teuthology.task.ansible.out: skipping: [smithi146.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.585 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.587 INFO:teuthology.task.ansible.out: skipping: [smithi146.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.597 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.599 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.609 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.611 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.620 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.622 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.633 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.636 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.645 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.646 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.656 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.658 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.668 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.670 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.679 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:34.729 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:34 +0000 (0:00:00.354) 0:00:12.466 ***** 2021-01-27T09:38:35.079 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-01-27T09:38:35.081 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "e880c991f1562524752e643d227b8575ac6e2ed1", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} 2021-01-27T09:38:35.122 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:35 +0000 (0:00:00.392) 0:00:12.858 ***** 2021-01-27T09:38:35.163 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-01-27T09:38:35.164 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => { "msg": "Host smithi078.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-01-27T09:38:35.206 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:35 +0000 (0:00:00.084) 0:00:12.943 ***** 2021-01-27T09:38:35.265 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-01-27T09:38:35.267 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-01-27T09:38:35.304 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:35 +0000 (0:00:00.098) 0:00:13.041 ***** 2021-01-27T09:38:35.312 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-01-27T09:38:35.313 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "e880c991f1562524752e643d227b8575ac6e2ed1", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} 2021-01-27T09:38:35.359 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:35 +0000 (0:00:00.055) 0:00:13.096 ***** 2021-01-27T09:38:35.367 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-01-27T09:38:35.369 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:35.409 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:35 +0000 (0:00:00.050) 0:00:13.146 ***** 2021-01-27T09:38:35.416 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-01-27T09:38:35.418 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => { "msg": "Host smithi146.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-01-27T09:38:35.460 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:35 +0000 (0:00:00.050) 0:00:13.197 ***** 2021-01-27T09:38:35.468 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:35.508 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:35 +0000 (0:00:00.048) 0:00:13.245 ***** 2021-01-27T09:38:35.515 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-01-27T09:38:35.517 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-01-27T09:38:35.559 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:35 +0000 (0:00:00.051) 0:00:13.296 ***** 2021-01-27T09:38:35.566 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-01-27T09:38:35.567 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:35.609 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:35 +0000 (0:00:00.049) 0:00:13.346 ***** 2021-01-27T09:38:35.617 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:35.663 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:35 +0000 (0:00:00.054) 0:00:13.400 ***** 2021-01-27T09:38:35.670 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-01-27T09:38:35.672 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:35.711 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:35 +0000 (0:00:00.048) 0:00:13.448 ***** 2021-01-27T09:38:35.718 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-01-27T09:38:35.719 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:35.767 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:35 +0000 (0:00:00.055) 0:00:13.503 ***** 2021-01-27T09:38:35.773 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-01-27T09:38:35.775 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:35.816 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:35 +0000 (0:00:00.049) 0:00:13.553 ***** 2021-01-27T09:38:35.823 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-01-27T09:38:35.825 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:35.869 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:35 +0000 (0:00:00.052) 0:00:13.605 ***** 2021-01-27T09:38:35.876 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-01-27T09:38:35.877 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:35.925 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:35 +0000 (0:00:00.056) 0:00:13.662 ***** 2021-01-27T09:38:35.936 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-01-27T09:38:35.937 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:35.991 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:35 +0000 (0:00:00.065) 0:00:13.728 ***** 2021-01-27T09:38:36.002 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-01-27T09:38:36.004 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:36.044 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:36 +0000 (0:00:00.053) 0:00:13.781 ***** 2021-01-27T09:38:36.053 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-01-27T09:38:36.054 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:36.095 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:36 +0000 (0:00:00.050) 0:00:13.832 ***** 2021-01-27T09:38:36.102 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-01-27T09:38:36.103 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:36.146 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:36 +0000 (0:00:00.051) 0:00:13.883 ***** 2021-01-27T09:38:36.154 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-01-27T09:38:36.156 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:36.202 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:36 +0000 (0:00:00.055) 0:00:13.938 ***** 2021-01-27T09:38:36.208 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-01-27T09:38:36.210 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi078.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:38:36.246 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:36 +0000 (0:00:00.044) 0:00:13.983 ***** 2021-01-27T09:38:36.254 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-01-27T09:38:36.256 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:36.301 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:36 +0000 (0:00:00.055) 0:00:14.038 ***** 2021-01-27T09:38:36.310 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-01-27T09:38:36.312 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:36.357 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:36 +0000 (0:00:00.055) 0:00:14.094 ***** 2021-01-27T09:38:36.367 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:36.416 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:36 +0000 (0:00:00.058) 0:00:14.153 ***** 2021-01-27T09:38:36.422 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-01-27T09:38:36.424 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:36.477 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:36 +0000 (0:00:00.061) 0:00:14.214 ***** 2021-01-27T09:38:36.485 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-01-27T09:38:36.487 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi146.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:38:36.531 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:36 +0000 (0:00:00.053) 0:00:14.268 ***** 2021-01-27T09:38:36.538 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-01-27T09:38:36.539 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:38:36.541 INFO:teuthology.task.ansible.out: 2021-01-27T09:38:36.577 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:36 +0000 (0:00:00.046) 0:00:14.314 ***** 2021-01-27T09:38:36.584 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-01-27T09:38:36.586 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:36.630 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:36 +0000 (0:00:00.052) 0:00:14.367 ***** 2021-01-27T09:38:36.636 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-01-27T09:38:36.638 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:36.678 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:36 +0000 (0:00:00.047) 0:00:14.414 ***** 2021-01-27T09:38:36.686 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-01-27T09:38:36.688 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:36.733 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:36 +0000 (0:00:00.055) 0:00:14.470 ***** 2021-01-27T09:38:36.741 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi078.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:38:36.781 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:36 +0000 (0:00:00.047) 0:00:14.517 ***** 2021-01-27T09:38:36.792 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi146.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:38:36.836 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:36 +0000 (0:00:00.054) 0:00:14.572 ***** 2021-01-27T09:38:36.842 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-01-27T09:38:36.844 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:36.880 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:36 +0000 (0:00:00.044) 0:00:14.617 ***** 2021-01-27T09:38:36.889 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-01-27T09:38:36.891 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:36.935 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:36 +0000 (0:00:00.054) 0:00:14.671 ***** 2021-01-27T09:38:36.941 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-01-27T09:38:36.943 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:36.986 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:36 +0000 (0:00:00.050) 0:00:14.722 ***** 2021-01-27T09:38:36.994 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-01-27T09:38:36.996 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:38:37.038 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:37 +0000 (0:00:00.052) 0:00:14.775 ***** 2021-01-27T09:38:37.045 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-01-27T09:38:37.047 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:37.094 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:37 +0000 (0:00:00.056) 0:00:14.831 ***** 2021-01-27T09:38:37.105 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-01-27T09:38:37.107 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:37.153 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:37 +0000 (0:00:00.058) 0:00:14.890 ***** 2021-01-27T09:38:37.160 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-01-27T09:38:37.162 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:37.200 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:37 +0000 (0:00:00.046) 0:00:14.937 ***** 2021-01-27T09:38:37.209 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-01-27T09:38:37.210 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:37.258 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:37 +0000 (0:00:00.058) 0:00:14.995 ***** 2021-01-27T09:38:37.266 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-01-27T09:38:37.268 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:38:37.311 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:37 +0000 (0:00:00.049) 0:00:15.044 ***** 2021-01-27T09:38:37.316 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-01-27T09:38:37.318 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:37.359 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:37 +0000 (0:00:00.051) 0:00:15.095 ***** 2021-01-27T09:38:37.365 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-01-27T09:38:37.367 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:37.404 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:37 +0000 (0:00:00.045) 0:00:15.141 ***** 2021-01-27T09:38:37.411 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-01-27T09:38:37.413 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:37.453 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:37 +0000 (0:00:00.049) 0:00:15.190 ***** 2021-01-27T09:38:37.460 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-01-27T09:38:37.462 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:37.497 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:37 +0000 (0:00:00.043) 0:00:15.233 ***** 2021-01-27T09:38:37.505 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-01-27T09:38:37.507 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:38:37.554 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:37 +0000 (0:00:00.057) 0:00:15.291 ***** 2021-01-27T09:38:37.562 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-01-27T09:38:37.564 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:37.603 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:37 +0000 (0:00:00.049) 0:00:15.340 ***** 2021-01-27T09:38:37.612 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-01-27T09:38:37.614 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:37.659 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:37 +0000 (0:00:00.055) 0:00:15.396 ***** 2021-01-27T09:38:37.666 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-01-27T09:38:37.668 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:37.708 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:37 +0000 (0:00:00.048) 0:00:15.445 ***** 2021-01-27T09:38:37.718 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:37.790 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:37 +0000 (0:00:00.081) 0:00:15.526 ***** 2021-01-27T09:38:37.803 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-01-27T09:38:37.805 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:37.843 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:37 +0000 (0:00:00.053) 0:00:15.580 ***** 2021-01-27T09:38:37.851 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-01-27T09:38:37.853 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:37.901 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:37 +0000 (0:00:00.058) 0:00:15.638 ***** 2021-01-27T09:38:37.909 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-01-27T09:38:37.911 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:37.947 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:37 +0000 (0:00:00.046) 0:00:15.684 ***** 2021-01-27T09:38:37.957 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-01-27T09:38:37.959 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:38.009 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:38 +0000 (0:00:00.061) 0:00:15.746 ***** 2021-01-27T09:38:38.016 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi078.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:38:38.060 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:38 +0000 (0:00:00.049) 0:00:15.796 ***** 2021-01-27T09:38:38.084 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:38.124 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:38 +0000 (0:00:00.064) 0:00:15.860 ***** 2021-01-27T09:38:38.131 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-01-27T09:38:38.133 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:38.178 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:38 +0000 (0:00:00.053) 0:00:15.914 ***** 2021-01-27T09:38:38.188 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-01-27T09:38:38.189 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:38.235 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:38 +0000 (0:00:00.057) 0:00:15.972 ***** 2021-01-27T09:38:38.243 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-01-27T09:38:38.245 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:38.284 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:38 +0000 (0:00:00.049) 0:00:16.021 ***** 2021-01-27T09:38:38.292 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-01-27T09:38:38.294 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:38:38.338 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:38 +0000 (0:00:00.053) 0:00:16.074 ***** 2021-01-27T09:38:38.345 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:38.383 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:38 +0000 (0:00:00.045) 0:00:16.120 ***** 2021-01-27T09:38:38.393 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:38.450 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:38 +0000 (0:00:00.066) 0:00:16.187 ***** 2021-01-27T09:38:38.459 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-01-27T09:38:38.460 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:38.464 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:38.507 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:38 +0000 (0:00:00.057) 0:00:16.244 ***** 2021-01-27T09:38:38.520 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-01-27T09:38:38.522 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:38.581 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:38 +0000 (0:00:00.073) 0:00:16.317 ***** 2021-01-27T09:38:38.587 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-01-27T09:38:38.589 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:38.640 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:38 +0000 (0:00:00.058) 0:00:16.375 ***** 2021-01-27T09:38:38.648 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-01-27T09:38:38.650 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:38.705 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:38 +0000 (0:00:00.065) 0:00:16.441 ***** 2021-01-27T09:38:38.712 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-01-27T09:38:38.714 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:38.755 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:38 +0000 (0:00:00.050) 0:00:16.492 ***** 2021-01-27T09:38:38.778 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:38.817 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:38 +0000 (0:00:00.061) 0:00:16.554 ***** 2021-01-27T09:38:38.866 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-01-27T09:38:38.867 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:38.910 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:38 +0000 (0:00:00.093) 0:00:16.647 ***** 2021-01-27T09:38:38.911 INFO:teuthology.task.ansible.out: 2021-01-27T09:38:38.931 INFO:teuthology.task.ansible.out: 2021-01-27T09:38:38.932 INFO:teuthology.task.ansible.out:TASK [common : Get the current timezone] *************************************** ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.015993", "end": "2021-01-27 09:38:38.897401", "rc": 0, "start": "2021-01-27 09:38:38.881408", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-01-27T09:38:39.005 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:39 +0000 (0:00:00.094) 0:00:16.742 ***** 2021-01-27T09:38:39.012 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-01-27T09:38:39.014 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:39.063 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:39 +0000 (0:00:00.057) 0:00:16.800 ***** 2021-01-27T09:38:39.070 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-01-27T09:38:39.071 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:39.111 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:39 +0000 (0:00:00.048) 0:00:16.848 ***** 2021-01-27T09:38:39.150 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-01-27T09:38:39.152 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:39.188 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:39 +0000 (0:00:00.076) 0:00:16.924 ***** 2021-01-27T09:38:39.214 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-01-27T09:38:39.216 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:39.253 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:39 +0000 (0:00:00.065) 0:00:16.989 ***** 2021-01-27T09:38:39.282 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-01-27T09:38:39.284 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:39.321 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:39 +0000 (0:00:00.068) 0:00:17.058 ***** 2021-01-27T09:38:39.330 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-01-27T09:38:39.331 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.032434", "end": "2021-01-27 09:38:39.457939", "rc": 0, "start": "2021-01-27 09:38:39.425505", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-01-27T09:38:39.381 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:39 +0000 (0:00:00.059) 0:00:17.117 ***** 2021-01-27T09:38:39.387 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-01-27T09:38:39.389 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:39.425 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:39 +0000 (0:00:00.044) 0:00:17.162 ***** 2021-01-27T09:38:39.431 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-01-27T09:38:39.436 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:39.475 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:39 +0000 (0:00:00.049) 0:00:17.211 ***** 2021-01-27T09:38:39.481 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-01-27T09:38:39.483 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:39.520 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:39 +0000 (0:00:00.045) 0:00:17.257 ***** 2021-01-27T09:38:39.528 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:39.576 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:39 +0000 (0:00:00.055) 0:00:17.313 ***** 2021-01-27T09:38:39.582 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-01-27T09:38:39.584 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:39.625 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:39 +0000 (0:00:00.048) 0:00:17.361 ***** 2021-01-27T09:38:39.634 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:39.705 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:39 +0000 (0:00:00.080) 0:00:17.441 ***** 2021-01-27T09:38:39.771 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:39.830 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:39 +0000 (0:00:00.125) 0:00:17.566 ***** 2021-01-27T09:38:39.857 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-01-27T09:38:39.858 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:39.900 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:39 +0000 (0:00:00.070) 0:00:17.637 ***** 2021-01-27T09:38:39.939 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-01-27T09:38:39.941 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:39.984 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:39 +0000 (0:00:00.083) 0:00:17.721 ***** 2021-01-27T09:38:40.035 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:40.084 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:40 +0000 (0:00:00.100) 0:00:17.821 ***** 2021-01-27T09:38:40.344 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-01-27T09:38:40.346 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.074197", "end": "2021-01-27 09:38:40.501258", "rc": 0, "start": "2021-01-27 09:38:40.427061", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:38:40.391 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:40 +0000 (0:00:00.306) 0:00:18.128 ***** 2021-01-27T09:38:40.419 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-01-27T09:38:40.421 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:40.467 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:40 +0000 (0:00:00.073) 0:00:18.202 ***** 2021-01-27T09:38:40.527 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-01-27T09:38:40.529 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.711224", "end": "2021-01-27 09:38:40.500448", "rc": 0, "start": "2021-01-27 09:38:39.789224", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:38:40.573 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:40 +0000 (0:00:00.107) 0:00:18.309 ***** 2021-01-27T09:38:40.602 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:40.641 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:40 +0000 (0:00:00.069) 0:00:18.378 ***** 2021-01-27T09:38:40.874 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-01-27T09:38:40.876 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.204338", "end": "2021-01-27 09:38:41.037706", "rc": 0, "start": "2021-01-27 09:38:40.833368", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:38:40.919 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:40 +0000 (0:00:00.276) 0:00:18.655 ***** 2021-01-27T09:38:40.936 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.144891", "end": "2021-01-27 09:38:40.899880", "rc": 0, "start": "2021-01-27 09:38:40.754989", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:38:40.973 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:40 +0000 (0:00:00.055) 0:00:18.710 ***** 2021-01-27T09:38:48.370 INFO:teuthology.task.ansible.out: 2021-01-27T09:38:48.372 INFO:teuthology.task.ansible.out:TASK [common : Update apt cache] *********************************************** 2021-01-27T09:38:48.373 INFO:teuthology.task.ansible.out: changed: [smithi078.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1611740324, "cache_updated": true, "changed": true} 2021-01-27T09:38:48.415 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:48 +0000 (0:00:07.441) 0:00:26.152 ***** 2021-01-27T09:38:49.058 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-01-27T09:38:49.059 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"cache_update_time": 1611740324, "cache_updated": false, "changed": false} 2021-01-27T09:38:49.099 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:49 +0000 (0:00:00.684) 0:00:26.836 ***** 2021-01-27T09:38:49.149 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:49.192 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:49 +0000 (0:00:00.092) 0:00:26.928 ***** 2021-01-27T09:38:49.640 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-01-27T09:38:49.642 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-01-27T09:38:49.691 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:49 +0000 (0:00:00.499) 0:00:27.428 ***** 2021-01-27T09:38:49.861 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-01-27T09:38:49.863 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1611740325, "cache_updated": true, "changed": true} 2021-01-27T09:38:49.935 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:49 +0000 (0:00:00.243) 0:00:27.671 ***** 2021-01-27T09:38:50.367 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-01-27T09:38:50.370 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"cache_update_time": 1611740324, "cache_updated": false, "changed": false} 2021-01-27T09:38:50.406 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:50 +0000 (0:00:00.471) 0:00:28.143 ***** 2021-01-27T09:38:50.781 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi078.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-01-27T09:38:50.857 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** ok: [smithi146.front.sepia.ceph.com] => {"cache_update_time": 1611740325, "cache_updated": false, "changed": false} 2021-01-27T09:38:50.901 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:50 +0000 (0:00:00.495) 0:00:28.638 ***** 2021-01-27T09:38:50.929 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-01-27T09:38:50.931 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:50.973 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:50 +0000 (0:00:00.071) 0:00:28.710 ***** 2021-01-27T09:38:51.108 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-01-27T09:38:51.110 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-01-27T09:38:51.492 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-01-27T09:38:51.546 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:51 +0000 (0:00:00.572) 0:00:29.283 ***** 2021-01-27T09:38:51.598 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-01-27T09:38:51.600 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-01-27T09:38:51.649 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:51 +0000 (0:00:00.102) 0:00:29.385 ***** 2021-01-27T09:38:51.688 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T09:38:51.733 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:51 +0000 (0:00:00.084) 0:00:29.470 ***** 2021-01-27T09:38:52.311 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-27T09:38:52.313 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-01-27T09:38:52.508 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-01-27T09:38:52.510 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"cache_update_time": 1611740325, "cache_updated": false, "changed": false} 2021-01-27T09:38:52.548 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:52 +0000 (0:00:00.815) 0:00:30.285 ***** 2021-01-27T09:38:52.565 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-27T09:38:52.567 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-01-27T09:38:52.850 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-01-27T09:38:52.892 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:52 +0000 (0:00:00.343) 0:00:30.629 ***** 2021-01-27T09:38:52.943 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-01-27T09:38:52.945 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-01-27T09:38:52.987 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:52 +0000 (0:00:00.094) 0:00:30.723 ***** 2021-01-27T09:38:53.015 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-01-27T09:38:53.017 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:53.055 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:53 +0000 (0:00:00.067) 0:00:30.791 ***** 2021-01-27T09:38:53.095 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-01-27T09:38:53.097 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} TASK [common : Check for epel] ************************************************* skipping: [smithi078.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:38:53.132 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:53 +0000 (0:00:00.077) 0:00:30.869 ***** 2021-01-27T09:38:53.180 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-01-27T09:38:53.182 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:53.201 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:53.203 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:53.214 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:53.252 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:53 +0000 (0:00:00.119) 0:00:30.988 ***** 2021-01-27T09:38:53.279 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-01-27T09:38:53.281 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:53.317 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:53 +0000 (0:00:00.064) 0:00:31.053 ***** 2021-01-27T09:38:53.629 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-01-27T09:38:53.631 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-01-27T09:38:53.990 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-01-27T09:38:53.992 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"cache_update_time": 1611740324, "cache_updated": false, "changed": false} 2021-01-27T09:38:54.031 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:54 +0000 (0:00:00.713) 0:00:31.767 ***** 2021-01-27T09:38:54.111 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-01-27T09:38:54.113 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-01-27T09:38:54.158 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:54 +0000 (0:00:00.126) 0:00:31.894 ***** 2021-01-27T09:38:54.334 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-01-27T09:38:54.336 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T09:38:54.384 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:54 +0000 (0:00:00.226) 0:00:32.121 ***** 2021-01-27T09:38:54.392 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-01-27T09:38:54.393 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-01-27T09:38:54.439 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:54 +0000 (0:00:00.054) 0:00:32.175 ***** 2021-01-27T09:38:54.784 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-01-27T09:38:54.786 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-01-27T09:38:54.822 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:54 +0000 (0:00:00.383) 0:00:32.559 ***** 2021-01-27T09:38:54.910 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-27T09:38:54.912 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-01-27T09:38:54.975 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-01-27T09:38:54.977 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-01-27T09:38:55.083 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-01-27T09:38:55.121 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:55 +0000 (0:00:00.298) 0:00:32.857 ***** 2021-01-27T09:38:55.148 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-01-27T09:38:55.150 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:55.188 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:55 +0000 (0:00:00.067) 0:00:32.925 ***** 2021-01-27T09:38:55.227 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** skipping: [smithi078.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:38:55.272 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:55 +0000 (0:00:00.083) 0:00:33.008 ***** 2021-01-27T09:38:55.310 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-01-27T09:38:55.313 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:55.352 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:55 +0000 (0:00:00.076) 0:00:33.085 ***** 2021-01-27T09:38:55.383 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-27T09:38:55.385 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-01-27T09:38:55.704 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-01-27T09:38:55.750 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:55 +0000 (0:00:00.401) 0:00:33.487 ***** 2021-01-27T09:38:55.869 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-27T09:38:55.871 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-01-27T09:38:55.924 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:55 +0000 (0:00:00.171) 0:00:33.658 ***** 2021-01-27T09:38:56.011 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-01-27T09:38:56.012 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-01-27T09:38:56.056 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:56 +0000 (0:00:00.133) 0:00:33.792 ***** 2021-01-27T09:38:56.083 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-01-27T09:38:56.085 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:56.129 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:56 +0000 (0:00:00.073) 0:00:33.866 ***** 2021-01-27T09:38:56.171 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* skipping: [smithi146.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:38:56.216 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:56 +0000 (0:00:00.086) 0:00:33.952 ***** 2021-01-27T09:38:56.275 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-01-27T09:38:56.277 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:56.286 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:56.297 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:56.309 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T09:38:56.361 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:56 +0000 (0:00:00.145) 0:00:34.098 ***** 2021-01-27T09:38:56.368 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-01-27T09:38:56.370 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 09:34:20 UTC", "ActiveEnterTimestampMonotonic": "16501126", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket system.slice var-run.mount time-sync.target -.mount local-fs.target network.target remote-fs.target basic.target sysinit.target nss-lookup.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 09:34:20 UTC", "AssertTimestampMonotonic": "16495713", "Before": "multi-user.target shutdown.target xdm.service getty@tty1.service plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 09:34:20 UTC", "Co 2021-01-27T09:38:56.372 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "16495713", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1297", "ExecMainStartTimestamp": "Wed 2021-01-27 09:34:20 UTC", "ExecMainStartTimestampMonotonic": "16500968", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes" 2021-01-27T09:38:56.375 INFO:teuthology.task.ansible.out:, "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 09:34:20 UTC", "InactiveExitTimestampMonotonic": "16501126", "InvocationID": "b9357beee78149cbbd2f36f1bccd16cb", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127780", "LimitNPROCSoft": "127780", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127780", "LimitSIGPENDINGSoft": "127780", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1297", "MemoryAccounting": "yes", "MemoryCurrent": "954368", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", " 2021-01-27T09:38:56.377 INFO:teuthology.task.ansible.out:MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 09:34:20 UTC", "StateChangeTimestampMonotonic": "16501126", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", " 2021-01-27T09:38:56.379 INFO:teuthology.task.ansible.out:SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38334", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T09:38:56.411 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:56 +0000 (0:00:00.050) 0:00:34.148 ***** 2021-01-27T09:38:56.419 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-01-27T09:38:56.420 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:56.467 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:56 +0000 (0:00:00.054) 0:00:34.203 ***** 2021-01-27T09:38:56.472 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-01-27T09:38:56.474 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:56.515 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:56 +0000 (0:00:00.049) 0:00:34.252 ***** 2021-01-27T09:38:56.553 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:56.590 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:56 +0000 (0:00:00.074) 0:00:34.327 ***** 2021-01-27T09:38:56.651 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-01-27T09:38:56.653 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:56.738 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:56 +0000 (0:00:00.147) 0:00:34.474 ***** 2021-01-27T09:38:56.792 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:56.877 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:56 +0000 (0:00:00.139) 0:00:34.614 ***** 2021-01-27T09:38:56.952 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-01-27T09:38:56.954 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:57.034 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:57 +0000 (0:00:00.156) 0:00:34.770 ***** 2021-01-27T09:38:57.093 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-01-27T09:38:57.095 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:57.140 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:57 +0000 (0:00:00.106) 0:00:34.877 ***** 2021-01-27T09:38:57.192 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:57.252 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:57 +0000 (0:00:00.108) 0:00:34.986 ***** 2021-01-27T09:38:57.311 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-01-27T09:38:57.313 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:57.393 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:57 +0000 (0:00:00.143) 0:00:35.129 ***** 2021-01-27T09:38:57.404 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-01-27T09:38:57.406 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"cache_update_time": 1611740325, "cache_updated": false, "changed": false} 2021-01-27T09:38:57.493 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:57 +0000 (0:00:00.100) 0:00:35.230 ***** 2021-01-27T09:38:57.503 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-01-27T09:38:57.505 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:57.554 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:57 +0000 (0:00:00.060) 0:00:35.291 ***** 2021-01-27T09:38:57.605 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-01-27T09:38:57.606 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:57.649 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:57 +0000 (0:00:00.094) 0:00:35.385 ***** 2021-01-27T09:38:57.694 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-01-27T09:38:57.696 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-01-27T09:38:57.736 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:57 +0000 (0:00:00.086) 0:00:35.472 ***** 2021-01-27T09:38:57.785 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-01-27T09:38:57.787 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-01-27T09:38:57.827 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:57 +0000 (0:00:00.091) 0:00:35.564 ***** 2021-01-27T09:38:57.876 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-01-27T09:38:57.878 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-01-27T09:38:57.916 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:57 +0000 (0:00:00.088) 0:00:35.653 ***** 2021-01-27T09:38:57.976 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi078.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-01-27T09:38:58.021 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:58 +0000 (0:00:00.104) 0:00:35.758 ***** 2021-01-27T09:38:58.136 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-01-27T09:38:58.138 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-01-27T09:38:58.183 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:58 +0000 (0:00:00.162) 0:00:35.920 ***** 2021-01-27T09:38:58.191 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-01-27T09:38:58.193 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-27T09:38:58.238 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:58 +0000 (0:00:00.053) 0:00:35.974 ***** 2021-01-27T09:38:58.405 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-01-27T09:38:58.407 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-01-27T09:38:58.460 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:58 +0000 (0:00:00.222) 0:00:36.196 ***** 2021-01-27T09:38:58.516 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-01-27T09:38:58.518 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:58.553 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:58 +0000 (0:00:00.092) 0:00:36.289 ***** 2021-01-27T09:38:58.590 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-01-27T09:38:58.592 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:58.630 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:58 +0000 (0:00:00.077) 0:00:36.367 ***** 2021-01-27T09:38:58.743 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-01-27T09:38:58.745 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-01-27T09:38:58.787 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:58 +0000 (0:00:00.156) 0:00:36.523 ***** 2021-01-27T09:38:58.804 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-01-27T09:38:58.806 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-01-27T09:38:58.843 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:58 +0000 (0:00:00.056) 0:00:36.580 ***** 2021-01-27T09:38:58.989 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-01-27T09:38:58.990 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-01-27T09:38:59.149 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-01-27T09:38:59.195 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:59 +0000 (0:00:00.352) 0:00:36.932 ***** 2021-01-27T09:38:59.234 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-01-27T09:38:59.236 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:59.282 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:59 +0000 (0:00:00.087) 0:00:37.019 ***** 2021-01-27T09:38:59.290 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-01-27T09:38:59.292 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-01-27T09:38:59.334 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:59 +0000 (0:00:00.051) 0:00:37.071 ***** 2021-01-27T09:38:59.341 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-01-27T09:38:59.343 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T09:38:59.388 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:59 +0000 (0:00:00.053) 0:00:37.124 ***** 2021-01-27T09:38:59.397 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-01-27T09:38:59.399 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi078"}, "changed": false} 2021-01-27T09:38:59.439 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:59 +0000 (0:00:00.051) 0:00:37.176 ***** 2021-01-27T09:38:59.446 INFO:teuthology.task.ansible.out: 2021-01-27T09:38:59.448 INFO:teuthology.task.ansible.out:TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:38:59.492 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:38:59 +0000 (0:00:00.052) 0:00:37.229 ***** 2021-01-27T09:39:00.002 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-01-27T09:39:00.004 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-01-27T09:39:00.049 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:00 +0000 (0:00:00.557) 0:00:37.786 ***** 2021-01-27T09:39:00.266 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-01-27T09:39:00.268 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi078", "ansible_hostname": "smithi078", "ansible_nodename": "smithi078"}, "changed": false, "name": "smithi078"} 2021-01-27T09:39:00.306 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:00 +0000 (0:00:00.256) 0:00:38.042 ***** 2021-01-27T09:39:00.355 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-01-27T09:39:00.356 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 09:37:47 UTC", "ActiveEnterTimestampMonotonic": "16011021", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice systemd-journald.socket basic.target systemd-tmpfiles-setup.service var-run.mount network.target local-fs.target remote-fs.target time-sync.target -.mount sysinit.target nss-lookup.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 09:37:47 UTC", "AssertTimestampMonotonic": "15998086", "Before": "xdm.service multi-user.target plymouth-quit.service getty@tty1.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read 0x26 0x27 0x28", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 09: 2021-01-27T09:39:00.358 INFO:teuthology.task.ansible.out:37:47 UTC", "ConditionTimestampMonotonic": "15998086", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "864", "ExecMainStartTimestamp": "Wed 2021-01-27 09:37:47 UTC", "ExecMainStartTimestampMonotonic": "16010754", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Wed 2021-01-27 09:37:47 UTC] ; stop_time=[n/a] ; pid=864 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Wed 2021-01-27 09:37:47 UTC] ; stop_time=[n/a] ; pid=864 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-serve 2021-01-27T09:39:00.360 INFO:teuthology.task.ansible.out:r.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 09:37:47 UTC", "InactiveExitTimestampMonotonic": "16011021", "InvocationID": "ff185d94712f4b2ba62ac6e06687d4af", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127767", "LimitNPROCSoft": "127767", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127767", "LimitSIGPENDINGSoft": "127767", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "864", "MemoryAccounting": "yes", "MemoryCurrent": "663 2021-01-27T09:39:00.361 INFO:teuthology.task.ansible.out:552", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 09:37:47 UTC", "StateChangeTimestampMonotonic": "16011021", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenU 2021-01-27T09:39:00.363 INFO:teuthology.task.ansible.out:nneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "38330", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T09:39:00.408 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:00 +0000 (0:00:00.102) 0:00:38.144 ***** 2021-01-27T09:39:00.438 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-01-27T09:39:00.439 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:00.479 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:00 +0000 (0:00:00.071) 0:00:38.216 ***** 2021-01-27T09:39:00.505 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-01-27T09:39:00.507 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:00.547 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:00 +0000 (0:00:00.068) 0:00:38.284 ***** 2021-01-27T09:39:00.583 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-01-27T09:39:00.585 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:00.624 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:00 +0000 (0:00:00.076) 0:00:38.361 ***** 2021-01-27T09:39:00.641 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-01-27T09:39:00.643 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-01-27T09:39:00.680 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:00 +0000 (0:00:00.055) 0:00:38.417 ***** 2021-01-27T09:39:00.687 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-01-27T09:39:00.689 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:00.737 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:00 +0000 (0:00:00.057) 0:00:38.474 ***** 2021-01-27T09:39:00.765 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:00.806 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:00 +0000 (0:00:00.068) 0:00:38.543 ***** 2021-01-27T09:39:00.833 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-01-27T09:39:00.835 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:00.875 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:00 +0000 (0:00:00.068) 0:00:38.612 ***** 2021-01-27T09:39:00.912 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-01-27T09:39:00.914 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:00.958 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:00 +0000 (0:00:00.083) 0:00:38.695 ***** 2021-01-27T09:39:00.987 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:01.031 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:01 +0000 (0:00:00.072) 0:00:38.768 ***** 2021-01-27T09:39:01.038 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-01-27T09:39:01.040 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-01-27T09:39:01.083 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:01 +0000 (0:00:00.051) 0:00:38.820 ***** 2021-01-27T09:39:01.090 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:01.136 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:01 +0000 (0:00:00.052) 0:00:38.873 ***** 2021-01-27T09:39:01.164 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-01-27T09:39:01.165 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:01.212 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:01 +0000 (0:00:00.076) 0:00:38.949 ***** 2021-01-27T09:39:01.241 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-01-27T09:39:01.243 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-01-27T09:39:01.285 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:01 +0000 (0:00:00.073) 0:00:39.022 ***** 2021-01-27T09:39:01.322 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-01-27T09:39:01.324 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-01-27T09:39:01.373 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:01 +0000 (0:00:00.088) 0:00:39.110 ***** 2021-01-27T09:39:01.412 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-01-27T09:39:01.414 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-01-27T09:39:01.466 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:01 +0000 (0:00:00.090) 0:00:39.201 ***** 2021-01-27T09:39:01.514 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi146.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-01-27T09:39:01.515 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:01.560 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:01 +0000 (0:00:00.096) 0:00:39.297 ***** 2021-01-27T09:39:01.704 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-01-27T09:39:01.706 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-01-27T09:39:01.745 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:01 +0000 (0:00:00.185) 0:00:39.482 ***** 2021-01-27T09:39:01.747 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:01.755 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-01-27T09:39:01.757 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-27T09:39:01.804 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:01 +0000 (0:00:00.058) 0:00:39.541 ***** 2021-01-27T09:39:01.811 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-01-27T09:39:01.813 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:01.858 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:01 +0000 (0:00:00.053) 0:00:39.595 ***** 2021-01-27T09:39:01.887 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-27T09:39:01.889 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:01.926 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:01 +0000 (0:00:00.067) 0:00:39.663 ***** 2021-01-27T09:39:01.953 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-01-27T09:39:01.955 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:01.995 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:01 +0000 (0:00:00.069) 0:00:39.732 ***** 2021-01-27T09:39:02.012 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-01-27T09:39:02.013 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-01-27T09:39:02.062 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:02 +0000 (0:00:00.067) 0:00:39.799 ***** 2021-01-27T09:39:02.070 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-27T09:39:02.071 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:02.116 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:02 +0000 (0:00:00.052) 0:00:39.852 ***** 2021-01-27T09:39:02.128 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-01-27T09:39:02.130 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:02.175 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:02 +0000 (0:00:00.059) 0:00:39.912 ***** 2021-01-27T09:39:02.186 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:02.229 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:02 +0000 (0:00:00.053) 0:00:39.966 ***** 2021-01-27T09:39:02.236 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-01-27T09:39:02.238 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:02.288 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:02 +0000 (0:00:00.058) 0:00:40.024 ***** 2021-01-27T09:39:02.295 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-01-27T09:39:02.297 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:02.340 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:02 +0000 (0:00:00.051) 0:00:40.076 ***** 2021-01-27T09:39:02.379 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-27T09:39:02.380 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:02.420 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:02 +0000 (0:00:00.079) 0:00:40.156 ***** 2021-01-27T09:39:02.463 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-01-27T09:39:02.465 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:02.503 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:02 +0000 (0:00:00.082) 0:00:40.239 ***** 2021-01-27T09:39:02.530 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-01-27T09:39:02.532 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi146.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-01-27T09:39:02.567 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:02 +0000 (0:00:00.064) 0:00:40.304 ***** 2021-01-27T09:39:02.607 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:02 +0000 (0:00:00.039) 0:00:40.344 ***** 2021-01-27T09:39:02.614 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-01-27T09:39:02.654 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:02 +0000 (0:00:00.046) 0:00:40.390 ***** 2021-01-27T09:39:02.682 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-01-27T09:39:02.721 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:02 +0000 (0:00:00.067) 0:00:40.458 ***** 2021-01-27T09:39:02.749 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:02.751 INFO:teuthology.task.ansible.out:TASK [testnode : Install GPG] ************************************************** 2021-01-27T09:39:02.752 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:02.792 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:02 +0000 (0:00:00.070) 0:00:40.529 ***** 2021-01-27T09:39:02.843 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-01-27T09:39:02.845 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:02.885 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:02 +0000 (0:00:00.093) 0:00:40.622 ***** 2021-01-27T09:39:02.924 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-01-27T09:39:02.925 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:02.968 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:02 +0000 (0:00:00.083) 0:00:40.705 ***** 2021-01-27T09:39:02.997 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:39:02.999 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:03.039 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:03 +0000 (0:00:00.070) 0:00:40.775 ***** 2021-01-27T09:39:03.067 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-01-27T09:39:03.069 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:03.110 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:03 +0000 (0:00:00.071) 0:00:40.847 ***** 2021-01-27T09:39:03.156 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:03.200 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:03 +0000 (0:00:00.090) 0:00:40.937 ***** 2021-01-27T09:39:03.208 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:03.209 INFO:teuthology.task.ansible.out:TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-01-27T09:39:03.300 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:03 +0000 (0:00:00.099) 0:00:41.036 ***** 2021-01-27T09:39:03.310 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-01-27T09:39:03.311 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:03.358 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:03 +0000 (0:00:00.057) 0:00:41.094 ***** 2021-01-27T09:39:03.370 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-01-27T09:39:03.371 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi146"}, "changed": false} 2021-01-27T09:39:03.418 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:03 +0000 (0:00:00.060) 0:00:41.155 ***** 2021-01-27T09:39:03.425 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-01-27T09:39:03.427 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:03.488 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:03 +0000 (0:00:00.069) 0:00:41.225 ***** 2021-01-27T09:39:03.539 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-27T09:39:03.541 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:03.575 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:03 +0000 (0:00:00.086) 0:00:41.312 ***** 2021-01-27T09:39:03.605 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-27T09:39:03.607 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:03.650 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:03 +0000 (0:00:00.074) 0:00:41.386 ***** 2021-01-27T09:39:03.678 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-27T09:39:03.680 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:03.731 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:03 +0000 (0:00:00.080) 0:00:41.467 ***** 2021-01-27T09:39:03.784 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-01-27T09:39:03.786 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:03.828 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:03 +0000 (0:00:00.098) 0:00:41.565 ***** 2021-01-27T09:39:03.867 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-27T09:39:03.869 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:03.923 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:03 +0000 (0:00:00.093) 0:00:41.659 ***** 2021-01-27T09:39:03.952 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-27T09:39:03.954 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:03.990 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:03 +0000 (0:00:00.067) 0:00:41.726 ***** 2021-01-27T09:39:04.023 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-01-27T09:39:04.025 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:04.071 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:04 +0000 (0:00:00.081) 0:00:41.807 ***** 2021-01-27T09:39:04.080 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-01-27T09:39:04.082 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi146.front.sepia.ceph.com", "ansible_hostname": "smithi146", "ansible_nodename": "smithi146"}, "changed": true, "name": "smithi146"} 2021-01-27T09:39:04.133 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:04 +0000 (0:00:00.059) 0:00:41.867 ***** 2021-01-27T09:39:04.139 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:04.190 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:04 +0000 (0:00:00.060) 0:00:41.927 ***** 2021-01-27T09:39:04.242 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:04.283 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:04 +0000 (0:00:00.092) 0:00:42.020 ***** 2021-01-27T09:39:04.321 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:04.366 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:04 +0000 (0:00:00.083) 0:00:42.103 ***** 2021-01-27T09:39:04.408 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:04.452 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:04 +0000 (0:00:00.085) 0:00:42.189 ***** 2021-01-27T09:39:04.495 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:04.497 INFO:teuthology.task.ansible.out:TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:04.537 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:04 +0000 (0:00:00.084) 0:00:42.273 ***** 2021-01-27T09:39:04.576 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:04.624 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:04 +0000 (0:00:00.086) 0:00:42.360 ***** 2021-01-27T09:39:04.654 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-01-27T09:39:04.655 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:04.700 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:04 +0000 (0:00:00.076) 0:00:42.437 ***** 2021-01-27T09:39:04.710 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-01-27T09:39:04.711 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-01-27T09:39:04.759 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:04 +0000 (0:00:00.058) 0:00:42.495 ***** 2021-01-27T09:39:04.839 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:04.841 INFO:teuthology.task.ansible.out:TASK [testnode : Check for custom repos] *************************************** ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005351", "end": "2021-01-27 09:39:04.827151", "rc": 0, "start": "2021-01-27 09:39:04.821800", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:39:04.880 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:04 +0000 (0:00:00.121) 0:00:42.617 ***** 2021-01-27T09:39:04.906 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-01-27T09:39:04.943 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:04 +0000 (0:00:00.063) 0:00:42.680 ***** 2021-01-27T09:39:05.352 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:05.354 INFO:teuthology.task.ansible.out:TASK [testnode : Set apt preferences] ****************************************** ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-01-27T09:39:05.397 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:05 +0000 (0:00:00.453) 0:00:43.134 ***** 2021-01-27T09:39:05.399 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:05.437 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:05.439 INFO:teuthology.task.ansible.out:TASK [testnode : Add sources list] ********************************************* skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:05.476 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:05 +0000 (0:00:00.079) 0:00:43.213 ***** 2021-01-27T09:39:05.478 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:05.508 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-01-27T09:39:05.551 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:05 +0000 (0:00:00.074) 0:00:43.287 ***** 2021-01-27T09:39:05.552 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:06.250 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-01-27T09:39:06.252 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-01-27T09:39:06.301 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:06 +0000 (0:00:00.749) 0:00:44.037 ***** 2021-01-27T09:39:06.339 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-01-27T09:39:06.341 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:06.385 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:06 +0000 (0:00:00.084) 0:00:44.122 ***** 2021-01-27T09:39:06.414 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-27T09:39:06.416 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:06.457 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:06 +0000 (0:00:00.072) 0:00:44.194 ***** 2021-01-27T09:39:06.498 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:06.542 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:06 +0000 (0:00:00.084) 0:00:44.278 ***** 2021-01-27T09:39:06.569 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-27T09:39:06.571 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:06.614 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:06 +0000 (0:00:00.071) 0:00:44.350 ***** 2021-01-27T09:39:06.641 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-27T09:39:06.643 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:06.691 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:06 +0000 (0:00:00.077) 0:00:44.427 ***** 2021-01-27T09:39:06.719 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:06.720 INFO:teuthology.task.ansible.out:TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:06.769 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:06 +0000 (0:00:00.078) 0:00:44.506 ***** 2021-01-27T09:39:06.797 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-27T09:39:06.799 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:06.840 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:06 +0000 (0:00:00.070) 0:00:44.577 ***** 2021-01-27T09:39:06.877 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-01-27T09:39:06.879 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:06.919 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:06 +0000 (0:00:00.078) 0:00:44.656 ***** 2021-01-27T09:39:06.937 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* ok: [smithi078.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-01-27T09:39:06.948 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-01-27T09:39:06.993 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:06 +0000 (0:00:00.073) 0:00:44.729 ***** 2021-01-27T09:39:07.033 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-01-27T09:39:07.078 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:07 +0000 (0:00:00.085) 0:00:44.815 ***** 2021-01-27T09:39:07.106 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-01-27T09:39:07.154 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:07 +0000 (0:00:00.076) 0:00:44.891 ***** 2021-01-27T09:39:07.194 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-01-27T09:39:07.196 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:07.243 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:07 +0000 (0:00:00.089) 0:00:44.980 ***** 2021-01-27T09:39:07.292 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi146.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:07.293 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:07.336 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:07 +0000 (0:00:00.092) 0:00:45.073 ***** 2021-01-27T09:39:07.410 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-01-27T09:39:07.412 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:07.455 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:07 +0000 (0:00:00.118) 0:00:45.191 ***** 2021-01-27T09:39:07.483 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:39:07.484 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:07.524 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:07 +0000 (0:00:00.069) 0:00:45.261 ***** 2021-01-27T09:39:07.564 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:07.607 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:07 +0000 (0:00:00.082) 0:00:45.344 ***** 2021-01-27T09:39:07.635 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:07.638 INFO:teuthology.task.ansible.out:TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:07.681 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:07 +0000 (0:00:00.073) 0:00:45.418 ***** 2021-01-27T09:39:07.722 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-01-27T09:39:07.724 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:07.764 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:07 +0000 (0:00:00.083) 0:00:45.501 ***** 2021-01-27T09:39:07.813 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-01-27T09:39:07.815 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:07.866 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:07 +0000 (0:00:00.101) 0:00:45.602 ***** 2021-01-27T09:39:07.882 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-01-27T09:39:07.884 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-01-27T09:39:07.922 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:07 +0000 (0:00:00.055) 0:00:45.658 ***** 2021-01-27T09:39:07.929 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-27T09:39:07.931 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:07.978 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:07 +0000 (0:00:00.055) 0:00:45.713 ***** 2021-01-27T09:39:08.023 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-27T09:39:08.025 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:08.072 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:08 +0000 (0:00:00.095) 0:00:45.809 ***** 2021-01-27T09:39:08.110 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-27T09:39:08.112 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:08.160 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:08 +0000 (0:00:00.087) 0:00:45.896 ***** 2021-01-27T09:39:08.191 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-01-27T09:39:08.193 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:08.239 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:08 +0000 (0:00:00.079) 0:00:45.975 ***** 2021-01-27T09:39:08.266 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-27T09:39:08.268 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:08.319 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:08 +0000 (0:00:00.080) 0:00:46.056 ***** 2021-01-27T09:39:08.357 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-27T09:39:08.358 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:08.402 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:08 +0000 (0:00:00.083) 0:00:46.139 ***** 2021-01-27T09:39:08.440 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-01-27T09:39:08.442 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:08.486 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:08 +0000 (0:00:00.083) 0:00:46.222 ***** 2021-01-27T09:39:08.527 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-01-27T09:39:08.529 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:08.603 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:08 +0000 (0:00:00.116) 0:00:46.339 ***** 2021-01-27T09:39:08.619 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-01-27T09:39:08.622 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"cache_update_time": 1611740324, "cache_updated": false, "changed": false} 2021-01-27T09:39:08.662 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:08 +0000 (0:00:00.060) 0:00:46.399 ***** 2021-01-27T09:39:08.669 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-01-27T09:39:08.671 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:08.718 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:08 +0000 (0:00:00.055) 0:00:46.454 ***** 2021-01-27T09:39:08.725 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-01-27T09:39:08.776 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:08 +0000 (0:00:00.053) 0:00:46.508 ***** 2021-01-27T09:39:08.779 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-01-27T09:39:08.781 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:08.829 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:08 +0000 (0:00:00.057) 0:00:46.565 ***** 2021-01-27T09:39:08.862 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-01-27T09:39:08.864 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:08.909 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:08 +0000 (0:00:00.079) 0:00:46.644 ***** 2021-01-27T09:39:08.937 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-01-27T09:39:08.938 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:08.981 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:08 +0000 (0:00:00.072) 0:00:46.717 ***** 2021-01-27T09:39:08.988 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-01-27T09:39:08.990 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.032228", "end": "2021-01-27 09:39:08.923754", "rc": 0, "start": "2021-01-27 09:39:08.891526", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:39:09.030 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:09 +0000 (0:00:00.049) 0:00:46.767 ***** 2021-01-27T09:39:09.041 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-01-27T09:39:09.044 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:09.092 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:09 +0000 (0:00:00.061) 0:00:46.829 ***** 2021-01-27T09:39:09.144 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-01-27T09:39:09.146 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:09.192 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:09 +0000 (0:00:00.099) 0:00:46.928 ***** 2021-01-27T09:39:09.422 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-01-27T09:39:09.424 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.017065", "end": "2021-01-27 09:39:09.577790", "rc": 0, "start": "2021-01-27 09:39:09.560725", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:39:09.477 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:09 +0000 (0:00:00.285) 0:00:47.214 ***** 2021-01-27T09:39:09.517 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-01-27T09:39:09.569 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:09 +0000 (0:00:00.091) 0:00:47.305 ***** 2021-01-27T09:39:10.116 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-01-27T09:39:10.120 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-01-27T09:39:10.164 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:10 +0000 (0:00:00.594) 0:00:47.900 ***** 2021-01-27T09:39:10.202 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-01-27T09:39:10.204 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:10.249 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:10 +0000 (0:00:00.085) 0:00:47.986 ***** 2021-01-27T09:39:11.244 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:11.246 INFO:teuthology.task.ansible.out:TASK [testnode : Update apt cache.] ******************************************** ok: [smithi078.front.sepia.ceph.com] => {"cache_update_time": 1611740324, "cache_updated": false, "changed": false} 2021-01-27T09:39:11.289 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:11 +0000 (0:00:01.039) 0:00:49.026 ***** 2021-01-27T09:39:12.450 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-01-27T09:39:12.452 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-01-27T09:39:14.520 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-01-27T09:39:14.576 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:14 +0000 (0:00:03.286) 0:00:52.312 ***** 2021-01-27T09:39:15.495 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* ok: [smithi146.front.sepia.ceph.com] => {"cache_update_time": 1611740325, "cache_updated": false, "changed": false} 2021-01-27T09:39:15.545 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:15 +0000 (0:00:00.969) 0:00:53.282 ***** 2021-01-27T09:39:15.590 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-01-27T09:39:15.644 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:15 +0000 (0:00:00.099) 0:00:53.381 ***** 2021-01-27T09:39:15.920 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-01-27T09:39:15.922 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.077621", "end": "2021-01-27 09:39:16.085387", "rc": 0, "start": "2021-01-27 09:39:16.007766", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:39:15.965 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:15 +0000 (0:00:00.320) 0:00:53.702 ***** 2021-01-27T09:39:19.536 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** ok: [smithi146.front.sepia.ceph.com] => {"cache_update_time": 1611740325, "cache_updated": false, "changed": false} 2021-01-27T09:39:19.580 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:19 +0000 (0:00:03.614) 0:00:57.316 ***** 2021-01-27T09:39:23.262 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-01-27T09:39:23.265 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms\n libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1\n libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools\n ovmf qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 22 not upgraded.\nAfter this operation, 62.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 114224 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nRemoving librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\ 2021-01-27T09:39:23.266 INFO:teuthology.task.ansible.out:r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms", " libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1", " libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools", " ovmf qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 22 not upgraded.", "After this operation, 62.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 114224 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.11) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Removing librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-27T09:39:23.301 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:23 +0000 (0:00:03.722) 0:01:01.038 ***** 2021-01-27T09:39:23.968 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-27T09:39:23.970 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"cache_update_time": 1611740324, "cache_updated": false, "changed": false} 2021-01-27T09:39:24.004 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:24 +0000 (0:00:00.702) 0:01:01.741 ***** 2021-01-27T09:39:24.042 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:24.078 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:24 +0000 (0:00:00.073) 0:01:01.815 ***** 2021-01-27T09:39:33.008 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-01-27T09:39:33.011 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms\n libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1\n libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools\n ovmf qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 22 not upgraded.\nAfter this operation, 62.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 116716 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nRemoving librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\ 2021-01-27T09:39:33.013 INFO:teuthology.task.ansible.out:r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms", " libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1", " libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools", " ovmf qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 22 not upgraded.", "After this operation, 62.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 116716 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.11) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Removing librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-27T09:39:33.055 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:33 +0000 (0:00:08.976) 0:01:10.792 ***** 2021-01-27T09:39:33.433 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-27T09:39:33.434 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"cache_update_time": 1611740324, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 22 not upgraded.\nNeed to get 13.6 MB of archives.\nAfter this operation, 62.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.1 [3203 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.1 [1611 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]\nFetched 13.6 MB in 1s (11.7 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading da 2021-01-27T09:39:33.435 INFO:teuthology.task.ansible.out:tabase ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 114152 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.11) ...\r\nSetting up librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nSetting up librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.11) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is 2021-01-27T09:39:33.437 INFO:teuthology.task.ansible.out:already the newest version (1:2.25.1-1ubuntu3).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 22 not upgraded.", "Need to get 13.6 MB of archives.", "After this operation, 62.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.1 [3203 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.1 [1611 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]", "Fetched 13.6 MB in 1s (11.7 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 114152 files and directories currently i 2021-01-27T09:39:33.438 INFO:teuthology.task.ansible.out:nstalled.)", "Preparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.11) ...", "Setting up librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Setting up librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.11) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-27T09:39:33.474 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:33 +0000 (0:00:00.419) 0:01:11.211 ***** 2021-01-27T09:39:33.476 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:33.899 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-27T09:39:33.901 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"cache_update_time": 1611740325, "cache_updated": false, "changed": false} 2021-01-27T09:39:33.949 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:33 +0000 (0:00:00.470) 0:01:11.681 ***** 2021-01-27T09:39:33.996 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-01-27T09:39:33.999 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:34.046 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:34 +0000 (0:00:00.099) 0:01:11.781 ***** 2021-01-27T09:39:34.135 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-01-27T09:39:34.137 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"cache_update_time": 1611740324, "cache_updated": false, "changed": false} 2021-01-27T09:39:34.179 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:34 +0000 (0:00:00.134) 0:01:11.915 ***** 2021-01-27T09:39:34.348 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-01-27T09:39:34.386 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:34 +0000 (0:00:00.206) 0:01:12.122 ***** 2021-01-27T09:39:34.434 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-01-27T09:39:34.436 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:34.482 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:34 +0000 (0:00:00.093) 0:01:12.216 ***** 2021-01-27T09:39:34.618 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-01-27T09:39:34.620 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-01-27T09:39:34.656 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:34 +0000 (0:00:00.175) 0:01:12.392 ***** 2021-01-27T09:39:35.038 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-01-27T09:39:35.040 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-01-27T09:39:35.084 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:35 +0000 (0:00:00.428) 0:01:12.821 ***** 2021-01-27T09:39:35.272 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-01-27T09:39:35.274 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-01-27T09:39:35.317 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:35 +0000 (0:00:00.232) 0:01:13.054 ***** 2021-01-27T09:39:35.456 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-01-27T09:39:35.458 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T09:39:35.498 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:35 +0000 (0:00:00.180) 0:01:13.234 ***** 2021-01-27T09:39:35.774 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-01-27T09:39:35.776 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 09:34:21 UTC", "ActiveEnterTimestampMonotonic": "17386569", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket basic.target system.slice -.mount nss-lookup.target sysinit.target remote-fs.target network.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 09:34:20 UTC", "AssertTimestampMonotonic": "16403622", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 09:34:20 UTC", "ConditionTimestampMonotonic": "16403622", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup" 2021-01-27T09:39:35.777 INFO:teuthology.task.ansible.out:: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1447", "ExecMainStartTimestamp": "Wed 2021-01-27 09:34:21 UTC", "ExecMainStartTimestampMonotonic": "17386532", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "1844674407370 2021-01-27T09:39:35.779 INFO:teuthology.task.ansible.out:9551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 09:34:20 UTC", "InactiveExitTimestampMonotonic": "16404667", "InvocationID": "fbc1f7de09664e5f886a5ada4dd10c81", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127780", "LimitNPROCSoft": "127780", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127780", "LimitSIGPENDINGSoft": "127780", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1447", "MemoryAccounting": "yes", "MemoryCurrent": "9928704", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPoli 2021-01-27T09:39:35.782 INFO:teuthology.task.ansible.out:cy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 09:34:21 UTC", "StateChangeTimestampMonotonic": "17386569", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38334", "TimeoutAbortUSec": 2021-01-27T09:39:35.784 INFO:teuthology.task.ansible.out: "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T09:39:35.819 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:35 +0000 (0:00:00.321) 0:01:13.556 ***** 2021-01-27T09:39:35.847 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-27T09:39:35.850 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:35.885 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:35 +0000 (0:00:00.064) 0:01:13.621 ***** 2021-01-27T09:39:35.911 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-01-27T09:39:35.913 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:35.948 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:35 +0000 (0:00:00.063) 0:01:13.684 ***** 2021-01-27T09:39:35.996 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-27T09:39:35.997 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:36.032 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:36 +0000 (0:00:00.084) 0:01:13.769 ***** 2021-01-27T09:39:36.060 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-27T09:39:36.062 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:36.103 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:36 +0000 (0:00:00.071) 0:01:13.840 ***** 2021-01-27T09:39:36.133 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:36.176 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:36 +0000 (0:00:00.072) 0:01:13.912 ***** 2021-01-27T09:39:36.203 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-27T09:39:36.205 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:36.239 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:36 +0000 (0:00:00.063) 0:01:13.976 ***** 2021-01-27T09:39:36.266 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-27T09:39:36.268 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:36.308 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:36 +0000 (0:00:00.068) 0:01:14.045 ***** 2021-01-27T09:39:36.336 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-27T09:39:36.338 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:36.374 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:36 +0000 (0:00:00.065) 0:01:14.111 ***** 2021-01-27T09:39:36.402 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:36.438 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:36 +0000 (0:00:00.063) 0:01:14.174 ***** 2021-01-27T09:39:36.440 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:36.470 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-27T09:39:36.472 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:36.512 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:36 +0000 (0:00:00.073) 0:01:14.248 ***** 2021-01-27T09:39:36.539 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-27T09:39:36.541 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:36.577 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:36 +0000 (0:00:00.065) 0:01:14.314 ***** 2021-01-27T09:39:36.615 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-27T09:39:36.617 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:36.657 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:36 +0000 (0:00:00.079) 0:01:14.393 ***** 2021-01-27T09:39:36.688 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:36.690 INFO:teuthology.task.ansible.out:TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:36.731 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:36 +0000 (0:00:00.074) 0:01:14.468 ***** 2021-01-27T09:39:36.760 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-27T09:39:36.762 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:36.797 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:36 +0000 (0:00:00.065) 0:01:14.533 ***** 2021-01-27T09:39:36.834 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-27T09:39:36.836 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:36.872 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:36 +0000 (0:00:00.074) 0:01:14.608 ***** 2021-01-27T09:39:36.900 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-27T09:39:36.901 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:36.937 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:36 +0000 (0:00:00.064) 0:01:14.673 ***** 2021-01-27T09:39:36.964 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-27T09:39:36.965 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:37.015 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:37 +0000 (0:00:00.078) 0:01:14.752 ***** 2021-01-27T09:39:37.017 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:37.048 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:37.051 INFO:teuthology.task.ansible.out:TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:37.084 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:37 +0000 (0:00:00.069) 0:01:14.821 ***** 2021-01-27T09:39:37.111 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-27T09:39:37.113 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:37.156 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:37 +0000 (0:00:00.071) 0:01:14.892 ***** 2021-01-27T09:39:37.184 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-27T09:39:37.186 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:37.223 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:37 +0000 (0:00:00.066) 0:01:14.959 ***** 2021-01-27T09:39:37.261 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-27T09:39:37.263 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:37.299 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:37 +0000 (0:00:00.076) 0:01:15.036 ***** 2021-01-27T09:39:37.338 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:37.378 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:37 +0000 (0:00:00.078) 0:01:15.115 ***** 2021-01-27T09:39:37.380 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:37.410 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-27T09:39:37.412 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:37.454 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:37 +0000 (0:00:00.076) 0:01:15.191 ***** 2021-01-27T09:39:37.503 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-27T09:39:37.505 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:37.543 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:37 +0000 (0:00:00.088) 0:01:15.279 ***** 2021-01-27T09:39:37.576 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:37.635 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:37 +0000 (0:00:00.092) 0:01:15.372 ***** 2021-01-27T09:39:37.641 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:37.664 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:37.702 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:37 +0000 (0:00:00.066) 0:01:15.438 ***** 2021-01-27T09:39:37.863 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-01-27T09:39:37.864 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-01-27T09:39:37.901 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:37 +0000 (0:00:00.198) 0:01:15.637 ***** 2021-01-27T09:39:38.218 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-27T09:39:38.220 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-01-27T09:39:38.260 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:38 +0000 (0:00:00.359) 0:01:15.996 ***** 2021-01-27T09:39:38.287 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-01-27T09:39:38.289 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:38.324 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:38 +0000 (0:00:00.064) 0:01:16.061 ***** 2021-01-27T09:39:38.657 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-01-27T09:39:38.659 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-01-27T09:39:38.699 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:38 +0000 (0:00:00.374) 0:01:16.435 ***** 2021-01-27T09:39:39.021 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-01-27T09:39:39.063 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:39 +0000 (0:00:00.364) 0:01:16.799 ***** 2021-01-27T09:39:39.586 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-01-27T09:39:39.587 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-01-27T09:39:39.587 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:39.648 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:39 +0000 (0:00:00.585) 0:01:17.385 ***** 2021-01-27T09:39:39.806 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-01-27T09:39:39.808 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T09:39:39.862 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:39 +0000 (0:00:00.213) 0:01:17.599 ***** 2021-01-27T09:39:39.892 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:39.935 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:39 +0000 (0:00:00.072) 0:01:17.671 ***** 2021-01-27T09:39:39.992 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:40.029 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:40 +0000 (0:00:00.094) 0:01:17.766 ***** 2021-01-27T09:39:40.082 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:40.084 INFO:teuthology.task.ansible.out:TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:40.121 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:40 +0000 (0:00:00.091) 0:01:17.857 ***** 2021-01-27T09:39:40.149 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:40.185 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:40 +0000 (0:00:00.064) 0:01:17.921 ***** 2021-01-27T09:39:40.224 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-01-27T09:39:40.226 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:40.283 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:40 +0000 (0:00:00.098) 0:01:18.020 ***** 2021-01-27T09:39:40.335 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi078.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-01-27T09:39:40.389 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:40 +0000 (0:00:00.106) 0:01:18.126 ***** 2021-01-27T09:39:40.459 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-01-27T09:39:40.461 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:40.483 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:40.485 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:40.496 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:40.518 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:40.520 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:40.541 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:40.562 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:40.596 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-01-27T09:39:40.618 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:40.620 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:40.630 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:40.651 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:40.662 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:40.674 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:40.685 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:40.695 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:40.738 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:40 +0000 (0:00:00.348) 0:01:18.474 ***** 2021-01-27T09:39:40.959 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi078.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003389", "end": "2021-01-27 09:39:40.932151", "rc": 0, "start": "2021-01-27 09:39:40.928762", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2021-01-27T09:39:41.011 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:41 +0000 (0:00:00.273) 0:01:18.748 ***** 2021-01-27T09:39:41.049 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-01-27T09:39:41.051 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:41.093 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:41 +0000 (0:00:00.081) 0:01:18.829 ***** 2021-01-27T09:39:41.121 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:41.160 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:41 +0000 (0:00:00.067) 0:01:18.897 ***** 2021-01-27T09:39:41.188 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:41.226 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:41 +0000 (0:00:00.065) 0:01:18.962 ***** 2021-01-27T09:39:41.869 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-01-27T09:39:41.870 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"cache_update_time": 1611740324, "cache_updated": false, "changed": false} 2021-01-27T09:39:41.906 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:41 +0000 (0:00:00.680) 0:01:19.642 ***** 2021-01-27T09:39:41.933 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-01-27T09:39:41.935 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:41.974 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:41 +0000 (0:00:00.068) 0:01:19.711 ***** 2021-01-27T09:39:42.013 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-27T09:39:42.015 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item={'block_used': 14029141, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226065967, 'size_available': 925966200832, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 129578, 'block_size': 4096, 'inode_available': 60925398}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226065967, "block_size": 4096, "block_total": 240095108, "block_used": 14029141, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60925398, "inode_total": 61054976, "inode_used": 129578, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925966200832, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}} 2021-01-27T09:39:42.050 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:42 +0000 (0:00:00.076) 0:01:19.787 ***** 2021-01-27T09:39:42.196 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-01-27T09:39:42.198 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009358", "end": "2021-01-27 09:39:42.179092", "rc": 0, "start": "2021-01-27 09:39:42.169734", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:39:42.235 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:42 +0000 (0:00:00.185) 0:01:19.972 ***** 2021-01-27T09:39:42.284 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-01-27T09:39:42.286 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'block_used': 14029141, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226065967, 'size_available': 925966200832, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 129578, 'block_size': 4096, 'inode_available': 60925398}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226065967, "block_size": 4096, "block_total": 240095108, "block_used": 14029141, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60925398, "inode_total": 61054976, "inode_used": 129578, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925966200832, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:42.323 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:42 +0000 (0:00:00.087) 0:01:20.060 ***** 2021-01-27T09:39:42.351 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-01-27T09:39:42.387 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:42 +0000 (0:00:00.063) 0:01:20.124 ***** 2021-01-27T09:39:42.446 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-27T09:39:42.448 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:44.220 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-EF0LKlDbpJa4aSuaeTHXY27GBwjfVDLvyBKdlQtfwrKrJ1rFo21owG1NIB5YCHmD'], 'uuids': ['03185918-86f9-40df-9aa2-c3774bb8ce3c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.647465", "end": "2021-01-27 09:39:44.189323", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-EF0LKlDbpJa4aSuaeTHXY27GBwjfVDLvyBKdlQtfwrKrJ1rFo21owG1NIB5YCHmD"], "labels": [], "masters": [], "uuids": ["03185918-86f9-40df-9aa2-c3774bb8ce3c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:39:42.541858", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T09:39:44.232 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:44.233 INFO:teuthology.task.ansible.out: skipping: [smithi078.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:44.234 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:45.499 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-EF0LKlDbpJa4aSuaeTHXY27GBwjfVDLv08bx7Y3wcmGg7fpfBRzVb0bDguW6cwuW'], 'uuids': ['d7ddc7cb-b248-4a6b-91ae-708bd37ec963']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.135467", "end": "2021-01-27 09:39:45.470503", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-EF0LKlDbpJa4aSuaeTHXY27GBwjfVDLv08bx7Y3wcmGg7fpfBRzVb0bDguW6cwuW"], "labels": [], "masters": [], "uuids": ["d7ddc7cb-b248-4a6b-91ae-708bd37ec963"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:39:44.335036", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T09:39:45.511 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LGR8', 'wwn-0x5000c500918e79d4'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LGR8-part1', 'wwn-0x5000c500918e79d4-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500918e79d4', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5LGR8', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGR8", "wwn-0x5000c500918e79d4"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGR8-part1", "wwn-0x5000c500918e79d4-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LGR8", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918e79d4"}}, 2021-01-27T09:39:45.513 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-01-27T09:39:45.931 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-27T09:39:45.933 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"cache_update_time": 1611740325, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 22 not upgraded.\nNeed to get 13.6 MB of archives.\nAfter this operation, 62.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.1 [3203 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.1 [1611 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]\nFetched 13.6 MB in 1s (11.7 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading da 2021-01-27T09:39:45.935 INFO:teuthology.task.ansible.out:tabase ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 116644 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.11) ...\r\nSetting up librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nSetting up librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.11) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is 2021-01-27T09:39:45.936 INFO:teuthology.task.ansible.out:already the newest version (1:2.25.1-1ubuntu3).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 22 not upgraded.", "Need to get 13.6 MB of archives.", "After this operation, 62.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.1 [3203 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.1 [1611 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]", "Fetched 13.6 MB in 1s (11.7 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 116644 files and directories currently i 2021-01-27T09:39:45.938 INFO:teuthology.task.ansible.out:nstalled.)", "Preparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.11) ...", "Setting up librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Setting up librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.11) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-27T09:39:45.976 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:45 +0000 (0:00:03.589) 0:01:23.713 ***** 2021-01-27T09:39:46.817 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-01-27T09:39:46.820 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"cache_update_time": 1611740325, "cache_updated": false, "changed": false} 2021-01-27T09:39:46.863 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:46 +0000 (0:00:00.886) 0:01:24.600 ***** 2021-01-27T09:39:46.870 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-27T09:39:46.871 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-L5F6at-1f9W-sQVm-xxKK-6VmM-xLch-u9AeWn', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400QR400BGN', 'nvme-nvme.8086-50484654363230343030515234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.196580", "end": "2021-01-27 09:39:46.810327", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-L5F6at-1f9W-sQVm-xxKK-6VmM-xLch-u9AeWn", "nvme-INTEL_SSDPEDMD400G4_PHFT620400QR400BGN", "nvme-nvme.8086-50484654363230343030515234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:39:45.613747", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-01-27T09:39:46.872 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T09:39:46.873 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:46.874 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:47.055 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-01-27T09:39:47.057 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-01-27T09:39:47.098 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:47 +0000 (0:00:00.234) 0:01:24.834 ***** 2021-01-27T09:39:47.132 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-01-27T09:39:47.134 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:47.176 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:47 +0000 (0:00:00.077) 0:01:24.912 ***** 2021-01-27T09:39:47.374 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-01-27T09:39:47.376 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-01-27T09:39:47.420 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:47 +0000 (0:00:00.243) 0:01:25.156 ***** 2021-01-27T09:39:47.927 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-01-27T09:39:47.929 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-01-27T09:39:47.973 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:47 +0000 (0:00:00.552) 0:01:25.709 ***** 2021-01-27T09:39:48.147 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi078.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-EF0LKlDbpJa4aSuaeTHXY27GBwjfVDLvoND2llckN13EA6PqDFA25QeDnbPtNNFM'], 'uuids': ['e2104a18-b8d7-4f75-9411-69468457da38']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.152996", "end": "2021-01-27 09:39:48.121063", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-EF0LKlDbpJa4aSuaeTHXY27GBwjfVDLvoND2llckN13EA6PqDFA25QeDnbPtNNFM"], "labels": [], "masters": [], "uuids": ["e2104a18-b8d7-4f75-9411-69468457da38"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:39:46.968067", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now pa 2021-01-27T09:39:48.149 INFO:teuthology.task.ansible.out:rtition the disk using fdisk or", "other utilities."]} 2021-01-27T09:39:48.158 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:48.170 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:48.214 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:48.216 INFO:teuthology.task.ansible.out:TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-01-27T09:39:48.218 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-01-27T09:39:48.260 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:48 +0000 (0:00:00.287) 0:01:25.997 ***** 2021-01-27T09:39:48.469 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-01-27T09:39:48.471 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T09:39:48.517 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:48 +0000 (0:00:00.256) 0:01:26.254 ***** 2021-01-27T09:39:48.935 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-01-27T09:39:48.936 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 09:37:48 UTC", "ActiveEnterTimestampMonotonic": "16659202", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket basic.target remote-fs.target system.slice -.mount nss-lookup.target systemd-tmpfiles-setup.service sysinit.target network.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 09:37:47 UTC", "AssertTimestampMonotonic": "15878148", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read 0x26 0x27 0x28", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 09:37:47 UTC", "ConditionTimestampMonotonic": "15878148", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", 2021-01-27T09:39:48.938 INFO:teuthology.task.ansible.out: "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "992", "ExecMainStartTimestamp": "Wed 2021-01-27 09:37:48 UTC", "ExecMainStartTimestampMonotonic": "16659172", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": 2021-01-27T09:39:48.940 INFO:teuthology.task.ansible.out:"18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 09:37:47 UTC", "InactiveExitTimestampMonotonic": "15880733", "InvocationID": "bfd03d1a44024bbcb9a182842f6ad0ab", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127767", "LimitNPROCSoft": "127767", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127767", "LimitSIGPENDINGSoft": "127767", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "992", "MemoryAccounting": "yes", "MemoryCurrent": "25202688", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": 2021-01-27T09:39:48.941 INFO:teuthology.task.ansible.out: "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 09:37:48 UTC", "StateChangeTimestampMonotonic": "16659202", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "38330" 2021-01-27T09:39:48.943 INFO:teuthology.task.ansible.out:, "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T09:39:48.983 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:48 +0000 (0:00:00.465) 0:01:26.720 ***** 2021-01-27T09:39:48.985 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:49.014 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:49.015 INFO:teuthology.task.ansible.out:TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:49.056 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:49 +0000 (0:00:00.073) 0:01:26.793 ***** 2021-01-27T09:39:49.083 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-01-27T09:39:49.085 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:49.129 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:49 +0000 (0:00:00.072) 0:01:26.865 ***** 2021-01-27T09:39:49.167 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-27T09:39:49.169 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:49.212 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:49 +0000 (0:00:00.083) 0:01:26.948 ***** 2021-01-27T09:39:49.250 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:49.291 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:49 +0000 (0:00:00.079) 0:01:27.028 ***** 2021-01-27T09:39:49.319 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-01-27T09:39:49.320 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:49.364 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:49 +0000 (0:00:00.072) 0:01:27.100 ***** 2021-01-27T09:39:49.391 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-27T09:39:49.393 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:49.449 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:49 +0000 (0:00:00.085) 0:01:27.186 ***** 2021-01-27T09:39:49.466 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-27T09:39:49.468 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-EF0LKlDbpJa4aSuaeTHXY27GBwjfVDLvoA9FRfnGlqSA4SRzqfNQS5PlorKQDvoK'], 'uuids': ['46f3aff2-e959-4377-8c08-22e0a2a02872']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.151689", "end": "2021-01-27 09:39:49.425212", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-EF0LKlDbpJa4aSuaeTHXY27GBwjfVDLvoA9FRfnGlqSA4SRzqfNQS5PlorKQDvoK"], "labels": [], "masters": [], "uuids": ["46f3aff2-e959-4377-8c08-22e0a2a02872"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:39:48.273523", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T09:39:49.469 INFO:teuthology.task.ansible.out:skipping: [smithi078.front 2021-01-27T09:39:49.470 INFO:teuthology.task.ansible.out:.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:49.492 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-27T09:39:49.494 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:49.540 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:49 +0000 (0:00:00.090) 0:01:27.277 ***** 2021-01-27T09:39:49.567 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-27T09:39:49.569 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:49.613 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:49 +0000 (0:00:00.073) 0:01:27.350 ***** 2021-01-27T09:39:49.651 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:39:49.653 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:49.694 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:49 +0000 (0:00:00.080) 0:01:27.430 ***** 2021-01-27T09:39:49.732 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-27T09:39:49.734 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:49.777 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:49 +0000 (0:00:00.083) 0:01:27.514 ***** 2021-01-27T09:39:49.804 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-27T09:39:49.806 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:49.848 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:49 +0000 (0:00:00.070) 0:01:27.585 ***** 2021-01-27T09:39:49.886 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-27T09:39:49.888 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:49.928 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:49 +0000 (0:00:00.080) 0:01:27.665 ***** 2021-01-27T09:39:49.955 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-27T09:39:49.957 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:50.007 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:50 +0000 (0:00:00.078) 0:01:27.743 ***** 2021-01-27T09:39:50.035 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-27T09:39:50.036 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:50.086 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:50 +0000 (0:00:00.078) 0:01:27.822 ***** 2021-01-27T09:39:50.115 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-27T09:39:50.117 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:50.172 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:50 +0000 (0:00:00.086) 0:01:27.908 ***** 2021-01-27T09:39:50.200 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-27T09:39:50.202 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:50.249 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:50 +0000 (0:00:00.077) 0:01:27.986 ***** 2021-01-27T09:39:50.278 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-27T09:39:50.281 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:50.330 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:50 +0000 (0:00:00.081) 0:01:28.067 ***** 2021-01-27T09:39:50.360 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-01-27T09:39:50.362 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:50.412 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:50 +0000 (0:00:00.081) 0:01:28.149 ***** 2021-01-27T09:39:50.440 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-27T09:39:50.442 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:50.490 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:50 +0000 (0:00:00.077) 0:01:28.227 ***** 2021-01-27T09:39:50.518 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-27T09:39:50.520 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:50.569 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:50 +0000 (0:00:00.079) 0:01:28.306 ***** 2021-01-27T09:39:50.597 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-27T09:39:50.599 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:50.647 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:50 +0000 (0:00:00.078) 0:01:28.384 ***** 2021-01-27T09:39:50.675 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-27T09:39:50.677 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:50.724 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:50 +0000 (0:00:00.077) 0:01:28.461 ***** 2021-01-27T09:39:50.737 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi078.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-EF0LKlDbpJa4aSuaeTHXY27GBwjfVDLvimR9Dc8BguHffD5cqwmVYv7yX1vgk0j9'], 'uuids': ['ff3b4088-b14f-4cc0-8a72-adad97d00252']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.127383", "end": "2021-01-27 09:39:50.697093", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-EF0LKlDbpJa4aSuaeTHXY27GBwjfVDLvimR9Dc8BguHffD5cqwmVYv7yX1vgk0j9"], "labels": [], "masters": [], "uuids": ["ff3b4088-b14f-4cc0-8a72-adad97d00252"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:39:49.569710", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now 2021-01-27T09:39:50.739 INFO:teuthology.task.ansible.out:partition the disk using fdisk or", "other utilities."]} 2021-01-27T09:39:50.792 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:50 +0000 (0:00:00.067) 0:01:28.528 ***** 2021-01-27T09:39:50.799 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-27T09:39:50.802 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:50.961 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:50 +0000 (0:00:00.169) 0:01:28.698 ***** 2021-01-27T09:39:50.981 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-27T09:39:50.982 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:50.984 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:51.026 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:51 +0000 (0:00:00.064) 0:01:28.762 ***** 2021-01-27T09:39:51.053 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-27T09:39:51.054 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:51.097 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:51 +0000 (0:00:00.071) 0:01:28.834 ***** 2021-01-27T09:39:51.126 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:51.171 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:51 +0000 (0:00:00.073) 0:01:28.908 ***** 2021-01-27T09:39:51.261 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-27T09:39:51.263 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-EF0LKlDbpJa4aSuaeTHXY27GBwjfVDLvyBKdlQtfwrKrJ1rFo21owG1NIB5YCHmD'], 'uuids': ['03185918-86f9-40df-9aa2-c3774bb8ce3c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.164588", "end": "2021-01-27 09:39:51.237599", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-EF0LKlDbpJa4aSuaeTHXY27GBwjfVDLvyBKdlQtfwrKrJ1rFo21owG1NIB5YCHmD"], "labels": [], "masters": [], "uuids": ["03185918-86f9-40df-9aa2-c3774bb8ce3c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:39:51.073011", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159721 s, 722 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159721 s, 722 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:39:51.274 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:51.285 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:51.360 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-01-27T09:39:51.362 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-01-27T09:39:51.404 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:51 +0000 (0:00:00.232) 0:01:29.140 ***** 2021-01-27T09:39:51.580 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-27T09:39:51.582 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-EF0LKlDbpJa4aSuaeTHXY27GBwjfVDLv08bx7Y3wcmGg7fpfBRzVb0bDguW6cwuW'], 'uuids': ['d7ddc7cb-b248-4a6b-91ae-708bd37ec963']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.172590", "end": "2021-01-27 09:39:51.557813", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-EF0LKlDbpJa4aSuaeTHXY27GBwjfVDLv08bx7Y3wcmGg7fpfBRzVb0bDguW6cwuW"], "labels": [], "masters": [], "uuids": ["d7ddc7cb-b248-4a6b-91ae-708bd37ec963"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:39:51.385223", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.167559 s, 688 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.167559 s, 688 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:39:51.594 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LGR8', 'wwn-0x5000c500918e79d4'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LGR8-part1', 'wwn-0x5000c500918e79d4-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500918e79d4', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5LGR8', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGR8", "wwn-0x5000c500918e79d4"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGR8-part1", "wwn-0x5000c500918e79d4-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LGR8", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918e79d4"}}, 2021-01-27T09:39:51.596 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-01-27T09:39:51.774 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-L5F6at-1f9W-sQVm-xxKK-6VmM-xLch-u9AeWn', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400QR400BGN', 'nvme-nvme.8086-50484654363230343030515234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.059061", "end": "2021-01-27 09:39:51.750276", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-L5F6at-1f9W-sQVm-xxKK-6VmM-xLch-u9AeWn", "nvme-INTEL_SSDPEDMD400G4_PHFT620400QR400BGN", "nvme-nvme.8086-50484654363230343030515234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:39:51.691215", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0542922 s, 2.1 GB/s", "std 2021-01-27T09:39:51.776 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0542922 s, 2.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:39:51.786 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:51.798 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:51.882 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-27T09:39:51.884 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-01-27T09:39:51.924 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:51 +0000 (0:00:00.520) 0:01:29.661 ***** 2021-01-27T09:39:51.952 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-01-27T09:39:51.954 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:51.994 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:51 +0000 (0:00:00.069) 0:01:29.731 ***** 2021-01-27T09:39:52.079 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-27T09:39:52.081 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-EF0LKlDbpJa4aSuaeTHXY27GBwjfVDLvoND2llckN13EA6PqDFA25QeDnbPtNNFM'], 'uuids': ['e2104a18-b8d7-4f75-9411-69468457da38']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.162274", "end": "2021-01-27 09:39:52.056307", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-EF0LKlDbpJa4aSuaeTHXY27GBwjfVDLvoND2llckN13EA6PqDFA25QeDnbPtNNFM"], "labels": [], "masters": [], "uuids": ["e2104a18-b8d7-4f75-9411-69468457da38"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:39:51.894033", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.157225 s, 734 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.157225 s, 734 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:39:52.092 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:52.105 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:52.393 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-EF0LKlDbpJa4aSuaeTHXY27GBwjfVDLvoA9FRfnGlqSA4SRzqfNQS5PlorKQDvoK'], 'uuids': ['46f3aff2-e959-4377-8c08-22e0a2a02872']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.166697", "end": "2021-01-27 09:39:52.368449", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-EF0LKlDbpJa4aSuaeTHXY27GBwjfVDLvoA9FRfnGlqSA4SRzqfNQS5PlorKQDvoK"], "labels": [], "masters": [], "uuids": ["46f3aff2-e959-4377-8c08-22e0a2a02872"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:39:52.201752", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.161904 s, 712 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.161904 s, 712 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:39:52.415 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:52.514 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-01-27T09:39:52.516 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-01-27T09:39:52.565 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:52 +0000 (0:00:00.570) 0:01:30.301 ***** 2021-01-27T09:39:52.710 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-27T09:39:52.712 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-EF0LKlDbpJa4aSuaeTHXY27GBwjfVDLvimR9Dc8BguHffD5cqwmVYv7yX1vgk0j9'], 'uuids': ['ff3b4088-b14f-4cc0-8a72-adad97d00252']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.166553", "end": "2021-01-27 09:39:52.683915", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-EF0LKlDbpJa4aSuaeTHXY27GBwjfVDLvimR9Dc8BguHffD5cqwmVYv7yX1vgk0j9"], "labels": [], "masters": [], "uuids": ["ff3b4088-b14f-4cc0-8a72-adad97d00252"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:39:52.517362", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.161538 s, 714 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.161538 s, 714 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:39:52.773 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:52 +0000 (0:00:00.208) 0:01:30.510 ***** 2021-01-27T09:39:53.085 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-01-27T09:39:53.087 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.153279", "end": "2021-01-27 09:39:53.050227", "rc": 0, "start": "2021-01-27 09:39:52.896948", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-01-27T09:39:53.130 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:53 +0000 (0:00:00.357) 0:01:30.867 ***** 2021-01-27T09:39:53.173 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:53 +0000 (0:00:00.042) 0:01:30.910 ***** 2021-01-27T09:39:53.351 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-01-27T09:39:53.353 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.085844", "end": "2021-01-27 09:39:53.330879", "rc": 0, "start": "2021-01-27 09:39:53.245035", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:39:53.391 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:53 +0000 (0:00:00.217) 0:01:31.127 ***** 2021-01-27T09:39:53.421 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-01-27T09:39:53.461 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:53 +0000 (0:00:00.069) 0:01:31.197 ***** 2021-01-27T09:39:53.504 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:53.547 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:53 +0000 (0:00:00.086) 0:01:31.283 ***** 2021-01-27T09:39:53.575 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-01-27T09:39:53.577 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:53.615 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:53 +0000 (0:00:00.068) 0:01:31.352 ***** 2021-01-27T09:39:53.653 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-27T09:39:53.654 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:53.703 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:53 +0000 (0:00:00.086) 0:01:31.438 ***** 2021-01-27T09:39:53.710 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-01-27T09:39:53.711 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-01-27T09:39:53.758 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:53 +0000 (0:00:00.056) 0:01:31.494 ***** 2021-01-27T09:39:53.765 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:53.804 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:53 +0000 (0:00:00.045) 0:01:31.540 ***** 2021-01-27T09:39:53.937 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-01-27T09:39:53.938 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T09:39:53.974 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:53 +0000 (0:00:00.170) 0:01:31.710 ***** 2021-01-27T09:39:53.981 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-01-27T09:39:53.982 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T09:39:54.032 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:54 +0000 (0:00:00.058) 0:01:31.769 ***** 2021-01-27T09:39:54.040 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-27T09:39:54.042 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'block_used': 14029141, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226065967, 'size_available': 925966200832, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 129578, 'block_size': 4096, 'inode_available': 60925398}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226065967, "block_size": 4096, "block_total": 240095108, "block_used": 14029141, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60925398, "inode_total": 61054976, "inode_used": 129578, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925966200832, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.079 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:54 +0000 (0:00:00.047) 0:01:31.816 ***** 2021-01-27T09:39:54.086 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-01-27T09:39:54.088 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.129 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:54 +0000 (0:00:00.049) 0:01:31.866 ***** 2021-01-27T09:39:54.136 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.178 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:54 +0000 (0:00:00.048) 0:01:31.914 ***** 2021-01-27T09:39:54.190 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-01-27T09:39:54.192 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.238 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:54 +0000 (0:00:00.059) 0:01:31.974 ***** 2021-01-27T09:39:54.244 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:39:54.246 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.285 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:54 +0000 (0:00:00.047) 0:01:32.022 ***** 2021-01-27T09:39:54.292 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-01-27T09:39:54.294 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.340 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:54 +0000 (0:00:00.054) 0:01:32.076 ***** 2021-01-27T09:39:54.346 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:39:54.347 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.397 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:54 +0000 (0:00:00.057) 0:01:32.134 ***** 2021-01-27T09:39:54.412 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.466 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:54 +0000 (0:00:00.069) 0:01:32.203 ***** 2021-01-27T09:39:54.476 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-01-27T09:39:54.477 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.519 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:54 +0000 (0:00:00.052) 0:01:32.256 ***** 2021-01-27T09:39:54.526 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-01-27T09:39:54.528 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.572 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:54 +0000 (0:00:00.052) 0:01:32.309 ***** 2021-01-27T09:39:54.580 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.621 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:54 +0000 (0:00:00.048) 0:01:32.357 ***** 2021-01-27T09:39:54.629 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:39:54.631 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-01-27T09:39:54.676 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:54 +0000 (0:00:00.055) 0:01:32.413 ***** 2021-01-27T09:39:54.684 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-01-27T09:39:54.686 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.726 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:54 +0000 (0:00:00.049) 0:01:32.463 ***** 2021-01-27T09:39:54.734 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-01-27T09:39:54.736 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=ram14) => {"ansible_loop_var": "item", "changed": false, "item": "ram14", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.747 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=ram15) => {"ansible_loop_var": "item", "changed": false, "item": "ram15", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.748 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=ram12) => {"ansible_loop_var": "item", "changed": false, "item": "ram12", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.758 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=ram13) => {"ansible_loop_var": "item", "changed": false, "item": "ram13", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.760 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=ram10) => {"ansible_loop_var": "item", "changed": false, "item": "ram10", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.769 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=ram11) => {"ansible_loop_var": "item", "changed": false, "item": "ram11", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.780 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=ram8) => {"ansible_loop_var": "item", "changed": false, "item": "ram8", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.782 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=ram9) => {"ansible_loop_var": "item", "changed": false, "item": "ram9", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.792 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=ram4) => {"ansible_loop_var": "item", "changed": false, "item": "ram4", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.803 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=ram5) => {"ansible_loop_var": "item", "changed": false, "item": "ram5", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.805 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=ram6) => {"ansible_loop_var": "item", "changed": false, "item": "ram6", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.815 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=ram7) => {"ansible_loop_var": "item", "changed": false, "item": "ram7", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.816 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=ram0) => {"ansible_loop_var": "item", "changed": false, "item": "ram0", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.826 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=ram1) => {"ansible_loop_var": "item", "changed": false, "item": "ram1", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.837 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=ram2) => {"ansible_loop_var": "item", "changed": false, "item": "ram2", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.839 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=ram3) => {"ansible_loop_var": "item", "changed": false, "item": "ram3", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.848 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.860 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.862 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.871 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.873 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.883 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.894 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.895 INFO:teuthology.task.ansible.out: skipping: [smithi146.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.908 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.917 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.929 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.930 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.940 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-01-27T09:39:54.951 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-01-27T09:39:55.006 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:55 +0000 (0:00:00.279) 0:01:32.742 ***** 2021-01-27T09:39:55.224 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-01-27T09:39:55.225 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.005236", "end": "2021-01-27 09:39:55.201827", "rc": 0, "start": "2021-01-27 09:39:55.196591", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2021-01-27T09:39:55.273 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:55 +0000 (0:00:00.266) 0:01:33.009 ***** 2021-01-27T09:39:55.310 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:55.312 INFO:teuthology.task.ansible.out:TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:55.372 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:55 +0000 (0:00:00.099) 0:01:33.109 ***** 2021-01-27T09:39:55.412 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:55.456 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:55 +0000 (0:00:00.084) 0:01:33.193 ***** 2021-01-27T09:39:55.458 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:55.465 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:55.466 INFO:teuthology.task.ansible.out:TASK [testnode : Create volume group(s)] *************************************** changed: [smithi078.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-01-27T09:39:55.506 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:55 +0000 (0:00:00.049) 0:01:33.242 ***** 2021-01-27T09:39:55.514 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-01-27T09:39:55.516 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:55.563 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:55 +0000 (0:00:00.057) 0:01:33.300 ***** 2021-01-27T09:39:56.045 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-01-27T09:39:56.046 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T09:39:56.413 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [smithi146.front.sepia.ceph.com] => {"cache_update_time": 1611740325, "cache_updated": false, "changed": false} 2021-01-27T09:39:56.415 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:56.416 INFO:teuthology.task.ansible.out:TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi078.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T09:39:56.459 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:56 +0000 (0:00:00.895) 0:01:34.195 ***** 2021-01-27T09:39:56.486 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:56.488 INFO:teuthology.task.ansible.out:TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:56.528 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:56 +0000 (0:00:00.069) 0:01:34.265 ***** 2021-01-27T09:39:56.566 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-27T09:39:56.568 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={'block_used': 14312482, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 225782626, 'size_available': 924805636096, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 134765, 'block_size': 4096, 'inode_available': 60920211}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 225782626, "block_size": 4096, "block_total": 240095108, "block_used": 14312482, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60920211, "inode_total": 61054976, "inode_used": 134765, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 924805636096, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}} 2021-01-27T09:39:56.611 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:56 +0000 (0:00:00.082) 0:01:34.348 ***** 2021-01-27T09:39:56.784 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-01-27T09:39:56.786 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T09:39:56.816 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-01-27T09:39:56.818 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.028609", "end": "2021-01-27 09:39:56.986376", "rc": 0, "start": "2021-01-27 09:39:56.957767", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:39:56.862 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:56 +0000 (0:00:00.250) 0:01:34.598 ***** 2021-01-27T09:39:56.898 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-01-27T09:39:56.900 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'block_used': 14312482, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 225782626, 'size_available': 924805636096, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 134765, 'block_size': 4096, 'inode_available': 60920211}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 225782626, "block_size": 4096, "block_total": 240095108, "block_used": 14312482, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60920211, "inode_total": 61054976, "inode_used": 134765, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 924805636096, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:56.945 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:56 +0000 (0:00:00.083) 0:01:34.681 ***** 2021-01-27T09:39:56.974 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-01-27T09:39:57.021 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:57 +0000 (0:00:00.075) 0:01:34.757 ***** 2021-01-27T09:39:57.070 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-27T09:39:57.072 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram14', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram14", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:57.083 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram15', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram15", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:57.095 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram12', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram12", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:57.107 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram13', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram13", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:57.118 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram10', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram10", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:57.140 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram11', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram11", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:57.152 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram8', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram8", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:57.164 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram9', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram9", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:57.176 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:57.188 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram5', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:57.190 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi078.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T09:39:57.200 INFO:teuthology.task.ansible.out: 2021-01-27T09:39:57.202 INFO:teuthology.task.ansible.out:TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram6', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:57.213 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram7', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:57.224 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:57.247 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:57.258 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:57.269 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:57.573 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-01-27T09:39:57.574 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T09:39:57.611 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:57 +0000 (0:00:00.590) 0:01:35.348 ***** 2021-01-27T09:39:57.744 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-27T09:39:57.746 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-01-27T09:39:57.780 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:57 +0000 (0:00:00.168) 0:01:35.517 ***** 2021-01-27T09:39:57.936 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-01-27T09:39:57.938 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T09:39:58.045 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T09:39:58.162 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T09:39:58.284 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T09:39:58.295 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:58.343 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:58 +0000 (0:00:00.562) 0:01:36.079 ***** 2021-01-27T09:39:58.371 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-01-27T09:39:58.373 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:58.412 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:58 +0000 (0:00:00.069) 0:01:36.149 ***** 2021-01-27T09:39:58.441 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:39:58.480 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:58 +0000 (0:00:00.066) 0:01:36.216 ***** 2021-01-27T09:39:58.613 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-01-27T09:39:58.615 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T09:39:58.656 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:58 +0000 (0:00:00.177) 0:01:36.393 ***** 2021-01-27T09:39:58.698 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-01-27T09:39:58.700 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-01-27T09:39:58.739 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:58 +0000 (0:00:00.083) 0:01:36.476 ***** 2021-01-27T09:39:58.989 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-27T09:39:58.990 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-Wi2bvxgfDxwo1D4O9OzLZoPBnJtTBexIFCGmZQJtDcwxdvG1FL0yBFnfhI0EKE6e'], 'uuids': ['f7e4e94f-d720-42e8-ae9c-aa1b83e4ea10']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.539904", "end": "2021-01-27 09:39:59.144277", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Wi2bvxgfDxwo1D4O9OzLZoPBnJtTBexIFCGmZQJtDcwxdvG1FL0yBFnfhI0EKE6e"], "labels": [], "masters": [], "uuids": ["f7e4e94f-d720-42e8-ae9c-aa1b83e4ea10"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:39:57.604373", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T09:39:59.138 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi078.front.sepia.ceph.com] => {"changed": true} 2021-01-27T09:39:59.181 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:39:59 +0000 (0:00:00.440) 0:01:36.917 ***** 2021-01-27T09:40:00.146 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-01-27T09:40:00.148 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-01-27T09:40:00.185 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:00 +0000 (0:00:01.004) 0:01:37.922 ***** 2021-01-27T09:40:00.212 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-01-27T09:40:00.214 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:00.248 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:00 +0000 (0:00:00.063) 0:01:37.985 ***** 2021-01-27T09:40:00.276 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-01-27T09:40:00.277 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:00.317 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:00 +0000 (0:00:00.069) 0:01:38.054 ***** 2021-01-27T09:40:00.348 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-01-27T09:40:00.349 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Zap all non-root disks] *************************************** 2021-01-27T09:40:00.351 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-Wi2bvxgfDxwo1D4O9OzLZoPBnJtTBexI4drQ4NENI0UcYPtxzqGJx1O3TDaecpLy'], 'uuids': ['10974e48-c22b-42f3-9385-e1c6ee2cbd75']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.162763", "end": "2021-01-27 09:40:00.502098", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Wi2bvxgfDxwo1D4O9OzLZoPBnJtTBexI4drQ4NENI0UcYPtxzqGJx1O3TDaecpLy"], "labels": [], "masters": [], "uuids": ["10974e48-c22b-42f3-9385-e1c6ee2cbd75"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:39:59.339335", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T09:40:00.390 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:00 +0000 (0:00:00.072) 0:01:38.127 ***** 2021-01-27T09:40:00.420 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:00.456 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:00 +0000 (0:00:00.065) 0:01:38.192 ***** 2021-01-27T09:40:01.013 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-01-27T09:40:01.015 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-01-27T09:40:01.049 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:01 +0000 (0:00:00.593) 0:01:38.786 ***** 2021-01-27T09:40:01.653 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-01-27T09:40:01.655 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T09:40:01.690 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:01 +0000 (0:00:00.640) 0:01:39.427 ***** 2021-01-27T09:40:01.720 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-27T09:40:01.721 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-Wi2bvxgfDxwo1D4O9OzLZoPBnJtTBexIlkNFL77b6cOoMRArxo17zhNBERB87WAg'], 'uuids': ['c31fcdcd-785a-42c5-9ff8-8bcb7f609ec7']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.176522", "end": "2021-01-27 09:40:01.868454", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Wi2bvxgfDxwo1D4O9OzLZoPBnJtTBexIlkNFL77b6cOoMRArxo17zhNBERB87WAg"], "labels": [], "masters": [], "uuids": ["c31fcdcd-785a-42c5-9ff8-8bcb7f609ec7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:40:00.691932", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T09:40:03.066 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-Wi2bvxgfDxwo1D4O9OzLZoPBnJtTBexIVnYc6ozfDkI5FPCdodikHv2R93zdgpA9'], 'uuids': ['515a6e6f-5855-46ac-b77d-0e06f7bb310b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.162820", "end": "2021-01-27 09:40:03.216842", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Wi2bvxgfDxwo1D4O9OzLZoPBnJtTBexIVnYc6ozfDkI5FPCdodikHv2R93zdgpA9"], "labels": [], "masters": [], "uuids": ["515a6e6f-5855-46ac-b77d-0e06f7bb310b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:40:02.054022", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T09:40:03.129 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-01-27T09:40:03.131 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-01-27T09:40:03.165 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:03 +0000 (0:00:01.474) 0:01:40.901 ***** 2021-01-27T09:40:04.425 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-Wi2bvxgfDxwo1D4O9OzLZoPBnJtTBexId5EJSP3iKEGqWAbcAVQLqsyZmm43qJMB'], 'uuids': ['aab3c0e2-75df-4d82-ad62-b20d6a9ea463']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.159438", "end": "2021-01-27 09:40:04.567070", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Wi2bvxgfDxwo1D4O9OzLZoPBnJtTBexId5EJSP3iKEGqWAbcAVQLqsyZmm43qJMB"], "labels": [], "masters": [], "uuids": ["aab3c0e2-75df-4d82-ad62-b20d6a9ea463"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:40:03.407632", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now 2021-01-27T09:40:04.428 INFO:teuthology.task.ansible.out:partition the disk using fdisk or", "other utilities."]} 2021-01-27T09:40:04.437 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFPH', 'wwn-0x5000c50092925063'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFPH-part1', 'wwn-0x5000c50092925063-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092925063', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XFPH', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPH", "wwn-0x5000c50092925063"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPH-part1", "wwn-0x5000c50092925063-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFPH", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092925063"}}, 2021-01-27T09:40:04.438 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-01-27T09:40:04.449 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:04.460 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:04.461 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:04.494 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:04.496 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:04.507 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:04.519 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:04.703 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-01-27T09:40:04.741 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:04 +0000 (0:00:01.576) 0:01:42.478 ***** 2021-01-27T09:40:05.874 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-27T09:40:05.877 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-l8dn7w-wSNB-OHCf-osfj-ifOO-Vmu9-2G2WXi', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300GB400BGN', 'nvme-nvme.8086-43564654363233333030474234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.162132", "end": "2021-01-27 09:40:06.026384", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-l8dn7w-wSNB-OHCf-osfj-ifOO-Vmu9-2G2WXi", "nvme-INTEL_SSDPEDMD400G4_CVFT623300GB400BGN", "nvme-nvme.8086-43564654363233333030474234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:40:04.864252", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-01-27T09:40:05.878 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T09:40:05.940 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:05 +0000 (0:00:01.198) 0:01:43.676 ***** 2021-01-27T09:40:05.990 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-27T09:40:05.992 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram14', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram14", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:06.003 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram15', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram15", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:06.016 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram12', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram12", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:06.028 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram13', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram13", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:06.052 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram10', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram10", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:06.065 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram11', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram11", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:06.077 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram8', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram8", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:06.099 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram9', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram9", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:06.111 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:06.122 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram5', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:06.134 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram6', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:06.146 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram7', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:06.168 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:06.180 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:06.194 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:06.206 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'ram3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '131072', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '64.00 MB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ram3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "131072", "sectorsize": "512", "size": "64.00 MB", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:07.276 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-01-27T09:40:07.278 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"cache_update_time": 1611740324, "cache_updated": false, "changed": false} 2021-01-27T09:40:07.314 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:07 +0000 (0:00:01.374) 0:01:45.051 ***** 2021-01-27T09:40:08.211 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-27T09:40:08.213 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-Wi2bvxgfDxwo1D4O9OzLZoPBnJtTBexIFCGmZQJtDcwxdvG1FL0yBFnfhI0EKE6e'], 'uuids': ['f7e4e94f-d720-42e8-ae9c-aa1b83e4ea10']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:01.811073", "end": "2021-01-27 09:40:08.361496", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Wi2bvxgfDxwo1D4O9OzLZoPBnJtTBexIFCGmZQJtDcwxdvG1FL0yBFnfhI0EKE6e"], "labels": [], "masters": [], "uuids": ["f7e4e94f-d720-42e8-ae9c-aa1b83e4ea10"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:40:06.550423", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 1.79416 s, 64.3 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 1.79416 s, 64.3 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:40:08.540 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-01-27T09:40:08.543 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.745866", "end": "2021-01-27 09:40:08.446129", "rc": 0, "start": "2021-01-27 09:40:07.700263", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-01-27T09:40:08.582 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:08 +0000 (0:00:01.267) 0:01:46.318 ***** 2021-01-27T09:40:08.610 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-01-27T09:40:08.612 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:08.646 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:08 +0000 (0:00:00.064) 0:01:46.383 ***** 2021-01-27T09:40:08.684 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:08.720 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:08 +0000 (0:00:00.074) 0:01:46.457 ***** 2021-01-27T09:40:09.655 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-01-27T09:40:09.657 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"cache_update_time": 1611740324, "cache_updated": false, "changed": false} 2021-01-27T09:40:09.694 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:09 +0000 (0:00:00.973) 0:01:47.431 ***** 2021-01-27T09:40:09.722 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-01-27T09:40:09.724 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:09.761 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:09 +0000 (0:00:00.067) 0:01:47.498 ***** 2021-01-27T09:40:10.067 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-01-27T09:40:10.068 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-01-27T09:40:10.102 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:10 +0000 (0:00:00.341) 0:01:47.839 ***** 2021-01-27T09:40:10.130 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-01-27T09:40:10.131 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:10.167 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:10 +0000 (0:00:00.064) 0:01:47.904 ***** 2021-01-27T09:40:10.221 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-27T09:40:10.222 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-Wi2bvxgfDxwo1D4O9OzLZoPBnJtTBexI4drQ4NENI0UcYPtxzqGJx1O3TDaecpLy'], 'uuids': ['10974e48-c22b-42f3-9385-e1c6ee2cbd75']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:01.832260", "end": "2021-01-27 09:40:10.377741", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Wi2bvxgfDxwo1D4O9OzLZoPBnJtTBexI4drQ4NENI0UcYPtxzqGJx1O3TDaecpLy"], "labels": [], "masters": [], "uuids": ["10974e48-c22b-42f3-9385-e1c6ee2cbd75"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:40:08.545481", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 1.81795 s, 63.4 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 1.81795 s, 63.4 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:40:10.381 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-01-27T09:40:10.382 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 09:34:19 UTC", "ActiveEnterTimestampMonotonic": "14930368", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service sysinit.target network.target system.slice -.mount basic.target systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 09:34:18 UTC", "AssertTimestampMonotonic": "14535572", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 09:34:18 UTC", "ConditionTimestampMonotonic": "14535572", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-01-27T09:40:10.384 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "884", "ExecMainStartTimestamp": "Wed 2021-01-27 09:34:19 UTC", "ExecMainStartTimestampMonotonic": "14930347", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 09:34:18 UTC", "InactiveExitTimestampMonotonic": "14536463", "InvocationID": "660a9ededdf542dbbba14f5daf74c60b", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-01-27T09:40:10.386 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127780", "LimitNPROCSoft": "127780", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127780", "LimitSIGPENDINGSoft": "127780", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "884", "MemoryAccounting": "yes", "MemoryCurrent": "3735552", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "Requi 2021-01-27T09:40:10.388 INFO:teuthology.task.ansible.out:resMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 09:34:19 UTC", "StateChangeTimestampMonotonic": "14930368", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38334", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T09:40:10.425 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:10 +0000 (0:00:00.258) 0:01:48.162 ***** 2021-01-27T09:40:10.453 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:40:10.455 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-01-27T09:40:10.494 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:10 +0000 (0:00:00.068) 0:01:48.230 ***** 2021-01-27T09:40:10.536 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi078.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-01-27T09:40:10.573 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:10 +0000 (0:00:00.079) 0:01:48.309 ***** 2021-01-27T09:40:10.599 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-01-27T09:40:10.601 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:10.638 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:10 +0000 (0:00:00.064) 0:01:48.374 ***** 2021-01-27T09:40:11.779 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-01-27T09:40:11.782 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"cache_update_time": 1611740324, "cache_updated": false, "changed": false} 2021-01-27T09:40:11.834 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:11 +0000 (0:00:01.196) 0:01:49.571 ***** 2021-01-27T09:40:11.873 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-01-27T09:40:11.875 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:11.919 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:11 +0000 (0:00:00.084) 0:01:49.655 ***** 2021-01-27T09:40:12.113 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-01-27T09:40:12.115 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-01-27T09:40:12.162 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:12 +0000 (0:00:00.243) 0:01:49.898 ***** 2021-01-27T09:40:12.213 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-27T09:40:12.215 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-Wi2bvxgfDxwo1D4O9OzLZoPBnJtTBexIlkNFL77b6cOoMRArxo17zhNBERB87WAg'], 'uuids': ['c31fcdcd-785a-42c5-9ff8-8bcb7f609ec7']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:01.809084", "end": "2021-01-27 09:40:12.364808", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Wi2bvxgfDxwo1D4O9OzLZoPBnJtTBexIlkNFL77b6cOoMRArxo17zhNBERB87WAg"], "labels": [], "masters": [], "uuids": ["c31fcdcd-785a-42c5-9ff8-8bcb7f609ec7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:40:10.555724", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 1.79253 s, 64.3 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 1.79253 s, 64.3 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:40:12.613 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-01-27T09:40:12.615 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-01-27T09:40:12.652 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:12 +0000 (0:00:00.490) 0:01:50.389 ***** 2021-01-27T09:40:14.222 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-27T09:40:14.225 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-Wi2bvxgfDxwo1D4O9OzLZoPBnJtTBexIVnYc6ozfDkI5FPCdodikHv2R93zdgpA9'], 'uuids': ['515a6e6f-5855-46ac-b77d-0e06f7bb310b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:01.835304", "end": "2021-01-27 09:40:14.376552", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Wi2bvxgfDxwo1D4O9OzLZoPBnJtTBexIVnYc6ozfDkI5FPCdodikHv2R93zdgpA9"], "labels": [], "masters": [], "uuids": ["515a6e6f-5855-46ac-b77d-0e06f7bb310b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:40:12.541248", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 1.81935 s, 63.4 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 1.81935 s, 63.4 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:40:15.616 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-01-27T09:40:15.618 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-01-27T09:40:15.653 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:15 +0000 (0:00:03.000) 0:01:53.389 ***** 2021-01-27T09:40:16.183 INFO:teuthology.task.ansible.out: 2021-01-27T09:40:16.184 INFO:teuthology.task.ansible.out:TASK [testnode : Purge resolvconf] ********************************************* 2021-01-27T09:40:16.185 INFO:teuthology.task.ansible.out: ok: [smithi078.front.sepia.ceph.com] => {"changed": false} 2021-01-27T09:40:16.225 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:16 +0000 (0:00:00.572) 0:01:53.962 ***** 2021-01-27T09:40:16.234 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-27T09:40:16.236 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-Wi2bvxgfDxwo1D4O9OzLZoPBnJtTBexId5EJSP3iKEGqWAbcAVQLqsyZmm43qJMB'], 'uuids': ['aab3c0e2-75df-4d82-ad62-b20d6a9ea463']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:01.814135", "end": "2021-01-27 09:40:16.367394", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Wi2bvxgfDxwo1D4O9OzLZoPBnJtTBexId5EJSP3iKEGqWAbcAVQLqsyZmm43qJMB"], "labels": [], "masters": [], "uuids": ["aab3c0e2-75df-4d82-ad62-b20d6a9ea463"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:40:14.553259", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 1.8 s, 64.1 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 1.8 s, 64.1 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:40:16.236 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFPH', 'wwn-0x5000c50092925063'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': 2021-01-27T09:40:16.238 INFO:teuthology.task.ansible.out: [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFPH-part1', 'wwn-0x5000c50092925063-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092925063', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XFPH', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPH", "wwn-0x5000c50092925063"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPH-part1", "wwn-0x5000c50092925063-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFPH", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092925063"}}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model' 2021-01-27T09:40:16.239 INFO:teuthology.task.ansible.out:: None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:16.249 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:16.250 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:16.255 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:16.257 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:16.259 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi078.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-01-27T09:40:16.301 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:16 +0000 (0:00:00.075) 0:01:54.037 ***** 2021-01-27T09:40:16.315 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:16.317 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:16.500 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-01-27T09:40:16.501 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1611740081.6867378, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1611740081.6827378, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 67510, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1611740081.6827378, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1828121574", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-01-27T09:40:16.536 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:16 +0000 (0:00:00.235) 0:01:54.273 ***** 2021-01-27T09:40:16.946 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-27T09:40:16.947 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-l8dn7w-wSNB-OHCf-osfj-ifOO-Vmu9-2G2WXi', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300GB400BGN', 'nvme-nvme.8086-43564654363233333030474234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.480377", "end": "2021-01-27 09:40:17.100329", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-l8dn7w-wSNB-OHCf-osfj-ifOO-Vmu9-2G2WXi", "nvme-INTEL_SSDPEDMD400G4_CVFT623300GB400BGN", "nvme-nvme.8086-43564654363233333030474234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 09:40:16.619952", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.466361 s, 247 MB/s", "stde 2021-01-27T09:40:16.949 INFO:teuthology.task.ansible.out:rr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.466361 s, 247 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T09:40:17.027 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:17 +0000 (0:00:00.490) 0:01:54.763 ***** 2021-01-27T09:40:17.034 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-01-27T09:40:17.036 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-01-27T09:40:17.076 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:17 +0000 (0:00:00.049) 0:01:54.813 ***** 2021-01-27T09:40:17.119 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-01-27T09:40:17.121 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-01-27T09:40:17.157 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:17 +0000 (0:00:00.080) 0:01:54.893 ***** 2021-01-27T09:40:17.185 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-01-27T09:40:17.187 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:17.225 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:17 +0000 (0:00:00.068) 0:01:54.962 ***** 2021-01-27T09:40:17.413 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-01-27T09:40:17.414 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-01-27T09:40:17.450 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:17 +0000 (0:00:00.224) 0:01:55.187 ***** 2021-01-27T09:40:17.452 INFO:teuthology.task.ansible.out: 2021-01-27T09:40:17.638 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-01-27T09:40:17.640 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-01-27T09:40:17.676 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:17 +0000 (0:00:00.225) 0:01:55.412 ***** 2021-01-27T09:40:17.702 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-01-27T09:40:17.704 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:17.739 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:17 +0000 (0:00:00.063) 0:01:55.476 ***** 2021-01-27T09:40:17.792 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-01-27T09:40:17.794 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-01-27T09:40:17.804 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-01-27T09:40:17.805 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-01-27T09:40:17.805 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-01-27T09:40:17.864 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:17 +0000 (0:00:00.124) 0:01:55.601 ***** 2021-01-27T09:40:17.907 INFO:teuthology.task.ansible.out: 2021-01-27T09:40:17.909 INFO:teuthology.task.ansible.out:TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi078.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi078.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:17.920 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:17.921 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:17.934 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:17.971 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:17 +0000 (0:00:00.107) 0:01:55.708 ***** 2021-01-27T09:40:17.999 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:40:18.000 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:18.041 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:18 +0000 (0:00:00.070) 0:01:55.778 ***** 2021-01-27T09:40:18.069 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-01-27T09:40:18.070 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:18.107 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:18 +0000 (0:00:00.065) 0:01:55.843 ***** 2021-01-27T09:40:18.134 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-01-27T09:40:18.136 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:18.175 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:18 +0000 (0:00:00.068) 0:01:55.912 ***** 2021-01-27T09:40:18.203 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-01-27T09:40:18.205 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:18.245 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:18 +0000 (0:00:00.069) 0:01:55.982 ***** 2021-01-27T09:40:18.272 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-01-27T09:40:18.274 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:18.313 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:18 +0000 (0:00:00.067) 0:01:56.050 ***** 2021-01-27T09:40:18.342 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-01-27T09:40:18.344 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:18.383 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:18 +0000 (0:00:00.070) 0:01:56.120 ***** 2021-01-27T09:40:18.412 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-01-27T09:40:18.413 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:18.449 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:18 +0000 (0:00:00.066) 0:01:56.186 ***** 2021-01-27T09:40:18.477 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-01-27T09:40:18.478 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:18.517 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:18 +0000 (0:00:00.067) 0:01:56.253 ***** 2021-01-27T09:40:18.723 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-01-27T09:40:18.725 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010784", "end": "2021-01-27 09:40:18.693319", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-01-27 09:40:18.682535", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:40:18.902 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006092", "end": "2021-01-27 09:40:18.873278", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-01-27 09:40:18.867186", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:40:18.955 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-01-27T09:40:18.957 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:01.732830", "end": "2021-01-27 09:40:19.107548", "rc": 0, "start": "2021-01-27 09:40:17.374718", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:40:18.999 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:18 +0000 (0:00:00.482) 0:01:56.736 ***** 2021-01-27T09:40:19.060 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-01-27T09:40:19.061 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005507", "end": "2021-01-27 09:40:19.037179", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-01-27 09:40:19.031672", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-01-27T09:40:19.238 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.017369", "end": "2021-01-27 09:40:19.211287", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-01-27 09:40:19.193918", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:40:19.240 INFO:teuthology.task.ansible.out: 2021-01-27T09:40:19.280 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:19 +0000 (0:00:00.281) 0:01:57.017 ***** 2021-01-27T09:40:19.310 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-01-27T09:40:19.349 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:19 +0000 (0:00:00.068) 0:01:57.086 ***** 2021-01-27T09:40:19.495 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-01-27T09:40:19.497 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.300697", "end": "2021-01-27 09:40:19.656832", "rc": 0, "start": "2021-01-27 09:40:19.356135", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:40:19.546 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:19 +0000 (0:00:00.196) 0:01:57.282 ***** 2021-01-27T09:40:19.553 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-01-27T09:40:19.554 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-01-27T09:40:19.591 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-01-27T09:40:19.661 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:19 +0000 (0:00:00.115) 0:01:57.398 ***** 2021-01-27T09:40:19.688 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:19.736 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:19 +0000 (0:00:00.074) 0:01:57.472 ***** 2021-01-27T09:40:19.765 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:19.808 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:19 +0000 (0:00:00.072) 0:01:57.544 ***** 2021-01-27T09:40:19.835 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-27T09:40:19.836 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:19.880 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:19 +0000 (0:00:00.071) 0:01:57.616 ***** 2021-01-27T09:40:19.907 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-01-27T09:40:19.909 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:19.949 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:19 +0000 (0:00:00.069) 0:01:57.686 ***** 2021-01-27T09:40:20.135 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-01-27T09:40:20.136 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T09:40:20.176 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:20 +0000 (0:00:00.227) 0:01:57.913 ***** 2021-01-27T09:40:20.224 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-27T09:40:20.226 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'block_used': 14312482, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 225782626, 'size_available': 924805636096, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 134765, 'block_size': 4096, 'inode_available': 60920211}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 225782626, "block_size": 4096, "block_total": 240095108, "block_used": 14312482, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60920211, "inode_total": 61054976, "inode_used": 134765, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 924805636096, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:20.271 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:20 +0000 (0:00:00.094) 0:01:58.008 ***** 2021-01-27T09:40:20.298 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-01-27T09:40:20.300 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:20.343 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:20 +0000 (0:00:00.071) 0:01:58.080 ***** 2021-01-27T09:40:20.372 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:40:20.373 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:20.414 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:20 +0000 (0:00:00.071) 0:01:58.151 ***** 2021-01-27T09:40:20.441 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:40:20.443 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:20.488 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:20 +0000 (0:00:00.073) 0:01:58.224 ***** 2021-01-27T09:40:20.516 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-01-27T09:40:20.518 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:20.559 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:20 +0000 (0:00:00.071) 0:01:58.295 ***** 2021-01-27T09:40:20.585 INFO:teuthology.task.ansible.out: 2021-01-27T09:40:20.587 INFO:teuthology.task.ansible.out:TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:20.632 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:20 +0000 (0:00:00.073) 0:01:58.369 ***** 2021-01-27T09:40:20.659 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-01-27T09:40:20.661 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:20.701 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:20 +0000 (0:00:00.069) 0:01:58.438 ***** 2021-01-27T09:40:21.471 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-01-27T09:40:21.472 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-01-27T09:40:21.520 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:21 +0000 (0:00:00.818) 0:01:59.257 ***** 2021-01-27T09:40:22.141 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-01-27T09:40:22.143 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T09:40:22.731 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T09:40:23.316 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T09:40:23.949 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T09:40:24.527 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T09:40:24.573 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:24 +0000 (0:00:03.053) 0:02:02.310 ***** 2021-01-27T09:40:24.762 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-27T09:40:24.764 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-01-27T09:40:24.807 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:24 +0000 (0:00:00.233) 0:02:02.544 ***** 2021-01-27T09:40:25.025 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-01-27T09:40:25.027 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T09:40:25.182 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T09:40:25.351 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T09:40:25.508 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T09:40:25.518 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:25.563 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:25 +0000 (0:00:00.755) 0:02:03.299 ***** 2021-01-27T09:40:25.590 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:25.631 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:25 +0000 (0:00:00.068) 0:02:03.367 ***** 2021-01-27T09:40:25.657 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-01-27T09:40:25.659 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:25.698 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:25 +0000 (0:00:00.067) 0:02:03.435 ***** 2021-01-27T09:40:25.902 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-01-27T09:40:25.904 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T09:40:25.946 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:25 +0000 (0:00:00.248) 0:02:03.683 ***** 2021-01-27T09:40:25.983 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-01-27T09:40:25.985 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-01-27T09:40:26.026 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:26 +0000 (0:00:00.079) 0:02:03.763 ***** 2021-01-27T09:40:26.376 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-01-27T09:40:26.378 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true} 2021-01-27T09:40:26.419 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:26 +0000 (0:00:00.392) 0:02:04.156 ***** 2021-01-27T09:40:26.768 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-01-27T09:40:26.813 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:26 +0000 (0:00:00.393) 0:02:04.549 ***** 2021-01-27T09:40:26.839 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-01-27T09:40:26.841 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:26.884 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:26 +0000 (0:00:00.070) 0:02:04.620 ***** 2021-01-27T09:40:26.911 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-01-27T09:40:26.913 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:26.956 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:26 +0000 (0:00:00.072) 0:02:04.693 ***** 2021-01-27T09:40:26.985 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-01-27T09:40:26.988 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:27.040 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:27 +0000 (0:00:00.083) 0:02:04.776 ***** 2021-01-27T09:40:27.078 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-01-27T09:40:27.080 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:27.187 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:27 +0000 (0:00:00.147) 0:02:04.924 ***** 2021-01-27T09:40:27.412 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-01-27T09:40:27.413 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-01-27T09:40:27.462 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:27 +0000 (0:00:00.273) 0:02:05.197 ***** 2021-01-27T09:40:27.694 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-01-27T09:40:27.696 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T09:40:27.763 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:27 +0000 (0:00:00.302) 0:02:05.500 ***** 2021-01-27T09:40:28.368 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-01-27T09:40:28.370 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-01-27T09:40:28.414 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:28 +0000 (0:00:00.650) 0:02:06.151 ***** 2021-01-27T09:40:28.954 INFO:teuthology.task.ansible.out: 2021-01-27T09:40:28.956 INFO:teuthology.task.ansible.out:TASK [testnode : Upload CPAN config for root.] ********************************* ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-01-27T09:40:28.998 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:28 +0000 (0:00:00.584) 0:02:06.735 ***** 2021-01-27T09:40:29.000 INFO:teuthology.task.ansible.out: 2021-01-27T09:40:29.841 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-01-27T09:40:29.843 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"cache_update_time": 1611740325, "cache_updated": false, "changed": false} 2021-01-27T09:40:29.885 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:29 +0000 (0:00:00.886) 0:02:07.622 ***** 2021-01-27T09:40:30.217 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-01-27T09:40:30.219 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.137316", "end": "2021-01-27 09:40:30.379359", "rc": 0, "start": "2021-01-27 09:40:30.242043", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-01-27T09:40:30.260 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:30 +0000 (0:00:00.374) 0:02:07.996 ***** 2021-01-27T09:40:30.296 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-01-27T09:40:30.298 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:30.339 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:30 +0000 (0:00:00.079) 0:02:08.076 ***** 2021-01-27T09:40:30.366 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:30.410 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:30 +0000 (0:00:00.071) 0:02:08.147 ***** 2021-01-27T09:40:31.265 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** ok: [smithi146.front.sepia.ceph.com] => {"cache_update_time": 1611740325, "cache_updated": false, "changed": false} 2021-01-27T09:40:31.309 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:31 +0000 (0:00:00.898) 0:02:09.046 ***** 2021-01-27T09:40:31.337 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-01-27T09:40:31.339 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:31.385 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:31 +0000 (0:00:00.076) 0:02:09.122 ***** 2021-01-27T09:40:31.875 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-01-27T09:40:31.878 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-01-27T09:40:31.917 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:31 +0000 (0:00:00.532) 0:02:09.654 ***** 2021-01-27T09:40:31.944 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-01-27T09:40:31.947 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:32.009 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:32 +0000 (0:00:00.092) 0:02:09.746 ***** 2021-01-27T09:40:32.345 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-01-27T09:40:32.346 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 09:37:46 UTC", "ActiveEnterTimestampMonotonic": "15466936", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service sysinit.target network.target -.mount basic.target systemd-journald.socket system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 09:37:46 UTC", "AssertTimestampMonotonic": "15325921", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read 0x26 0x27 0x28", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 09:37:46 UTC", "ConditionTimestampMonotonic": "15325920", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", 2021-01-27T09:40:32.348 INFO:teuthology.task.ansible.out:"ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "827", "ExecMainStartTimestamp": "Wed 2021-01-27 09:37:46 UTC", "ExecMainStartTimestampMonotonic": "15466890", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 09:37:46 UTC", "InactiveExitTimestampMonotonic": "15329235", "InvocationID": "9118faf2c12c43cda92a0a97e7569cf4", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": " 2021-01-27T09:40:32.349 INFO:teuthology.task.ansible.out:infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127767", "LimitNPROCSoft": "127767", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127767", "LimitSIGPENDINGSoft": "127767", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "827", "MemoryAccounting": "yes", "MemoryCurrent": "2146304", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system 2021-01-27T09:40:32.351 INFO:teuthology.task.ansible.out:.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 09:37:46 UTC", "StateChangeTimestampMonotonic": "15466936", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "38330", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T09:40:32.387 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:32 +0000 (0:00:00.378) 0:02:10.124 ***** 2021-01-27T09:40:32.419 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:40:32.420 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-01-27T09:40:32.464 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:32 +0000 (0:00:00.076) 0:02:10.201 ***** 2021-01-27T09:40:32.511 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:40:32.513 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-01-27T09:40:32.558 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:32 +0000 (0:00:00.093) 0:02:10.295 ***** 2021-01-27T09:40:32.586 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-01-27T09:40:32.587 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:32.630 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:32 +0000 (0:00:00.071) 0:02:10.366 ***** 2021-01-27T09:40:34.096 INFO:teuthology.task.ansible.out: 2021-01-27T09:40:34.098 INFO:teuthology.task.ansible.out:TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi146.front.sepia.ceph.com] => {"cache_update_time": 1611740325, "cache_updated": false, "changed": false} 2021-01-27T09:40:34.142 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:34 +0000 (0:00:01.512) 0:02:11.879 ***** 2021-01-27T09:40:34.170 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-01-27T09:40:34.172 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:34.211 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:34 +0000 (0:00:00.068) 0:02:11.948 ***** 2021-01-27T09:40:34.479 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-01-27T09:40:34.481 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-01-27T09:40:34.528 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:34 +0000 (0:00:00.316) 0:02:12.264 ***** 2021-01-27T09:40:35.198 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-01-27T09:40:35.200 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-01-27T09:40:35.260 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:35 +0000 (0:00:00.732) 0:02:12.997 ***** 2021-01-27T09:40:37.973 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-01-27T09:40:37.975 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-01-27T09:40:38.017 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:38 +0000 (0:00:02.757) 0:02:15.754 ***** 2021-01-27T09:40:38.702 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-01-27T09:40:38.704 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false} 2021-01-27T09:40:38.742 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:38 +0000 (0:00:00.725) 0:02:16.479 ***** 2021-01-27T09:40:38.782 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-01-27T09:40:38.784 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-01-27T09:40:38.826 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:38 +0000 (0:00:00.083) 0:02:16.563 ***** 2021-01-27T09:40:39.126 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-01-27T09:40:39.128 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1611740099.726206, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1611740098.402206, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 67510, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1611740098.402206, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1828121574", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-01-27T09:40:39.170 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:39 +0000 (0:00:00.343) 0:02:16.906 ***** 2021-01-27T09:40:39.428 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-01-27T09:40:39.430 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-01-27T09:40:39.470 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:39 +0000 (0:00:00.300) 0:02:17.207 ***** 2021-01-27T09:40:39.497 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-01-27T09:40:39.499 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-01-27T09:40:39.538 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:39 +0000 (0:00:00.067) 0:02:17.275 ***** 2021-01-27T09:40:39.565 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-01-27T09:40:39.567 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:39.606 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:39 +0000 (0:00:00.067) 0:02:17.343 ***** 2021-01-27T09:40:39.864 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-01-27T09:40:39.865 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-01-27T09:40:39.930 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:39 +0000 (0:00:00.324) 0:02:17.667 ***** 2021-01-27T09:40:40.181 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-01-27T09:40:40.183 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-01-27T09:40:40.226 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:40 +0000 (0:00:00.295) 0:02:17.962 ***** 2021-01-27T09:40:40.253 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-01-27T09:40:40.255 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:40.298 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:40 +0000 (0:00:00.072) 0:02:18.035 ***** 2021-01-27T09:40:40.336 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-01-27T09:40:40.339 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-01-27T09:40:40.347 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-01-27T09:40:40.358 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-01-27T09:40:40.360 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-01-27T09:40:40.369 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-01-27T09:40:40.412 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:40 +0000 (0:00:00.113) 0:02:18.148 ***** 2021-01-27T09:40:40.451 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-01-27T09:40:40.453 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:40.463 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:40.475 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:40.487 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:40.489 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:40.534 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:40 +0000 (0:00:00.122) 0:02:18.271 ***** 2021-01-27T09:40:40.565 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T09:40:40.567 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:40.625 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:40 +0000 (0:00:00.090) 0:02:18.362 ***** 2021-01-27T09:40:40.654 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-01-27T09:40:40.656 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:40.703 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:40 +0000 (0:00:00.077) 0:02:18.439 ***** 2021-01-27T09:40:40.731 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-01-27T09:40:40.733 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:40.777 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:40 +0000 (0:00:00.074) 0:02:18.514 ***** 2021-01-27T09:40:40.805 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-01-27T09:40:40.807 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:40.846 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:40 +0000 (0:00:00.068) 0:02:18.583 ***** 2021-01-27T09:40:40.873 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-01-27T09:40:40.875 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:40.920 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:40 +0000 (0:00:00.073) 0:02:18.656 ***** 2021-01-27T09:40:40.947 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-01-27T09:40:40.949 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:41.008 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:41 +0000 (0:00:00.087) 0:02:18.744 ***** 2021-01-27T09:40:41.048 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-01-27T09:40:41.050 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:41.114 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:41 +0000 (0:00:00.106) 0:02:18.850 ***** 2021-01-27T09:40:41.142 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-01-27T09:40:41.144 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:41.187 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:41 +0000 (0:00:00.073) 0:02:18.924 ***** 2021-01-27T09:40:41.500 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-01-27T09:40:41.501 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.029201", "end": "2021-01-27 09:40:41.641598", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-01-27 09:40:41.612397", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:40:41.774 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.042587", "end": "2021-01-27 09:40:41.927423", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-01-27 09:40:41.884836", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:40:41.776 INFO:teuthology.task.ansible.out: 2021-01-27T09:40:42.046 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.018696", "end": "2021-01-27 09:40:42.196323", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-01-27 09:40:42.177627", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-01-27T09:40:42.333 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.034947", "end": "2021-01-27 09:40:42.481429", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-01-27 09:40:42.446482", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:40:42.378 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:42 +0000 (0:00:01.190) 0:02:20.115 ***** 2021-01-27T09:40:42.409 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-01-27T09:40:42.454 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:42 +0000 (0:00:00.076) 0:02:20.191 ***** 2021-01-27T09:40:42.708 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-01-27T09:40:42.710 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-01-27T09:40:42.835 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-01-27T09:40:42.870 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:42 +0000 (0:00:00.415) 0:02:20.607 ***** 2021-01-27T09:40:42.910 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:42 +0000 (0:00:00.040) 0:02:20.647 ***** 2021-01-27T09:40:43.924 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi078.front.sepia.ceph.com] 2021-01-27T09:40:44.007 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:44 +0000 (0:00:01.096) 0:02:21.744 ***** 2021-01-27T09:40:44.046 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-27T09:40:44.048 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-01-27T09:40:44.089 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:44 +0000 (0:00:00.081) 0:02:21.825 ***** 2021-01-27T09:40:44.117 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-27T09:40:44.119 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:44.156 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:44 +0000 (0:00:00.067) 0:02:21.892 ***** 2021-01-27T09:40:44.216 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** ok: [smithi078.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-01-27T09:40:44.257 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:44 +0000 (0:00:00.101) 0:02:21.994 ***** 2021-01-27T09:40:44.961 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-01-27T09:40:44.963 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] 2021-01-27T09:40:45.014 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-01-27T09:40:45.016 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"cache_update_time": 1611740324, "cache_updated": false, "changed": false} 2021-01-27T09:40:45.052 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:45 +0000 (0:00:00.794) 0:02:22.788 ***** 2021-01-27T09:40:45.093 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:45 +0000 (0:00:00.041) 0:02:22.830 ***** 2021-01-27T09:40:45.101 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-27T09:40:45.102 INFO:teuthology.task.ansible.out:skipping: [smithi078.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:45.148 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:45 +0000 (0:00:00.055) 0:02:22.885 ***** 2021-01-27T09:40:45.159 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-27T09:40:45.234 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} Wednesday 27 January 2021 09:40:45 +0000 (0:00:00.073) 0:02:22.959 ***** TASK [container-host : set_fact] *********************************************** ok: [smithi078.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-01-27T09:40:45.277 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:45 +0000 (0:00:00.054) 0:02:23.014 ***** 2021-01-27T09:40:45.283 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-27T09:40:45.285 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:45.452 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:45 +0000 (0:00:00.175) 0:02:23.189 ***** 2021-01-27T09:40:45.491 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** ok: [smithi146.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-01-27T09:40:45.534 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:45 +0000 (0:00:00.081) 0:02:23.270 ***** 2021-01-27T09:40:45.654 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-01-27T09:40:45.656 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T09:40:45.824 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T09:40:45.867 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:45 +0000 (0:00:00.332) 0:02:23.603 ***** 2021-01-27T09:40:46.327 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-01-27T09:40:46.328 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611740445.9046068-149698909918313/source", "state": "file", "uid": 0} 2021-01-27T09:40:46.532 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-01-27T09:40:46.533 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"cache_update_time": 1611740325, "cache_updated": false, "changed": false} 2021-01-27T09:40:46.583 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:46 +0000 (0:00:00.716) 0:02:24.320 ***** 2021-01-27T09:40:46.610 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-27T09:40:46.612 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T09:40:46.654 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:46 +0000 (0:00:00.070) 0:02:24.391 ***** 2021-01-27T09:40:46.693 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-27T09:40:46.694 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-01-27T09:40:46.736 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:46 +0000 (0:00:00.082) 0:02:24.473 ***** 2021-01-27T09:40:46.757 INFO:teuthology.task.ansible.out: 2021-01-27T09:40:46.759 INFO:teuthology.task.ansible.out:TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** changed: [smithi078.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611740446.3392878-113463596110157/source", "state": "file", "uid": 0} 2021-01-27T09:40:46.798 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:46 +0000 (0:00:00.062) 0:02:24.535 ***** 2021-01-27T09:40:47.033 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-01-27T09:40:47.035 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T09:40:47.285 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T09:40:47.334 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:47 +0000 (0:00:00.535) 0:02:25.070 ***** 2021-01-27T09:40:48.042 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-01-27T09:40:48.044 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611740447.3716137-250698965725059/source", "state": "file", "uid": 0} 2021-01-27T09:40:48.709 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611740448.0532012-260146186727340/source", "state": "file", "uid": 0} 2021-01-27T09:40:48.757 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:48 +0000 (0:00:01.423) 0:02:26.494 ***** 2021-01-27T09:40:51.455 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-01-27T09:40:51.457 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-x4nzw0zd\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-x4nzw0zd"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-x4nzw0zd\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=9f3400c4420e7eba6022bd5552c9ed954420bb869714377fc4905de9320ad1db\n Stored in directory: /tmp/pip-ephem-wheel-cache-3u4rtv5c/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=f39b733b09eb6b21995a7cc92eacfa137b761be4d17f28923008061e9700fad6\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github. 2021-01-27T09:40:51.459 INFO:teuthology.task.ansible.out:com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-x4nzw0zd", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=9f3400c4420e7eba6022bd5552c9ed954420bb869714377fc4905de9320ad1db", " Stored in directory: /tmp/pip-ephem-wheel-cache-3u4rtv5c/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=f39b733b09eb6b21995a7cc92eacfa137b761be4d17f28923008061e9700fad6", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-01-27T09:40:51.511 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:51 +0000 (0:00:02.753) 0:02:29.247 ***** 2021-01-27T09:40:51.708 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-01-27T09:40:51.713 INFO:teuthology.task.ansible.out:ok: [smithi078.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-01-27T09:40:51.752 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:51 +0000 (0:00:00.241) 0:02:29.489 ***** 2021-01-27T09:40:52.196 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-01-27T09:40:52.197 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611740451.7952654-121237311672632/source", "state": "file", "uid": 0} 2021-01-27T09:40:52.238 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:52 +0000 (0:00:00.485) 0:02:29.975 ***** 2021-01-27T09:40:52.455 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-01-27T09:40:52.457 INFO:teuthology.task.ansible.out:changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.034255", "end": "2021-01-27 09:40:52.430292", "rc": 0, "start": "2021-01-27 09:40:52.396037", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:40:52.495 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:52 +0000 (0:00:00.256) 0:02:30.231 ***** 2021-01-27T09:40:54.722 INFO:teuthology.task.ansible.out: 2021-01-27T09:40:54.726 INFO:teuthology.task.ansible.out:TASK [container-host : Install registries-conf-ctl] **************************** changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-v0_xk4sh\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-v0_xk4sh"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-v0_xk4sh\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=bccf2d2cff4e7b640466b07a7790658112cefdd9c5d2c665b60b946068b11abd\n Stored in directory: /tmp/pip-ephem-wheel-cache-xhlj03yh/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=cda0fda82d95e343640ab7d8bd9dd5c29a079d4c7346d207dcaf583cf9a324e6\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 regist 2021-01-27T09:40:54.728 INFO:teuthology.task.ansible.out:ries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-v0_xk4sh", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=bccf2d2cff4e7b640466b07a7790658112cefdd9c5d2c665b60b946068b11abd", " Stored in directory: /tmp/pip-ephem-wheel-cache-xhlj03yh/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=cda0fda82d95e343640ab7d8bd9dd5c29a079d4c7346d207dcaf583cf9a324e6", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-01-27T09:40:54.785 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:54 +0000 (0:00:02.289) 0:02:32.521 ***** 2021-01-27T09:40:55.048 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-01-27T09:40:55.050 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-01-27T09:40:55.103 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:55 +0000 (0:00:00.319) 0:02:32.840 ***** 2021-01-27T09:40:55.566 INFO:teuthology.task.ansible.out: 2021-01-27T09:40:55.567 INFO:teuthology.task.ansible.out:TASK [container-host : Restart docker service] ********************************* 2021-01-27T09:40:55.569 INFO:teuthology.task.ansible.out: changed: [smithi078.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "network-online.target docker.socket systemd-journald.socket firewalld.service basic.target sysinit.target containerd.service system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-f 2021-01-27T09:40:55.571 INFO:teuthology.task.ansible.out:irewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15" 2021-01-27T09:40:55.573 INFO:teuthology.task.ansible.out:, "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127780", "LimitSIGPENDINGSoft": "127780", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success 2021-01-27T09:40:55.574 INFO:teuthology.task.ansible.out:", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target docker.socket system.slice", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 09:34:49 UTC", "StateChangeTimestampMonotonic": "45434648", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T09:40:55.817 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611740455.155875-229736849691422/source", "state": "file", "uid": 0} 2021-01-27T09:40:55.861 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:55 +0000 (0:00:00.757) 0:02:33.598 ***** 2021-01-27T09:40:56.183 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-01-27T09:40:56.185 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.050489", "end": "2021-01-27 09:40:56.336250", "rc": 0, "start": "2021-01-27 09:40:56.285761", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T09:40:56.227 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 09:40:56 +0000 (0:00:00.365) 0:02:33.964 ***** 2021-01-27T09:41:00.710 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-01-27T09:41:00.711 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "containerd.service network-online.target sysinit.target docker.socket systemd-journald.socket firewalld.service system.slice basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read 0x26 0x27 0x28", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devic 2021-01-27T09:41:00.713 INFO:teuthology.task.ansible.out:es pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "Kill 2021-01-27T09:41:00.715 INFO:teuthology.task.ansible.out:Signal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127767", "LimitSIGPENDINGSoft": "127767", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResu 2021-01-27T09:41:00.717 INFO:teuthology.task.ansible.out:lt": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target docker.socket", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 09:39:24 UTC", "StateChangeTimestampMonotonic": "113438331", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T09:41:00.830 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-01-27T09:41:00.834 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-01-27T09:41:00.839 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi078.front.sepia.ceph.com : ok=121 changed=33 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 smithi146.front.sepia.ceph.com : ok=121 changed=34 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 Wednesday 27 January 2021 09:41:00 +0000 (0:00:04.611) 0:02:38.575 ***** =============================================================================== 2021-01-27T09:41:00.840 INFO:teuthology.task.ansible.out:common : Update apt cache ----------------------------------------------- 7.44s container-host : Restart docker service --------------------------------- 4.61s testnode : Ensure packages are not present. ----------------------------- 3.72s testnode : Update apt cache. -------------------------------------------- 3.61s testnode : Create logical volume(s) ------------------------------------- 3.05s testnode : Install packages via pip ------------------------------------- 2.76s container-host : Install registries-conf-ctl ---------------------------- 2.75s Gathering Facts --------------------------------------------------------- 2.30s testnode : Install python-pip on apt based systems. --------------------- 1.51s container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert --- 1.42s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.37s testnode : List any leftover Ceph artifacts from previous jobs ---------- 1.19s Gathering Facts --------------------------------------------------------- 1.10s testnode : Install apt keys --------------------------------------------- 1.04s Gathering Facts --------------------------------------------------------- 0.99s testnode : Install python-apt ------------------------------------------- 0.97s users : Create all admin users with sudo access. ------------------------ 0.95s testnode : Install ntp package on apt based systems. -------------------- 0.90s testnode : Make sure apt dependencies are installed --------------------- 0.90s testnode : Install non aarch64 packages --------------------------------- 0.89s 2021-01-27T09:41:01.166 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi146.front.sepia.ceph.com'), Remote(name='ubuntu@smithi078.front.sepia.ceph.com')] 2021-01-27T09:41:01.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:41:01.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:41:01.233 DEBUG:teuthology.orchestra.run.smithi146:> true 2021-01-27T09:41:01.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T09:41:01.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T09:41:01.453 DEBUG:teuthology.orchestra.run.smithi078:> true 2021-01-27T09:41:01.648 INFO:teuthology.run_tasks:Running task clock... 2021-01-27T09:41:01.661 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-01-27T09:41:01.662 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-01-27T09:41:01.662 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-01-27T09:41:01.753 INFO:teuthology.orchestra.run.smithi146.stdout:27 Jan 09:41:01 ntpd[5376]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-01-27T09:41:01.754 INFO:teuthology.orchestra.run.smithi146.stdout:27 Jan 09:41:01 ntpd[5376]: Command line: ntpd -gq 2021-01-27T09:41:01.755 INFO:teuthology.orchestra.run.smithi146.stdout:27 Jan 09:41:01 ntpd[5376]: proto: precision = 0.057 usec (-24) 2021-01-27T09:41:01.756 INFO:teuthology.orchestra.run.smithi146.stdout:27 Jan 09:41:01 ntpd[5376]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-27T09:41:01.756 INFO:teuthology.orchestra.run.smithi146.stdout:27 Jan 09:41:01 ntpd[5376]: restrict ::: KOD does nothing without LIMITED. 2021-01-27T09:41:01.756 INFO:teuthology.orchestra.run.smithi146.stdout:27 Jan 09:41:01 ntpd[5376]: Listen and drop on 0 v6wildcard [::]:123 2021-01-27T09:41:01.756 INFO:teuthology.orchestra.run.smithi146.stdout:27 Jan 09:41:01 ntpd[5376]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-01-27T09:41:01.757 INFO:teuthology.orchestra.run.smithi146.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-27T09:41:01.757 INFO:teuthology.orchestra.run.smithi146.stderr:restrict ::: KOD does nothing without LIMITED. 2021-01-27T09:41:01.758 INFO:teuthology.orchestra.run.smithi146.stdout:27 Jan 09:41:01 ntpd[5376]: Listen normally on 2 lo 127.0.0.1:123 2021-01-27T09:41:01.758 INFO:teuthology.orchestra.run.smithi146.stdout:27 Jan 09:41:01 ntpd[5376]: Listen normally on 3 enp3s0f1 172.21.15.146:123 2021-01-27T09:41:01.758 INFO:teuthology.orchestra.run.smithi146.stdout:27 Jan 09:41:01 ntpd[5376]: Listen normally on 4 lo [::1]:123 2021-01-27T09:41:01.759 INFO:teuthology.orchestra.run.smithi146.stdout:27 Jan 09:41:01 ntpd[5376]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:76fd%5]:123 2021-01-27T09:41:01.759 INFO:teuthology.orchestra.run.smithi146.stdout:27 Jan 09:41:01 ntpd[5376]: Listening on routing socket on fd #22 for interface updates 2021-01-27T09:41:02.754 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:02 ntpd[5376]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:02.755 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:02 ntpd[5376]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:02.756 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:02 ntpd[5376]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:02.756 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:02 ntpd[5376]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:02.756 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:02 ntpd[5376]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:41:02.756 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:02 ntpd[5376]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:41:03.754 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:03 ntpd[5376]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:03.755 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:03 ntpd[5376]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:03.755 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:03 ntpd[5376]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:03.755 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:03 ntpd[5376]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:03.755 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:03 ntpd[5376]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:41:03.756 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:03 ntpd[5376]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:41:04.754 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:04 ntpd[5376]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:04.755 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:04 ntpd[5376]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:04.755 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:04 ntpd[5376]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:04.755 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:04 ntpd[5376]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:04.755 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:04 ntpd[5376]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:41:04.756 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:04 ntpd[5376]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:41:05.754 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:05 ntpd[5376]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:05.755 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:05 ntpd[5376]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:05.755 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:05 ntpd[5376]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:05.755 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:05 ntpd[5376]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:05.755 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:05 ntpd[5376]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:05.757 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:05 ntpd[5376]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:05.757 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:05 ntpd[5376]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:05.757 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:05 ntpd[5376]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:05.758 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:05 ntpd[5376]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:41:05.758 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:05 ntpd[5376]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:41:05.758 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:05 ntpd[5376]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:05.758 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:05 ntpd[5376]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:05.759 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:05 ntpd[5376]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:41:05.759 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:05 ntpd[5376]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:41:05.759 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:05 ntpd[5376]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:05.759 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:05 ntpd[5376]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:05.759 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:05 ntpd[5376]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:41:05.760 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:05 ntpd[5376]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:41:06.754 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:06 ntpd[5376]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:06.755 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:06 ntpd[5376]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:06.755 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:06 ntpd[5376]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:06.755 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:06 ntpd[5376]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:06.755 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:06 ntpd[5376]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:41:06.756 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:06 ntpd[5376]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:41:07.755 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:07 ntpd[5376]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:07.756 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:07 ntpd[5376]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:07.756 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:07 ntpd[5376]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:07.756 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:07 ntpd[5376]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:07.756 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:07 ntpd[5376]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:07.757 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:07 ntpd[5376]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:07.757 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:07 ntpd[5376]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:07.757 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:07 ntpd[5376]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:07.757 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:07 ntpd[5376]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:41:07.757 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:07 ntpd[5376]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:41:07.758 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:07 ntpd[5376]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:07.758 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:07 ntpd[5376]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:07.758 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:07 ntpd[5376]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:41:07.758 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:07 ntpd[5376]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:41:07.758 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:07 ntpd[5376]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:07.759 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:07 ntpd[5376]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:07.759 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:07 ntpd[5376]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:41:07.759 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:07 ntpd[5376]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:41:08.754 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:08 ntpd[5376]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:08 ntpd[5376]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:08 ntpd[5376]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:08 ntpd[5376]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:08 ntpd[5376]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:41:08.756 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:08 ntpd[5376]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:41:08.756 INFO:teuthology.orchestra.run.smithi146.stdout:27 Jan 09:41:08 ntpd[5376]: ntpd: time set -0.195560 s 2021-01-27T09:41:08.756 INFO:teuthology.orchestra.run.smithi146.stdout:ntpd: time set -0.195560s 2021-01-27T09:41:08.757 INFO:teuthology.orchestra.run.smithi146.stderr:27 Jan 09:41:08 ntpd[5376]: can't open /var/log/ntpstats/loopstats.20210127: Permission denied 2021-01-27T09:41:08.932 INFO:teuthology.orchestra.run.smithi146.stdout: remote refid st t when poll reach delay offset jitter 2021-01-27T09:41:08.932 INFO:teuthology.orchestra.run.smithi146.stdout:============================================================================== 2021-01-27T09:41:08.932 INFO:teuthology.orchestra.run.smithi146.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T09:41:08.932 INFO:teuthology.orchestra.run.smithi146.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T09:41:08.933 INFO:teuthology.orchestra.run.smithi146.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T09:41:08.933 INFO:teuthology.orchestra.run.smithi146.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T09:41:08.935 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-01-27T09:41:08.935 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-01-27T09:41:08.972 INFO:teuthology.orchestra.run.smithi078.stdout:27 Jan 09:41:08 ntpd[6575]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-01-27T09:41:08.972 INFO:teuthology.orchestra.run.smithi078.stdout:27 Jan 09:41:08 ntpd[6575]: Command line: ntpd -gq 2021-01-27T09:41:08.973 INFO:teuthology.orchestra.run.smithi078.stdout:27 Jan 09:41:08 ntpd[6575]: proto: precision = 0.170 usec (-22) 2021-01-27T09:41:08.974 INFO:teuthology.orchestra.run.smithi078.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-27T09:41:08.975 INFO:teuthology.orchestra.run.smithi078.stderr:restrict ::: KOD does nothing without LIMITED. 2021-01-27T09:41:08.975 INFO:teuthology.orchestra.run.smithi078.stdout:27 Jan 09:41:08 ntpd[6575]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-27T09:41:08.975 INFO:teuthology.orchestra.run.smithi078.stdout:27 Jan 09:41:08 ntpd[6575]: restrict ::: KOD does nothing without LIMITED. 2021-01-27T09:41:08.975 INFO:teuthology.orchestra.run.smithi078.stdout:27 Jan 09:41:08 ntpd[6575]: Listen and drop on 0 v6wildcard [::]:123 2021-01-27T09:41:08.976 INFO:teuthology.orchestra.run.smithi078.stdout:27 Jan 09:41:08 ntpd[6575]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-01-27T09:41:08.976 INFO:teuthology.orchestra.run.smithi078.stdout:27 Jan 09:41:08 ntpd[6575]: Listen normally on 2 lo 127.0.0.1:123 2021-01-27T09:41:08.976 INFO:teuthology.orchestra.run.smithi078.stdout:27 Jan 09:41:08 ntpd[6575]: Listen normally on 3 enp3s0f1 172.21.15.78:123 2021-01-27T09:41:08.976 INFO:teuthology.orchestra.run.smithi078.stdout:27 Jan 09:41:08 ntpd[6575]: Listen normally on 4 lo [::1]:123 2021-01-27T09:41:08.976 INFO:teuthology.orchestra.run.smithi078.stdout:27 Jan 09:41:08 ntpd[6575]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d4dd%5]:123 2021-01-27T09:41:08.977 INFO:teuthology.orchestra.run.smithi078.stdout:27 Jan 09:41:08 ntpd[6575]: Listening on routing socket on fd #22 for interface updates 2021-01-27T09:41:09.979 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:09 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:09.979 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:09 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:09.980 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:09 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:09.980 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:09 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:09.980 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:09 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:09.980 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:09 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:09.981 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:09 ntpd[6575]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:41:09.981 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:09 ntpd[6575]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:41:09.981 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:09 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:09.981 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:09 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:09.981 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:09 ntpd[6575]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:41:09.982 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:09 ntpd[6575]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:41:10.974 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:10 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:10.975 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:10 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:10.975 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:10 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:10.976 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:10 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:10.976 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:10 ntpd[6575]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:41:10.977 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:10 ntpd[6575]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:41:11.973 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:11 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:11.973 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:11 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:11.974 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:11 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:11.974 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:11 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:11.974 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:11 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:11.974 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:11 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:11.974 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:11 ntpd[6575]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:41:11.975 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:11 ntpd[6575]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:41:11.975 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:11 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:11.975 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:11 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:11.975 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:11 ntpd[6575]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:41:11.975 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:11 ntpd[6575]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:41:12.973 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:12 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:12.973 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:12 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:12.973 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:12 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:12.973 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:12 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:12 ntpd[6575]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:41:12.974 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:12 ntpd[6575]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:41:13.973 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:13 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:13.974 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:13 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:13.974 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:13 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:13.975 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:13 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:13.975 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:13 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:13.975 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:13 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:13.975 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:13 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:13.976 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:13 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:13.976 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:13 ntpd[6575]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:41:13.976 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:13 ntpd[6575]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:41:13.976 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:13 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:13.977 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:13 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:13.977 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:13 ntpd[6575]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:41:13.977 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:13 ntpd[6575]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:41:13.977 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:13 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:13.978 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:13 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:13.978 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:13 ntpd[6575]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:41:13.978 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:13 ntpd[6575]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:41:14.973 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:14 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:14.973 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:14 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:14.974 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:14 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:14.974 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:14 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:14.974 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:14 ntpd[6575]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:41:14.975 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:14 ntpd[6575]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:41:15.973 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:15 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:15.974 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:15 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:15.974 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:15 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:15.974 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:15 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:15.974 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:15 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:15.975 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:15 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:15.975 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:15 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:15.975 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:15 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:15.975 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:15 ntpd[6575]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:41:15.975 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:15 ntpd[6575]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:41:15.976 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:15 ntpd[6575]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T09:41:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:15 ntpd[6575]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T09:41:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:15 ntpd[6575]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T09:41:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:15 ntpd[6575]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T09:41:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:27 Jan 09:41:15 ntpd[6575]: can't open /var/log/ntpstats/loopstats.20210127: Permission denied 2021-01-27T09:41:15.980 INFO:teuthology.orchestra.run.smithi078.stdout:27 Jan 09:41:15 ntpd[6575]: ntpd: time slew -0.002256 s 2021-01-27T09:41:15.980 INFO:teuthology.orchestra.run.smithi078.stdout:ntpd: time slew -0.002256s 2021-01-27T09:41:16.037 INFO:teuthology.orchestra.run.smithi078.stdout: remote refid st t when poll reach delay offset jitter 2021-01-27T09:41:16.038 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================== 2021-01-27T09:41:16.038 INFO:teuthology.orchestra.run.smithi078.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T09:41:16.038 INFO:teuthology.orchestra.run.smithi078.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T09:41:16.039 INFO:teuthology.orchestra.run.smithi078.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T09:41:16.039 INFO:teuthology.orchestra.run.smithi078.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T09:41:16.040 INFO:teuthology.run_tasks:Running task install... 2021-01-27T09:41:16.051 DEBUG:teuthology.task.install:project ceph 2021-01-27T09:41:16.052 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '164b0f632a5fe3384fa7cbb10929c65ed7cc0f12'}} 2021-01-27T09:41:16.052 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': '164b0f632a5fe3384fa7cbb10929c65ed7cc0f12'} 2021-01-27T09:41:16.052 INFO:teuthology.task.install:Using flavor: basic 2021-01-27T09:41:16.072 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-01-27T09:41:16.073 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2021-01-27T09:41:16.073 DEBUG:teuthology.orchestra.run.smithi146:> sudo lsb_release -is 2021-01-27T09:41:16.164 INFO:teuthology.orchestra.run.smithi146.stdout:Ubuntu 2021-01-27T09:41:16.174 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T09:41:16.175 DEBUG:teuthology.orchestra.run.smithi078:> sudo lsb_release -is 2021-01-27T09:41:16.176 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-key list | grep Ceph 2021-01-27T09:41:16.228 INFO:teuthology.orchestra.run.smithi078.stdout:Ubuntu 2021-01-27T09:41:16.233 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T09:41:16.234 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-key list | grep Ceph 2021-01-27T09:41:16.336 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-01-27T09:41:16.396 INFO:teuthology.orchestra.run.smithi078.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-01-27T09:41:16.397 INFO:teuthology.orchestra.run.smithi078.stdout:uid [ unknown] Ceph.com (release key) 2021-01-27T09:41:16.398 DEBUG:teuthology.orchestra.run.smithi078:> sudo lsb_release -is 2021-01-27T09:41:16.424 INFO:teuthology.orchestra.run.smithi146.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-01-27T09:41:16.457 INFO:teuthology.orchestra.run.smithi078.stdout:Ubuntu 2021-01-27T09:41:16.463 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T09:41:16.464 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2021-01-27T09:41:16.465 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-01-27T09:41:16.466 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=164b0f632a5fe3384fa7cbb10929c65ed7cc0f12 2021-01-27T09:41:16.580 INFO:teuthology.orchestra.run.smithi146.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-01-27T09:41:16.580 INFO:teuthology.orchestra.run.smithi146.stdout:uid [ unknown] Ceph.com (release key) 2021-01-27T09:41:16.583 DEBUG:teuthology.orchestra.run.smithi146:> sudo lsb_release -is 2021-01-27T09:41:16.651 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default/ 2021-01-27T09:41:16.652 INFO:teuthology.task.install.deb:Package version is 17.0.0-139-g164b0f63-1focal 2021-01-27T09:41:16.666 INFO:teuthology.orchestra.run.smithi146.stdout:Ubuntu 2021-01-27T09:41:16.676 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T09:41:16.678 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2021-01-27T09:41:16.678 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-01-27T09:41:16.679 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=164b0f632a5fe3384fa7cbb10929c65ed7cc0f12 2021-01-27T09:41:16.807 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2021-01-27T09:41:16.808 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-01-27T09:41:16.865 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default/ 2021-01-27T09:41:16.866 INFO:teuthology.task.install.deb:Package version is 17.0.0-139-g164b0f63-1focal 2021-01-27T09:41:16.874 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get update 2021-01-27T09:41:17.012 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:41:17.012 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-01-27T09:41:17.049 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-01-27T09:41:17.065 DEBUG:teuthology.orchestra.run.smithi146:> sudo apt-get update 2021-01-27T09:41:17.082 INFO:teuthology.orchestra.run.smithi078.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal InRelease 2021-01-27T09:41:17.106 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-01-27T09:41:17.131 INFO:teuthology.orchestra.run.smithi078.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal Release.gpg 2021-01-27T09:41:17.135 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-27T09:41:17.155 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main i386 Packages [3,093 B] 2021-01-27T09:41:17.191 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 Packages [16.6 kB] 2021-01-27T09:41:17.217 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-01-27T09:41:17.430 INFO:teuthology.orchestra.run.smithi146.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal InRelease 2021-01-27T09:41:17.455 INFO:teuthology.orchestra.run.smithi146.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-01-27T09:41:17.496 INFO:teuthology.orchestra.run.smithi146.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-27T09:41:17.497 INFO:teuthology.orchestra.run.smithi146.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [109 kB] 2021-01-27T09:41:17.498 INFO:teuthology.orchestra.run.smithi146.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal Release.gpg 2021-01-27T09:41:17.523 INFO:teuthology.orchestra.run.smithi146.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main i386 Packages [3,093 B] 2021-01-27T09:41:17.552 INFO:teuthology.orchestra.run.smithi146.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-01-27T09:41:17.553 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-01-27T09:41:17.568 INFO:teuthology.orchestra.run.smithi146.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 Packages [16.6 kB] 2021-01-27T09:41:17.857 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 242 kB in 1s (298 kB/s) 2021-01-27T09:41:17.879 INFO:teuthology.orchestra.run.smithi146.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-01-27T09:41:18.568 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2021-01-27T09:41:18.589 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-139-g164b0f63-1focal cephadm=17.0.0-139-g164b0f63-1focal ceph-mds=17.0.0-139-g164b0f63-1focal ceph-mgr=17.0.0-139-g164b0f63-1focal ceph-common=17.0.0-139-g164b0f63-1focal ceph-fuse=17.0.0-139-g164b0f63-1focal ceph-test=17.0.0-139-g164b0f63-1focal radosgw=17.0.0-139-g164b0f63-1focal python3-rados=17.0.0-139-g164b0f63-1focal python3-rgw=17.0.0-139-g164b0f63-1focal python3-cephfs=17.0.0-139-g164b0f63-1focal python3-rbd=17.0.0-139-g164b0f63-1focal libcephfs2=17.0.0-139-g164b0f63-1focal libcephfs-dev=17.0.0-139-g164b0f63-1focal librados2=17.0.0-139-g164b0f63-1focal librbd1=17.0.0-139-g164b0f63-1focal rbd-fuse=17.0.0-139-g164b0f63-1focal python3-cephfs=17.0.0-139-g164b0f63-1focal cephfs-shell=17.0.0-139-g164b0f63-1focal cephfs-top=17.0.0-139-g164b0f63-1focal cephfs-mirror=17.0.0-139-g164b0f63-1focal 2021-01-27T09:41:18.657 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2021-01-27T09:41:18.791 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2021-01-27T09:41:18.792 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2021-01-27T09:41:18.910 INFO:teuthology.orchestra.run.smithi078.stdout:The following package was automatically installed and is no longer required: 2021-01-27T09:41:18.911 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.71.0 2021-01-27T09:41:18.911 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove it. 2021-01-27T09:41:18.911 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2021-01-27T09:41:18.912 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2021-01-27T09:41:18.912 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd jq 2021-01-27T09:41:18.912 INFO:teuthology.orchestra.run.smithi078.stdout: libjaeger libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-01-27T09:41:18.912 INFO:teuthology.orchestra.run.smithi078.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-01-27T09:41:18.913 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2 nvme-cli python-pastedeploy-tpl python3-atomicwrites python3-attr 2021-01-27T09:41:18.913 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt python3-bs4 python3-cachetools python3-ceph-argparse 2021-01-27T09:41:18.913 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2021-01-27T09:41:18.913 INFO:teuthology.orchestra.run.smithi078.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-01-27T09:41:18.913 INFO:teuthology.orchestra.run.smithi078.stdout: python3-joblib python3-json-pointer python3-jsonpatch python3-kubernetes 2021-01-27T09:41:18.914 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2021-01-27T09:41:18.914 INFO:teuthology.orchestra.run.smithi078.stdout: python3-openssl python3-packaging python3-paste python3-pastedeploy 2021-01-27T09:41:18.914 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pastescript python3-pecan python3-pluggy python3-prettytable 2021-01-27T09:41:18.914 INFO:teuthology.orchestra.run.smithi078.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2021-01-27T09:41:18.914 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyinotify python3-pyperclip python3-pytest python3-repoze.lru 2021-01-27T09:41:18.915 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2021-01-27T09:41:18.915 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplegeneric python3-singledispatch python3-sklearn 2021-01-27T09:41:18.915 INFO:teuthology.orchestra.run.smithi078.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-01-27T09:41:18.915 INFO:teuthology.orchestra.run.smithi078.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-01-27T09:41:18.915 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-01-27T09:41:18.916 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2021-01-27T09:41:18.917 INFO:teuthology.orchestra.run.smithi078.stdout: python3-influxdb python-attr-doc python3-genshi python-jinja2-doc 2021-01-27T09:41:18.917 INFO:teuthology.orchestra.run.smithi078.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-01-27T09:41:18.917 INFO:teuthology.orchestra.run.smithi078.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-01-27T09:41:18.917 INFO:teuthology.orchestra.run.smithi078.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-01-27T09:41:18.918 INFO:teuthology.orchestra.run.smithi078.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-01-27T09:41:18.918 INFO:teuthology.orchestra.run.smithi078.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-01-27T09:41:18.918 INFO:teuthology.orchestra.run.smithi078.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-01-27T09:41:18.918 INFO:teuthology.orchestra.run.smithi078.stdout:Recommended packages: 2021-01-27T09:41:18.919 INFO:teuthology.orchestra.run.smithi078.stdout: btrfs-tools 2021-01-27T09:41:19.009 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2021-01-27T09:41:19.010 INFO:teuthology.orchestra.run.smithi078.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-01-27T09:41:19.010 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2021-01-27T09:41:19.010 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm 2021-01-27T09:41:19.010 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 libjaeger 2021-01-27T09:41:19.011 INFO:teuthology.orchestra.run.smithi078.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-01-27T09:41:19.011 INFO:teuthology.orchestra.run.smithi078.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-01-27T09:41:19.011 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2 nvme-cli python-pastedeploy-tpl python3-atomicwrites python3-attr 2021-01-27T09:41:19.011 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt python3-bs4 python3-cachetools python3-ceph-argparse 2021-01-27T09:41:19.012 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2021-01-27T09:41:19.012 INFO:teuthology.orchestra.run.smithi078.stdout: python3-colorama python3-decorator python3-google-auth python3-html5lib 2021-01-27T09:41:19.012 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-01-27T09:41:19.012 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2021-01-27T09:41:19.012 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe python3-openssl python3-packaging python3-paste 2021-01-27T09:41:19.013 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pluggy 2021-01-27T09:41:19.013 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2021-01-27T09:41:19.013 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-01-27T09:41:19.013 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-01-27T09:41:19.014 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-01-27T09:41:19.014 INFO:teuthology.orchestra.run.smithi078.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-01-27T09:41:19.014 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-01-27T09:41:19.014 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug radosgw 2021-01-27T09:41:19.015 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse socat xmlstarlet 2021-01-27T09:41:19.015 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages will be upgraded: 2021-01-27T09:41:19.015 INFO:teuthology.orchestra.run.smithi078.stdout: librados2 librbd1 2021-01-27T09:41:19.031 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 351 kB in 2s (221 kB/s) 2021-01-27T09:41:19.144 INFO:teuthology.orchestra.run.smithi078.stdout:2 upgraded, 100 newly installed, 0 to remove and 22 not upgraded. 2021-01-27T09:41:19.144 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 169 MB of archives. 2021-01-27T09:41:19.145 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 782 MB of additional disk space will be used. 2021-01-27T09:41:19.145 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 17.0.0-139-g164b0f63-1focal [3,716 B] 2021-01-27T09:41:19.192 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.0.0-139-g164b0f63-1focal [3,291 kB] 2021-01-27T09:41:19.192 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-01-27T09:41:19.271 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-01-27T09:41:19.299 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-01-27T09:41:19.406 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-01-27T09:41:19.425 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.0.0-139-g164b0f63-1focal [3,352 kB] 2021-01-27T09:41:19.534 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-01-27T09:41:19.540 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-01-27T09:41:19.552 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-01-27T09:41:19.557 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.0.0-139-g164b0f63-1focal [706 kB] 2021-01-27T09:41:19.580 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.0.0-139-g164b0f63-1focal [407 kB] 2021-01-27T09:41:19.586 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.0.0-139-g164b0f63-1focal [21.7 kB] 2021-01-27T09:41:19.586 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.0.0-139-g164b0f63-1focal [198 kB] 2021-01-27T09:41:19.592 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.0.0-139-g164b0f63-1focal [29.4 kB] 2021-01-27T09:41:19.592 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.0.0-139-g164b0f63-1focal [386 kB] 2021-01-27T09:41:19.607 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.0.0-139-g164b0f63-1focal [3,500 kB] 2021-01-27T09:41:19.652 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-01-27T09:41:19.674 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-01-27T09:41:19.680 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-01-27T09:41:19.686 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-01-27T09:41:19.689 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-01-27T09:41:19.708 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-01-27T09:41:19.709 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-01-27T09:41:19.710 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-01-27T09:41:19.716 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-01-27T09:41:19.720 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.0.0-139-g164b0f63-1focal [116 kB] 2021-01-27T09:41:19.724 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.0.0-139-g164b0f63-1focal [447 kB] 2021-01-27T09:41:19.739 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.0.0-139-g164b0f63-1focal [22.1 MB] 2021-01-27T09:41:19.771 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-01-27T09:41:19.772 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-01-27T09:41:19.775 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-01-27T09:41:19.777 INFO:teuthology.orchestra.run.smithi078.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-01-27T09:41:19.781 INFO:teuthology.orchestra.run.smithi078.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-01-27T09:41:19.849 INFO:teuthology.orchestra.run.smithi078.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-01-27T09:41:19.850 INFO:teuthology.orchestra.run.smithi078.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-01-27T09:41:19.870 INFO:teuthology.orchestra.run.smithi078.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-01-27T09:41:19.870 INFO:teuthology.orchestra.run.smithi078.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-01-27T09:41:19.871 INFO:teuthology.orchestra.run.smithi078.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-01-27T09:41:19.927 INFO:teuthology.orchestra.run.smithi078.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-01-27T09:41:19.930 INFO:teuthology.orchestra.run.smithi078.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-01-27T09:41:19.938 INFO:teuthology.orchestra.run.smithi078.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-01-27T09:41:19.942 INFO:teuthology.orchestra.run.smithi078.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-01-27T09:41:19.943 INFO:teuthology.orchestra.run.smithi078.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-underscore all 1.9.1~dfsg-1 [98.6 kB] 2021-01-27T09:41:19.996 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2021-01-27T09:41:20.005 INFO:teuthology.orchestra.run.smithi078.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-01-27T09:41:20.009 INFO:teuthology.orchestra.run.smithi078.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-01-27T09:41:20.013 INFO:teuthology.orchestra.run.smithi078.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-01-27T09:41:20.013 INFO:teuthology.orchestra.run.smithi078.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-01-27T09:41:20.015 INFO:teuthology.orchestra.run.smithi078.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-01-27T09:41:20.045 DEBUG:teuthology.orchestra.run.smithi146:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-139-g164b0f63-1focal cephadm=17.0.0-139-g164b0f63-1focal ceph-mds=17.0.0-139-g164b0f63-1focal ceph-mgr=17.0.0-139-g164b0f63-1focal ceph-common=17.0.0-139-g164b0f63-1focal ceph-fuse=17.0.0-139-g164b0f63-1focal ceph-test=17.0.0-139-g164b0f63-1focal radosgw=17.0.0-139-g164b0f63-1focal python3-rados=17.0.0-139-g164b0f63-1focal python3-rgw=17.0.0-139-g164b0f63-1focal python3-cephfs=17.0.0-139-g164b0f63-1focal python3-rbd=17.0.0-139-g164b0f63-1focal libcephfs2=17.0.0-139-g164b0f63-1focal libcephfs-dev=17.0.0-139-g164b0f63-1focal librados2=17.0.0-139-g164b0f63-1focal librbd1=17.0.0-139-g164b0f63-1focal rbd-fuse=17.0.0-139-g164b0f63-1focal python3-cephfs=17.0.0-139-g164b0f63-1focal cephfs-shell=17.0.0-139-g164b0f63-1focal cephfs-top=17.0.0-139-g164b0f63-1focal cephfs-mirror=17.0.0-139-g164b0f63-1focal 2021-01-27T09:41:20.168 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2021-01-27T09:41:20.313 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2021-01-27T09:41:20.314 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2021-01-27T09:41:20.358 INFO:teuthology.orchestra.run.smithi078.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-01-27T09:41:20.412 INFO:teuthology.orchestra.run.smithi078.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-01-27T09:41:20.414 INFO:teuthology.orchestra.run.smithi078.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-01-27T09:41:20.436 INFO:teuthology.orchestra.run.smithi146.stdout:The following package was automatically installed and is no longer required: 2021-01-27T09:41:20.437 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-iostreams1.71.0 2021-01-27T09:41:20.437 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove it. 2021-01-27T09:41:20.437 INFO:teuthology.orchestra.run.smithi146.stdout:The following additional packages will be installed: 2021-01-27T09:41:20.437 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2021-01-27T09:41:20.438 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd jq 2021-01-27T09:41:20.438 INFO:teuthology.orchestra.run.smithi146.stdout: libjaeger libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-01-27T09:41:20.438 INFO:teuthology.orchestra.run.smithi146.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-01-27T09:41:20.439 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 nvme-cli python-pastedeploy-tpl python3-atomicwrites python3-attr 2021-01-27T09:41:20.439 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt python3-bs4 python3-cachetools python3-ceph-argparse 2021-01-27T09:41:20.439 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2021-01-27T09:41:20.440 INFO:teuthology.orchestra.run.smithi146.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-01-27T09:41:20.440 INFO:teuthology.orchestra.run.smithi146.stdout: python3-joblib python3-json-pointer python3-jsonpatch python3-kubernetes 2021-01-27T09:41:20.440 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2021-01-27T09:41:20.440 INFO:teuthology.orchestra.run.smithi146.stdout: python3-openssl python3-packaging python3-paste python3-pastedeploy 2021-01-27T09:41:20.440 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pastescript python3-pecan python3-pluggy python3-prettytable 2021-01-27T09:41:20.441 INFO:teuthology.orchestra.run.smithi146.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2021-01-27T09:41:20.441 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyinotify python3-pyperclip python3-pytest python3-repoze.lru 2021-01-27T09:41:20.441 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2021-01-27T09:41:20.441 INFO:teuthology.orchestra.run.smithi146.stdout: python3-simplegeneric python3-singledispatch python3-sklearn 2021-01-27T09:41:20.441 INFO:teuthology.orchestra.run.smithi146.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-01-27T09:41:20.442 INFO:teuthology.orchestra.run.smithi146.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-01-27T09:41:20.442 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-01-27T09:41:20.442 INFO:teuthology.orchestra.run.smithi146.stdout:Suggested packages: 2021-01-27T09:41:20.442 INFO:teuthology.orchestra.run.smithi146.stdout: python3-influxdb python-attr-doc python3-genshi python-jinja2-doc 2021-01-27T09:41:20.442 INFO:teuthology.orchestra.run.smithi146.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-01-27T09:41:20.443 INFO:teuthology.orchestra.run.smithi146.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-01-27T09:41:20.443 INFO:teuthology.orchestra.run.smithi146.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-01-27T09:41:20.443 INFO:teuthology.orchestra.run.smithi146.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-01-27T09:41:20.443 INFO:teuthology.orchestra.run.smithi146.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-01-27T09:41:20.443 INFO:teuthology.orchestra.run.smithi146.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-01-27T09:41:20.444 INFO:teuthology.orchestra.run.smithi146.stdout:Recommended packages: 2021-01-27T09:41:20.444 INFO:teuthology.orchestra.run.smithi146.stdout: btrfs-tools 2021-01-27T09:41:20.554 INFO:teuthology.orchestra.run.smithi078.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-01-27T09:41:20.554 INFO:teuthology.orchestra.run.smithi078.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-01-27T09:41:20.555 INFO:teuthology.orchestra.run.smithi078.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-01-27T09:41:20.555 INFO:teuthology.orchestra.run.smithi078.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.0.0-139-g164b0f63-1focal [5,863 kB] 2021-01-27T09:41:20.556 INFO:teuthology.orchestra.run.smithi078.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-01-27T09:41:20.600 INFO:teuthology.orchestra.run.smithi146.stdout:The following NEW packages will be installed: 2021-01-27T09:41:20.600 INFO:teuthology.orchestra.run.smithi146.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-01-27T09:41:20.601 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2021-01-27T09:41:20.601 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm 2021-01-27T09:41:20.601 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 libjaeger 2021-01-27T09:41:20.601 INFO:teuthology.orchestra.run.smithi146.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-01-27T09:41:20.601 INFO:teuthology.orchestra.run.smithi146.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-01-27T09:41:20.602 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 nvme-cli python-pastedeploy-tpl python3-atomicwrites python3-attr 2021-01-27T09:41:20.603 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt python3-bs4 python3-cachetools python3-ceph-argparse 2021-01-27T09:41:20.603 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2021-01-27T09:41:20.603 INFO:teuthology.orchestra.run.smithi146.stdout: python3-colorama python3-decorator python3-google-auth python3-html5lib 2021-01-27T09:41:20.603 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-01-27T09:41:20.604 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2021-01-27T09:41:20.604 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe python3-openssl python3-packaging python3-paste 2021-01-27T09:41:20.604 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pluggy 2021-01-27T09:41:20.604 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2021-01-27T09:41:20.604 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-01-27T09:41:20.605 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-01-27T09:41:20.605 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-01-27T09:41:20.605 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-01-27T09:41:20.606 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-01-27T09:41:20.606 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug radosgw 2021-01-27T09:41:20.606 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse socat xmlstarlet 2021-01-27T09:41:20.606 INFO:teuthology.orchestra.run.smithi146.stdout:The following packages will be upgraded: 2021-01-27T09:41:20.607 INFO:teuthology.orchestra.run.smithi146.stdout: librados2 librbd1 2021-01-27T09:41:20.619 INFO:teuthology.orchestra.run.smithi078.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-01-27T09:41:20.620 INFO:teuthology.orchestra.run.smithi078.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-01-27T09:41:20.621 INFO:teuthology.orchestra.run.smithi078.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-01-27T09:41:20.622 INFO:teuthology.orchestra.run.smithi078.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-01-27T09:41:20.627 INFO:teuthology.orchestra.run.smithi078.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-json-pointer all 2.0-0ubuntu1 [8,320 B] 2021-01-27T09:41:20.655 INFO:teuthology.orchestra.run.smithi078.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.0.0-139-g164b0f63-1focal [180 kB] 2021-01-27T09:41:20.660 INFO:teuthology.orchestra.run.smithi078.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.0.0-139-g164b0f63-1focal [1,462 kB] 2021-01-27T09:41:20.706 INFO:teuthology.orchestra.run.smithi078.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jsonpatch all 1.23-3 [12.0 kB] 2021-01-27T09:41:20.707 INFO:teuthology.orchestra.run.smithi078.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-01-27T09:41:20.708 INFO:teuthology.orchestra.run.smithi078.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.0.0-139-g164b0f63-1focal [6,917 kB] 2021-01-27T09:41:20.710 INFO:teuthology.orchestra.run.smithi078.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-01-27T09:41:20.714 INFO:teuthology.orchestra.run.smithi078.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-01-27T09:41:20.716 INFO:teuthology.orchestra.run.smithi078.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-01-27T09:41:20.720 INFO:teuthology.orchestra.run.smithi078.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-01-27T09:41:20.722 INFO:teuthology.orchestra.run.smithi078.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-01-27T09:41:20.723 INFO:teuthology.orchestra.run.smithi078.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-01-27T09:41:20.752 INFO:teuthology.orchestra.run.smithi078.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-01-27T09:41:20.753 INFO:teuthology.orchestra.run.smithi078.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-01-27T09:41:20.816 INFO:teuthology.orchestra.run.smithi146.stdout:2 upgraded, 100 newly installed, 0 to remove and 22 not upgraded. 2021-01-27T09:41:20.816 INFO:teuthology.orchestra.run.smithi146.stdout:Need to get 169 MB of archives. 2021-01-27T09:41:20.816 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 782 MB of additional disk space will be used. 2021-01-27T09:41:20.817 INFO:teuthology.orchestra.run.smithi146.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-01-27T09:41:20.831 INFO:teuthology.orchestra.run.smithi078.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-01-27T09:41:20.831 INFO:teuthology.orchestra.run.smithi078.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-01-27T09:41:20.833 INFO:teuthology.orchestra.run.smithi078.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.2 [1,382 kB] 2021-01-27T09:41:20.853 INFO:teuthology.orchestra.run.smithi078.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-01-27T09:41:20.853 INFO:teuthology.orchestra.run.smithi078.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-01-27T09:41:20.854 INFO:teuthology.orchestra.run.smithi078.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-01-27T09:41:20.854 INFO:teuthology.orchestra.run.smithi078.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-01-27T09:41:20.855 INFO:teuthology.orchestra.run.smithi078.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-01-27T09:41:20.898 INFO:teuthology.orchestra.run.smithi146.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-01-27T09:41:20.905 INFO:teuthology.orchestra.run.smithi146.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-01-27T09:41:20.908 INFO:teuthology.orchestra.run.smithi078.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-01-27T09:41:20.909 INFO:teuthology.orchestra.run.smithi078.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-01-27T09:41:20.951 INFO:teuthology.orchestra.run.smithi146.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 17.0.0-139-g164b0f63-1focal [3,716 B] 2021-01-27T09:41:20.955 INFO:teuthology.orchestra.run.smithi078.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.0.0-139-g164b0f63-1focal [25.9 MB] 2021-01-27T09:41:21.009 INFO:teuthology.orchestra.run.smithi146.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-01-27T09:41:21.068 INFO:teuthology.orchestra.run.smithi146.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.0.0-139-g164b0f63-1focal [3,291 kB] 2021-01-27T09:41:21.156 INFO:teuthology.orchestra.run.smithi146.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-01-27T09:41:21.166 INFO:teuthology.orchestra.run.smithi146.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-01-27T09:41:21.177 INFO:teuthology.orchestra.run.smithi146.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-01-27T09:41:21.279 INFO:teuthology.orchestra.run.smithi146.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-01-27T09:41:21.299 INFO:teuthology.orchestra.run.smithi146.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-01-27T09:41:21.304 INFO:teuthology.orchestra.run.smithi146.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-01-27T09:41:21.309 INFO:teuthology.orchestra.run.smithi146.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-01-27T09:41:21.313 INFO:teuthology.orchestra.run.smithi146.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-01-27T09:41:21.330 INFO:teuthology.orchestra.run.smithi146.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-01-27T09:41:21.331 INFO:teuthology.orchestra.run.smithi146.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-01-27T09:41:21.333 INFO:teuthology.orchestra.run.smithi146.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-01-27T09:41:21.339 INFO:teuthology.orchestra.run.smithi146.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-01-27T09:41:21.394 INFO:teuthology.orchestra.run.smithi146.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-01-27T09:41:21.395 INFO:teuthology.orchestra.run.smithi146.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-01-27T09:41:21.402 INFO:teuthology.orchestra.run.smithi146.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-01-27T09:41:21.403 INFO:teuthology.orchestra.run.smithi146.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-01-27T09:41:21.404 INFO:teuthology.orchestra.run.smithi146.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-01-27T09:41:21.472 INFO:teuthology.orchestra.run.smithi146.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-01-27T09:41:21.473 INFO:teuthology.orchestra.run.smithi146.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-01-27T09:41:21.494 INFO:teuthology.orchestra.run.smithi146.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-01-27T09:41:21.494 INFO:teuthology.orchestra.run.smithi146.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-01-27T09:41:21.495 INFO:teuthology.orchestra.run.smithi146.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-01-27T09:41:21.550 INFO:teuthology.orchestra.run.smithi146.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-01-27T09:41:21.553 INFO:teuthology.orchestra.run.smithi146.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-01-27T09:41:21.562 INFO:teuthology.orchestra.run.smithi146.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-01-27T09:41:21.566 INFO:teuthology.orchestra.run.smithi146.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-01-27T09:41:21.567 INFO:teuthology.orchestra.run.smithi146.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-underscore all 1.9.1~dfsg-1 [98.6 kB] 2021-01-27T09:41:21.629 INFO:teuthology.orchestra.run.smithi146.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-01-27T09:41:21.633 INFO:teuthology.orchestra.run.smithi146.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-01-27T09:41:21.637 INFO:teuthology.orchestra.run.smithi146.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-01-27T09:41:21.638 INFO:teuthology.orchestra.run.smithi146.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-01-27T09:41:21.639 INFO:teuthology.orchestra.run.smithi146.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-01-27T09:41:21.914 INFO:teuthology.orchestra.run.smithi078.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.0.0-139-g164b0f63-1focal [3,808 B] 2021-01-27T09:41:21.914 INFO:teuthology.orchestra.run.smithi078.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.0.0-139-g164b0f63-1focal [809 kB] 2021-01-27T09:41:21.926 INFO:teuthology.orchestra.run.smithi078.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.0.0-139-g164b0f63-1focal [2,302 kB] 2021-01-27T09:41:21.951 INFO:teuthology.orchestra.run.smithi078.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.0.0-139-g164b0f63-1focal [60.8 kB] 2021-01-27T09:41:21.953 INFO:teuthology.orchestra.run.smithi078.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.0.0-139-g164b0f63-1focal [63.9 kB] 2021-01-27T09:41:21.955 INFO:teuthology.orchestra.run.smithi078.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.0.0-139-g164b0f63-1focal [2,328 kB] 2021-01-27T09:41:21.983 INFO:teuthology.orchestra.run.smithi146.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-01-27T09:41:22.033 INFO:teuthology.orchestra.run.smithi146.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-01-27T09:41:22.035 INFO:teuthology.orchestra.run.smithi146.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-01-27T09:41:22.043 INFO:teuthology.orchestra.run.smithi078.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.0.0-139-g164b0f63-1focal [7,883 kB] 2021-01-27T09:41:22.100 INFO:teuthology.orchestra.run.smithi146.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-01-27T09:41:22.101 INFO:teuthology.orchestra.run.smithi146.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-01-27T09:41:22.102 INFO:teuthology.orchestra.run.smithi146.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-01-27T09:41:22.102 INFO:teuthology.orchestra.run.smithi146.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-01-27T09:41:22.103 INFO:teuthology.orchestra.run.smithi146.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-01-27T09:41:22.104 INFO:teuthology.orchestra.run.smithi146.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-01-27T09:41:22.105 INFO:teuthology.orchestra.run.smithi146.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-01-27T09:41:22.142 INFO:teuthology.orchestra.run.smithi146.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-01-27T09:41:22.150 INFO:teuthology.orchestra.run.smithi146.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-json-pointer all 2.0-0ubuntu1 [8,320 B] 2021-01-27T09:41:22.220 INFO:teuthology.orchestra.run.smithi146.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jsonpatch all 1.23-3 [12.0 kB] 2021-01-27T09:41:22.221 INFO:teuthology.orchestra.run.smithi146.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-01-27T09:41:22.226 INFO:teuthology.orchestra.run.smithi146.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-01-27T09:41:22.228 INFO:teuthology.orchestra.run.smithi146.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-01-27T09:41:22.229 INFO:teuthology.orchestra.run.smithi146.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-01-27T09:41:22.235 INFO:teuthology.orchestra.run.smithi146.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-01-27T09:41:22.238 INFO:teuthology.orchestra.run.smithi146.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-01-27T09:41:22.239 INFO:teuthology.orchestra.run.smithi146.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-01-27T09:41:22.298 INFO:teuthology.orchestra.run.smithi146.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-01-27T09:41:22.299 INFO:teuthology.orchestra.run.smithi146.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-01-27T09:41:22.322 INFO:teuthology.orchestra.run.smithi078.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.0.0-139-g164b0f63-1focal [3,924 B] 2021-01-27T09:41:22.322 INFO:teuthology.orchestra.run.smithi078.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-rook all 17.0.0-139-g164b0f63-1focal [22.6 kB] 2021-01-27T09:41:22.323 INFO:teuthology.orchestra.run.smithi078.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.0.0-139-g164b0f63-1focal [48.1 MB] 2021-01-27T09:41:22.376 INFO:teuthology.orchestra.run.smithi146.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-01-27T09:41:22.377 INFO:teuthology.orchestra.run.smithi146.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-01-27T09:41:22.380 INFO:teuthology.orchestra.run.smithi146.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.2 [1,382 kB] 2021-01-27T09:41:22.403 INFO:teuthology.orchestra.run.smithi146.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-01-27T09:41:22.404 INFO:teuthology.orchestra.run.smithi146.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-01-27T09:41:22.405 INFO:teuthology.orchestra.run.smithi146.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-01-27T09:41:22.405 INFO:teuthology.orchestra.run.smithi146.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-01-27T09:41:22.407 INFO:teuthology.orchestra.run.smithi146.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-01-27T09:41:22.454 INFO:teuthology.orchestra.run.smithi146.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-01-27T09:41:22.455 INFO:teuthology.orchestra.run.smithi146.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-01-27T09:41:22.565 INFO:teuthology.orchestra.run.smithi146.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.0.0-139-g164b0f63-1focal [3,352 kB] 2021-01-27T09:41:23.292 INFO:teuthology.orchestra.run.smithi146.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.0.0-139-g164b0f63-1focal [706 kB] 2021-01-27T09:41:23.417 INFO:teuthology.orchestra.run.smithi146.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.0.0-139-g164b0f63-1focal [407 kB] 2021-01-27T09:41:23.479 INFO:teuthology.orchestra.run.smithi146.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.0.0-139-g164b0f63-1focal [21.7 kB] 2021-01-27T09:41:23.480 INFO:teuthology.orchestra.run.smithi146.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.0.0-139-g164b0f63-1focal [198 kB] 2021-01-27T09:41:23.486 INFO:teuthology.orchestra.run.smithi146.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.0.0-139-g164b0f63-1focal [29.4 kB] 2021-01-27T09:41:23.487 INFO:teuthology.orchestra.run.smithi146.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.0.0-139-g164b0f63-1focal [386 kB] 2021-01-27T09:41:23.550 INFO:teuthology.orchestra.run.smithi146.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.0.0-139-g164b0f63-1focal [3,500 kB] 2021-01-27T09:41:23.977 INFO:teuthology.orchestra.run.smithi146.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.0.0-139-g164b0f63-1focal [116 kB] 2021-01-27T09:41:23.979 INFO:teuthology.orchestra.run.smithi146.stdout:Get:80 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.0.0-139-g164b0f63-1focal [447 kB] 2021-01-27T09:41:24.048 INFO:teuthology.orchestra.run.smithi146.stdout:Get:81 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.0.0-139-g164b0f63-1focal [22.1 MB] 2021-01-27T09:41:24.546 INFO:teuthology.orchestra.run.smithi078.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.0.0-139-g164b0f63-1focal [195 kB] 2021-01-27T09:41:24.550 INFO:teuthology.orchestra.run.smithi078.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.0.0-139-g164b0f63-1focal [17.0 kB] 2021-01-27T09:41:24.551 INFO:teuthology.orchestra.run.smithi078.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.0.0-139-g164b0f63-1focal [7,528 B] 2021-01-27T09:41:24.551 INFO:teuthology.orchestra.run.smithi078.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.0.0-139-g164b0f63-1focal [19.8 kB] 2021-01-27T09:41:24.552 INFO:teuthology.orchestra.run.smithi078.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.0.0-139-g164b0f63-1focal [10.7 MB] 2021-01-27T09:41:25.028 INFO:teuthology.orchestra.run.smithi078.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.0.0-139-g164b0f63-1focal [77.7 kB] 2021-01-27T09:41:25.321 INFO:teuthology.orchestra.run.smithi146.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.0.0-139-g164b0f63-1focal [5,863 kB] 2021-01-27T09:41:25.506 INFO:teuthology.orchestra.run.smithi146.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.0.0-139-g164b0f63-1focal [180 kB] 2021-01-27T09:41:25.509 INFO:teuthology.orchestra.run.smithi146.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.0.0-139-g164b0f63-1focal [1,462 kB] 2021-01-27T09:41:25.557 INFO:teuthology.orchestra.run.smithi146.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.0.0-139-g164b0f63-1focal [6,917 kB] 2021-01-27T09:41:25.636 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 169 MB in 6s (28.2 MB/s) 2021-01-27T09:41:25.780 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyperclip. 2021-01-27T09:41:25.787 INFO:teuthology.orchestra.run.smithi146.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.0.0-139-g164b0f63-1focal [25.9 MB] 2021-01-27T09:41:25.828 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 114224 files and directories currently installed.) 2021-01-27T09:41:25.831 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-01-27T09:41:25.861 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-01-27T09:41:26.183 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-wcwidth. 2021-01-27T09:41:26.197 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-01-27T09:41:26.241 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-27T09:41:26.569 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cmd2. 2021-01-27T09:41:26.584 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-01-27T09:41:26.618 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-01-27T09:41:26.659 INFO:teuthology.orchestra.run.smithi146.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.0.0-139-g164b0f63-1focal [3,808 B] 2021-01-27T09:41:26.660 INFO:teuthology.orchestra.run.smithi146.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.0.0-139-g164b0f63-1focal [809 kB] 2021-01-27T09:41:26.673 INFO:teuthology.orchestra.run.smithi146.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.0.0-139-g164b0f63-1focal [2,302 kB] 2021-01-27T09:41:26.749 INFO:teuthology.orchestra.run.smithi146.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.0.0-139-g164b0f63-1focal [60.8 kB] 2021-01-27T09:41:26.750 INFO:teuthology.orchestra.run.smithi146.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.0.0-139-g164b0f63-1focal [63.9 kB] 2021-01-27T09:41:26.753 INFO:teuthology.orchestra.run.smithi146.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.0.0-139-g164b0f63-1focal [2,328 kB] 2021-01-27T09:41:26.831 INFO:teuthology.orchestra.run.smithi146.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.0.0-139-g164b0f63-1focal [7,883 kB] 2021-01-27T09:41:26.884 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjaeger. 2021-01-27T09:41:26.902 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../003-libjaeger_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:26.938 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjaeger (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:27.091 INFO:teuthology.orchestra.run.smithi146.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.0.0-139-g164b0f63-1focal [3,924 B] 2021-01-27T09:41:27.092 INFO:teuthology.orchestra.run.smithi146.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-rook all 17.0.0-139-g164b0f63-1focal [22.6 kB] 2021-01-27T09:41:27.093 INFO:teuthology.orchestra.run.smithi146.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.0.0-139-g164b0f63-1focal [48.1 MB] 2021-01-27T09:41:27.283 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-01-27T09:41:27.299 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../004-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-01-27T09:41:27.383 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-27T09:41:27.760 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../005-librbd1_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:27.886 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librbd1 (17.0.0-139-g164b0f63-1focal) over (15.2.7-0ubuntu0.20.04.1) ... 2021-01-27T09:41:28.523 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../006-librados2_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:28.641 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librados2 (17.0.0-139-g164b0f63-1focal) over (15.2.7-0ubuntu0.20.04.1) ... 2021-01-27T09:41:28.687 INFO:teuthology.orchestra.run.smithi146.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.0.0-139-g164b0f63-1focal [195 kB] 2021-01-27T09:41:28.689 INFO:teuthology.orchestra.run.smithi146.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.0.0-139-g164b0f63-1focal [17.0 kB] 2021-01-27T09:41:28.690 INFO:teuthology.orchestra.run.smithi146.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.0.0-139-g164b0f63-1focal [7,528 B] 2021-01-27T09:41:28.690 INFO:teuthology.orchestra.run.smithi146.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.0.0-139-g164b0f63-1focal [19.8 kB] 2021-01-27T09:41:28.691 INFO:teuthology.orchestra.run.smithi146.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.0.0-139-g164b0f63-1focal [10.7 MB] 2021-01-27T09:41:29.030 INFO:teuthology.orchestra.run.smithi146.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-jcollin-dispatch-queue-throttle-test/164b0f632a5fe3384fa7cbb10929c65ed7cc0f12/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.0.0-139-g164b0f63-1focal [77.7 kB] 2021-01-27T09:41:29.320 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcephfs2. 2021-01-27T09:41:29.337 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../007-libcephfs2_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:29.378 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcephfs2 (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:29.731 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rados. 2021-01-27T09:41:29.745 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../008-python3-rados_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:29.780 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rados (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:30.018 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 169 MB in 8s (20.1 MB/s) 2021-01-27T09:41:30.134 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-01-27T09:41:30.148 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../009-python3-ceph-argparse_17.0.0-139-g164b0f63-1focal_all.deb ... 2021-01-27T09:41:30.192 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-ceph-argparse (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:30.206 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pyperclip. 2021-01-27T09:41:30.296 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 116716 files and directories currently installed.) 2021-01-27T09:41:30.300 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-01-27T09:41:30.344 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-01-27T09:41:30.469 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cephfs. 2021-01-27T09:41:30.484 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../010-python3-cephfs_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:30.527 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cephfs (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:30.613 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-wcwidth. 2021-01-27T09:41:30.625 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-01-27T09:41:30.655 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-27T09:41:30.880 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-ceph-common. 2021-01-27T09:41:30.894 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../011-python3-ceph-common_17.0.0-139-g164b0f63-1focal_all.deb ... 2021-01-27T09:41:30.938 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-ceph-common (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:31.033 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cmd2. 2021-01-27T09:41:31.045 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-01-27T09:41:31.083 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-01-27T09:41:31.216 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-prettytable. 2021-01-27T09:41:31.229 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-5_all.deb ... 2021-01-27T09:41:31.258 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-01-27T09:41:31.418 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libjaeger. 2021-01-27T09:41:31.431 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../003-libjaeger_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:31.468 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libjaeger (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:31.478 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rbd. 2021-01-27T09:41:31.492 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../013-python3-rbd_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:31.535 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rbd (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:31.838 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-01-27T09:41:31.856 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../004-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-01-27T09:41:31.938 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-27T09:41:31.939 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-01-27T09:41:31.953 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2021-01-27T09:41:31.997 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-01-27T09:41:32.308 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-01-27T09:41:32.325 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-01-27T09:41:32.329 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../005-librbd1_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:32.358 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-27T09:41:32.442 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librbd1 (17.0.0-139-g164b0f63-1focal) over (15.2.7-0ubuntu0.20.04.1) ... 2021-01-27T09:41:32.702 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librgw2. 2021-01-27T09:41:32.717 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../016-librgw2_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:32.761 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librgw2 (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:33.156 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../006-librados2_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:33.263 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librados2 (17.0.0-139-g164b0f63-1focal) over (15.2.7-0ubuntu0.20.04.1) ... 2021-01-27T09:41:33.313 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rgw. 2021-01-27T09:41:33.330 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../017-python3-rgw_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:33.371 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rgw (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:33.708 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-01-27T09:41:33.725 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../018-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-01-27T09:41:33.766 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-27T09:41:33.983 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libcephfs2. 2021-01-27T09:41:34.002 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../007-libcephfs2_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:34.042 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libcephfs2 (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:34.044 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liboath0. 2021-01-27T09:41:34.060 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../019-liboath0_2.6.1-1.3_amd64.deb ... 2021-01-27T09:41:34.102 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-01-27T09:41:34.411 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rados. 2021-01-27T09:41:34.421 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libradosstriper1. 2021-01-27T09:41:34.430 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../008-python3-rados_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:34.438 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../020-libradosstriper1_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:34.460 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rados (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:34.479 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libradosstriper1 (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:34.847 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-01-27T09:41:34.866 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../009-python3-ceph-argparse_17.0.0-139-g164b0f63-1focal_all.deb ... 2021-01-27T09:41:34.905 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-ceph-argparse (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:34.959 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-common. 2021-01-27T09:41:34.973 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../021-ceph-common_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:35.016 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-common (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:35.251 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cephfs. 2021-01-27T09:41:35.270 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../010-python3-cephfs_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:35.309 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cephfs (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:35.670 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-ceph-common. 2021-01-27T09:41:35.690 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../011-python3-ceph-common_17.0.0-139-g164b0f63-1focal_all.deb ... 2021-01-27T09:41:35.720 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-ceph-common (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:36.098 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-prettytable. 2021-01-27T09:41:36.118 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-5_all.deb ... 2021-01-27T09:41:36.156 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-01-27T09:41:36.509 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rbd. 2021-01-27T09:41:36.528 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../013-python3-rbd_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:36.568 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rbd (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:36.945 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-01-27T09:41:36.965 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2021-01-27T09:41:37.003 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-01-27T09:41:37.276 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-base. 2021-01-27T09:41:37.293 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../022-ceph-base_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:37.340 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-base (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:37.356 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-01-27T09:41:37.374 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-01-27T09:41:37.414 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-27T09:41:37.808 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package librgw2. 2021-01-27T09:41:37.827 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../016-librgw2_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:37.866 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking librgw2 (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:38.235 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-openssl. 2021-01-27T09:41:38.248 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-01-27T09:41:38.285 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-01-27T09:41:38.527 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rgw. 2021-01-27T09:41:38.547 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../017-python3-rgw_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:38.554 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-01-27T09:41:38.568 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_17.0.0-139-g164b0f63-1focal_all.deb ... 2021-01-27T09:41:38.586 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rgw (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:38.612 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-modules-core (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:38.922 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-01-27T09:41:38.940 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../018-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-01-27T09:41:38.950 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-bcrypt. 2021-01-27T09:41:38.964 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-01-27T09:41:38.980 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-27T09:41:39.025 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-27T09:41:39.311 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cherrypy3. 2021-01-27T09:41:39.325 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-01-27T09:41:39.361 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-01-27T09:41:39.391 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package liboath0. 2021-01-27T09:41:39.410 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../019-liboath0_2.6.1-1.3_amd64.deb ... 2021-01-27T09:41:39.449 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-01-27T09:41:39.690 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-logutils. 2021-01-27T09:41:39.706 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2021-01-27T09:41:39.739 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-01-27T09:41:39.810 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libradosstriper1. 2021-01-27T09:41:39.833 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../020-libradosstriper1_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:39.877 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libradosstriper1 (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:40.051 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-markupsafe. 2021-01-27T09:41:40.064 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-01-27T09:41:40.109 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-01-27T09:41:40.305 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-common. 2021-01-27T09:41:40.324 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../021-ceph-common_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:40.363 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-common (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:40.445 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-mako. 2021-01-27T09:41:40.460 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-01-27T09:41:40.503 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-27T09:41:40.856 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-simplegeneric. 2021-01-27T09:41:40.871 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2021-01-27T09:41:40.914 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-01-27T09:41:41.201 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-singledispatch. 2021-01-27T09:41:41.216 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-01-27T09:41:41.251 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-01-27T09:41:41.737 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webob. 2021-01-27T09:41:41.782 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2021-01-27T09:41:41.795 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-01-27T09:41:42.140 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-soupsieve. 2021-01-27T09:41:42.157 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-01-27T09:41:42.198 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-27T09:41:42.509 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-bs4. 2021-01-27T09:41:42.526 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2021-01-27T09:41:42.567 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-01-27T09:41:42.602 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-base. 2021-01-27T09:41:42.621 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../022-ceph-base_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:42.695 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-base (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:42.946 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-waitress. 2021-01-27T09:41:42.960 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1_all.deb ... 2021-01-27T09:41:43.006 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-01-27T09:41:43.365 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-tempita. 2021-01-27T09:41:43.382 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2021-01-27T09:41:43.423 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-01-27T09:41:43.731 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-openssl. 2021-01-27T09:41:43.750 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-01-27T09:41:43.760 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-paste. 2021-01-27T09:41:43.775 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-01-27T09:41:43.789 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-01-27T09:41:43.818 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-01-27T09:41:44.125 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-01-27T09:41:44.144 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_17.0.0-139-g164b0f63-1focal_all.deb ... 2021-01-27T09:41:44.154 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-01-27T09:41:44.171 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-01-27T09:41:44.184 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-modules-core (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:44.212 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-01-27T09:41:44.549 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pastedeploy. 2021-01-27T09:41:44.563 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2021-01-27T09:41:44.607 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-01-27T09:41:44.630 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-bcrypt. 2021-01-27T09:41:44.650 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-01-27T09:41:44.688 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-27T09:41:44.893 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webtest. 2021-01-27T09:41:44.910 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2021-01-27T09:41:44.951 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-01-27T09:41:45.066 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cherrypy3. 2021-01-27T09:41:45.085 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-01-27T09:41:45.124 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-01-27T09:41:45.296 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pecan. 2021-01-27T09:41:45.313 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-01-27T09:41:45.354 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-01-27T09:41:45.519 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-logutils. 2021-01-27T09:41:45.539 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2021-01-27T09:41:45.577 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-01-27T09:41:45.709 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-werkzeug. 2021-01-27T09:41:45.726 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-01-27T09:41:45.790 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-27T09:41:45.921 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-markupsafe. 2021-01-27T09:41:45.940 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-01-27T09:41:46.004 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-01-27T09:41:46.146 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr. 2021-01-27T09:41:46.160 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../043-ceph-mgr_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:46.212 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:46.366 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-mako. 2021-01-27T09:41:46.386 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-01-27T09:41:46.424 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-27T09:41:46.704 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mon. 2021-01-27T09:41:46.720 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../044-ceph-mon_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:46.765 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mon (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:46.819 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-simplegeneric. 2021-01-27T09:41:46.837 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2021-01-27T09:41:46.877 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-01-27T09:41:47.247 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-singledispatch. 2021-01-27T09:41:47.268 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-01-27T09:41:47.298 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-01-27T09:41:47.599 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-webob. 2021-01-27T09:41:47.618 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2021-01-27T09:41:47.657 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-01-27T09:41:47.878 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-osd. 2021-01-27T09:41:47.892 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../045-ceph-osd_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:47.935 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-osd (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:48.043 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-soupsieve. 2021-01-27T09:41:48.062 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-01-27T09:41:48.102 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-27T09:41:48.488 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-bs4. 2021-01-27T09:41:48.506 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2021-01-27T09:41:48.546 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-01-27T09:41:48.965 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-waitress. 2021-01-27T09:41:48.985 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1_all.deb ... 2021-01-27T09:41:49.038 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-01-27T09:41:49.418 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-tempita. 2021-01-27T09:41:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2021-01-27T09:41:49.485 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-01-27T09:41:49.854 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-paste. 2021-01-27T09:41:49.874 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-01-27T09:41:49.904 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-01-27T09:41:50.265 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-01-27T09:41:50.285 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-01-27T09:41:50.315 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-01-27T09:41:50.632 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph. 2021-01-27T09:41:50.647 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../046-ceph_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:50.660 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pastedeploy. 2021-01-27T09:41:50.679 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2021-01-27T09:41:50.690 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:50.718 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-01-27T09:41:50.985 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-fuse. 2021-01-27T09:41:50.998 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../047-ceph-fuse_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:51.043 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-fuse (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:51.104 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-webtest. 2021-01-27T09:41:51.123 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2021-01-27T09:41:51.162 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-01-27T09:41:51.472 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mds. 2021-01-27T09:41:51.487 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../048-ceph-mds_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:51.521 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mds (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:51.965 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pecan. 2021-01-27T09:41:51.984 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-01-27T09:41:52.023 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-01-27T09:41:52.470 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-werkzeug. 2021-01-27T09:41:52.489 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-01-27T09:41:52.528 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-27T09:41:52.758 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephadm. 2021-01-27T09:41:52.773 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../049-cephadm_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:52.816 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephadm (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:52.965 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr. 2021-01-27T09:41:52.984 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../043-ceph-mgr_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:53.022 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:53.161 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jinja2. 2021-01-27T09:41:53.178 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../050-python3-jinja2_2.10.1-2_all.deb ... 2021-01-27T09:41:53.219 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-01-27T09:41:53.564 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-01-27T09:41:53.576 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mon. 2021-01-27T09:41:53.577 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../051-ceph-mgr-cephadm_17.0.0-139-g164b0f63-1focal_all.deb ... 2021-01-27T09:41:53.596 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../044-ceph-mon_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:53.622 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-cephadm (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:53.625 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mon (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:53.975 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-repoze.lru. 2021-01-27T09:41:53.991 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../052-python3-repoze.lru_0.7-2_all.deb ... 2021-01-27T09:41:54.033 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-01-27T09:41:54.295 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjs-underscore. 2021-01-27T09:41:54.309 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../053-libjs-underscore_1.9.1~dfsg-1_all.deb ... 2021-01-27T09:41:54.344 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1) ... 2021-01-27T09:41:54.638 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-01-27T09:41:54.654 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../054-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-01-27T09:41:54.697 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-27T09:41:54.729 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-osd. 2021-01-27T09:41:54.748 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../045-ceph-osd_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:54.788 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-osd (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:55.041 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-routes. 2021-01-27T09:41:55.056 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../055-python3-routes_2.4.1-2_all.deb ... 2021-01-27T09:41:55.100 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-01-27T09:41:55.453 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-01-27T09:41:55.470 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../056-ceph-mgr-dashboard_17.0.0-139-g164b0f63-1focal_all.deb ... 2021-01-27T09:41:55.511 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-dashboard (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:56.478 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-decorator. 2021-01-27T09:41:56.495 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../057-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-01-27T09:41:56.536 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-01-27T09:41:56.847 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-01-27T09:41:56.863 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../058-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-01-27T09:41:56.905 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-27T09:41:57.251 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-scipy. 2021-01-27T09:41:57.266 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../059-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-01-27T09:41:57.275 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph. 2021-01-27T09:41:57.294 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../046-ceph_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:57.308 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-01-27T09:41:57.325 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:57.653 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-fuse. 2021-01-27T09:41:57.673 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../047-ceph-fuse_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:57.711 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-fuse (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:58.173 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mds. 2021-01-27T09:41:58.192 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../048-ceph-mds_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:58.255 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mds (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:58.651 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-01-27T09:41:58.666 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../060-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-01-27T09:41:58.734 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-27T09:41:58.834 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package cephadm. 2021-01-27T09:41:58.855 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../049-cephadm_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:41:58.901 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking cephadm (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:41:59.303 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jinja2. 2021-01-27T09:41:59.304 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-joblib. 2021-01-27T09:41:59.321 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../061-python3-joblib_0.14.0-3_all.deb ... 2021-01-27T09:41:59.322 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../050-python3-jinja2_2.10.1-2_all.deb ... 2021-01-27T09:41:59.354 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-01-27T09:41:59.361 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-01-27T09:41:59.733 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-sklearn. 2021-01-27T09:41:59.748 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../062-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-01-27T09:41:59.772 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-01-27T09:41:59.790 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-27T09:41:59.792 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../051-ceph-mgr-cephadm_17.0.0-139-g164b0f63-1focal_all.deb ... 2021-01-27T09:41:59.830 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-cephadm (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:00.226 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-repoze.lru. 2021-01-27T09:42:00.245 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../052-python3-repoze.lru_0.7-2_all.deb ... 2021-01-27T09:42:00.284 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-01-27T09:42:00.499 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-01-27T09:42:00.516 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../063-ceph-mgr-diskprediction-local_17.0.0-139-g164b0f63-1focal_all.deb ... 2021-01-27T09:42:00.548 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-diskprediction-local (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:00.587 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libjs-underscore. 2021-01-27T09:42:00.606 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../053-libjs-underscore_1.9.1~dfsg-1_all.deb ... 2021-01-27T09:42:00.636 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1) ... 2021-01-27T09:42:00.972 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-01-27T09:42:00.991 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../054-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-01-27T09:42:01.030 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-27T09:42:01.391 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-routes. 2021-01-27T09:42:01.411 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../055-python3-routes_2.4.1-2_all.deb ... 2021-01-27T09:42:01.449 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-01-27T09:42:01.644 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cachetools. 2021-01-27T09:42:01.660 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../064-python3-cachetools_4.0.0-1_all.deb ... 2021-01-27T09:42:01.694 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-01-27T09:42:01.988 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyasn1. 2021-01-27T09:42:02.002 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../065-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-01-27T09:42:02.046 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-01-27T09:42:02.145 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-01-27T09:42:02.165 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../056-ceph-mgr-dashboard_17.0.0-139-g164b0f63-1focal_all.deb ... 2021-01-27T09:42:02.194 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-dashboard (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:02.400 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-01-27T09:42:02.416 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../066-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-01-27T09:42:02.449 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-27T09:42:02.719 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rsa. 2021-01-27T09:42:02.736 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../067-python3-rsa_4.0-3_all.deb ... 2021-01-27T09:42:02.769 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rsa (4.0-3) ... 2021-01-27T09:42:03.089 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-google-auth. 2021-01-27T09:42:03.107 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../068-python3-google-auth_1.5.1-2_all.deb ... 2021-01-27T09:42:03.147 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-01-27T09:42:03.377 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-decorator. 2021-01-27T09:42:03.396 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../057-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-01-27T09:42:03.435 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-01-27T09:42:03.484 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-01-27T09:42:03.501 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../069-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-01-27T09:42:03.542 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-27T09:42:03.780 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-01-27T09:42:03.799 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../058-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-01-27T09:42:03.829 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-27T09:42:03.845 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-websocket. 2021-01-27T09:42:03.862 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../070-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-01-27T09:42:03.903 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-01-27T09:42:04.157 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-scipy. 2021-01-27T09:42:04.177 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../059-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-01-27T09:42:04.215 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-01-27T09:42:04.256 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-kubernetes. 2021-01-27T09:42:04.272 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../071-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-01-27T09:42:04.314 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-01-27T09:42:04.903 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-01-27T09:42:04.917 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../072-ceph-mgr-k8sevents_17.0.0-139-g164b0f63-1focal_all.deb ... 2021-01-27T09:42:04.961 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-k8sevents (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:05.289 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-json-pointer. 2021-01-27T09:42:05.304 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../073-python3-json-pointer_2.0-0ubuntu1_all.deb ... 2021-01-27T09:42:05.338 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-json-pointer (2.0-0ubuntu1) ... 2021-01-27T09:42:05.683 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jsonpatch. 2021-01-27T09:42:05.701 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../074-python3-jsonpatch_1.23-3_all.deb ... 2021-01-27T09:42:05.732 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-01-27T09:42:05.741 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jsonpatch (1.23-3) ... 2021-01-27T09:42:05.752 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../060-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-01-27T09:42:05.782 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-27T09:42:06.070 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-01-27T09:42:06.084 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../075-ceph-mgr-rook_17.0.0-139-g164b0f63-1focal_all.deb ... 2021-01-27T09:42:06.128 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-rook (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:06.336 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-joblib. 2021-01-27T09:42:06.354 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../061-python3-joblib_0.14.0-3_all.deb ... 2021-01-27T09:42:06.385 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-01-27T09:42:06.456 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libonig5:amd64. 2021-01-27T09:42:06.470 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../076-libonig5_6.9.4-1_amd64.deb ... 2021-01-27T09:42:06.505 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-01-27T09:42:06.847 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-sklearn. 2021-01-27T09:42:06.859 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjq1:amd64. 2021-01-27T09:42:06.866 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../062-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-01-27T09:42:06.873 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../077-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-27T09:42:06.897 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-27T09:42:06.919 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-27T09:42:07.205 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package jq. 2021-01-27T09:42:07.221 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../078-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-27T09:42:07.263 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-01-27T09:42:07.507 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package socat. 2021-01-27T09:42:07.527 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../079-socat_1.7.3.3-2_amd64.deb ... 2021-01-27T09:42:07.582 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking socat (1.7.3.3-2) ... 2021-01-27T09:42:07.714 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-01-27T09:42:07.734 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../063-ceph-mgr-diskprediction-local_17.0.0-139-g164b0f63-1focal_all.deb ... 2021-01-27T09:42:07.772 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-diskprediction-local (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:07.877 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package xmlstarlet. 2021-01-27T09:42:07.892 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../080-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-01-27T09:42:07.968 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-01-27T09:42:08.391 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-test. 2021-01-27T09:42:08.407 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../081-ceph-test_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:42:08.449 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-test (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:09.016 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-cachetools. 2021-01-27T09:42:09.036 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../064-python3-cachetools_4.0.0-1_all.deb ... 2021-01-27T09:42:09.066 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-01-27T09:42:09.444 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pyasn1. 2021-01-27T09:42:09.465 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../065-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-01-27T09:42:09.502 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-01-27T09:42:09.922 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-01-27T09:42:09.942 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../066-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-01-27T09:42:09.980 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-27T09:42:10.367 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-rsa. 2021-01-27T09:42:10.386 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../067-python3-rsa_4.0-3_all.deb ... 2021-01-27T09:42:10.425 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-rsa (4.0-3) ... 2021-01-27T09:42:10.803 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-google-auth. 2021-01-27T09:42:10.824 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../068-python3-google-auth_1.5.1-2_all.deb ... 2021-01-27T09:42:10.869 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-01-27T09:42:11.256 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-01-27T09:42:11.276 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../069-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-01-27T09:42:11.314 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-27T09:42:11.700 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-websocket. 2021-01-27T09:42:11.720 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../070-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-01-27T09:42:11.750 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-01-27T09:42:12.103 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-kubernetes. 2021-01-27T09:42:12.124 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../071-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-01-27T09:42:12.169 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-01-27T09:42:12.696 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-mirror. 2021-01-27T09:42:12.711 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../082-cephfs-mirror_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:42:12.754 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-mirror (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:12.903 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-01-27T09:42:12.925 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../072-ceph-mgr-k8sevents_17.0.0-139-g164b0f63-1focal_all.deb ... 2021-01-27T09:42:12.966 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-k8sevents (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:13.090 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-colorama. 2021-01-27T09:42:13.107 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../083-python3-colorama_0.4.3-1build1_all.deb ... 2021-01-27T09:42:13.148 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-01-27T09:42:13.360 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-json-pointer. 2021-01-27T09:42:13.380 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../073-python3-json-pointer_2.0-0ubuntu1_all.deb ... 2021-01-27T09:42:13.400 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-shell. 2021-01-27T09:42:13.414 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../084-cephfs-shell_17.0.0-139-g164b0f63-1focal_all.deb ... 2021-01-27T09:42:13.418 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-json-pointer (2.0-0ubuntu1) ... 2021-01-27T09:42:13.475 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-shell (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:13.687 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-top. 2021-01-27T09:42:13.703 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../085-cephfs-top_17.0.0-139-g164b0f63-1focal_all.deb ... 2021-01-27T09:42:13.736 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-top (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:13.764 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-jsonpatch. 2021-01-27T09:42:13.783 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../074-python3-jsonpatch_1.23-3_all.deb ... 2021-01-27T09:42:13.813 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-jsonpatch (1.23-3) ... 2021-01-27T09:42:14.014 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcephfs-dev. 2021-01-27T09:42:14.031 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../086-libcephfs-dev_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:42:14.072 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcephfs-dev (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:14.208 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-01-27T09:42:14.227 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../075-ceph-mgr-rook_17.0.0-139-g164b0f63-1focal_all.deb ... 2021-01-27T09:42:14.266 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-mgr-rook (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:14.484 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package nvme-cli. 2021-01-27T09:42:14.500 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-01-27T09:42:14.562 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-01-27T09:42:14.653 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libonig5:amd64. 2021-01-27T09:42:14.671 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../076-libonig5_6.9.4-1_amd64.deb ... 2021-01-27T09:42:14.710 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-01-27T09:42:14.923 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-atomicwrites. 2021-01-27T09:42:14.937 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-01-27T09:42:14.997 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-01-27T09:42:15.105 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libjq1:amd64. 2021-01-27T09:42:15.126 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../077-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-27T09:42:15.171 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-27T09:42:15.275 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-attr. 2021-01-27T09:42:15.289 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-01-27T09:42:15.350 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-01-27T09:42:15.499 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package jq. 2021-01-27T09:42:15.518 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../078-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-27T09:42:15.557 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-01-27T09:42:15.661 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webencodings. 2021-01-27T09:42:15.679 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-01-27T09:42:15.745 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-27T09:42:15.852 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package socat. 2021-01-27T09:42:15.871 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../079-socat_1.7.3.3-2_amd64.deb ... 2021-01-27T09:42:15.909 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking socat (1.7.3.3-2) ... 2021-01-27T09:42:16.039 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-html5lib. 2021-01-27T09:42:16.053 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-01-27T09:42:16.088 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-01-27T09:42:16.230 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package xmlstarlet. 2021-01-27T09:42:16.249 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../080-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-01-27T09:42:16.280 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-01-27T09:42:16.383 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-01-27T09:42:16.402 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.2_amd64.deb ... 2021-01-27T09:42:16.433 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-27T09:42:16.852 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package ceph-test. 2021-01-27T09:42:16.874 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../081-ceph-test_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:42:16.910 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking ceph-test (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:16.912 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-packaging. 2021-01-27T09:42:16.928 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-01-27T09:42:16.970 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-packaging (20.3-1) ... 2021-01-27T09:42:17.289 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pastescript. 2021-01-27T09:42:17.307 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-01-27T09:42:17.340 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-01-27T09:42:17.726 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pluggy. 2021-01-27T09:42:17.740 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-01-27T09:42:17.784 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-01-27T09:42:18.121 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-psutil. 2021-01-27T09:42:18.136 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-01-27T09:42:18.179 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-01-27T09:42:18.532 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-py. 2021-01-27T09:42:18.548 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../097-python3-py_1.8.1-1_all.deb ... 2021-01-27T09:42:18.590 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-py (1.8.1-1) ... 2021-01-27T09:42:18.944 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyinotify. 2021-01-27T09:42:18.958 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-01-27T09:42:19.002 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-27T09:42:19.288 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pytest. 2021-01-27T09:42:19.302 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-01-27T09:42:19.338 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-01-27T09:42:19.809 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package radosgw. 2021-01-27T09:42:19.830 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../100-radosgw_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:42:19.866 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking radosgw (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:20.937 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package rbd-fuse. 2021-01-27T09:42:20.951 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../101-rbd-fuse_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:42:20.995 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking rbd-fuse (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:21.081 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package cephfs-mirror. 2021-01-27T09:42:21.101 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../082-cephfs-mirror_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:42:21.138 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking cephfs-mirror (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:21.327 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-attr (19.3.0-2) ... 2021-01-27T09:42:21.549 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-colorama. 2021-01-27T09:42:21.562 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../083-python3-colorama_0.4.3-1build1_all.deb ... 2021-01-27T09:42:21.607 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-01-27T09:42:21.650 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-27T09:42:21.775 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-01-27T09:42:21.886 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package cephfs-shell. 2021-01-27T09:42:21.906 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../084-cephfs-shell_17.0.0-139-g164b0f63-1focal_all.deb ... 2021-01-27T09:42:21.926 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-01-27T09:42:21.935 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking cephfs-shell (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:22.128 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephadm (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:22.238 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package cephfs-top. 2021-01-27T09:42:22.258 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../085-cephfs-top_17.0.0-139-g164b0f63-1focal_all.deb ... 2021-01-27T09:42:22.296 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking cephfs-top (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:22.599 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libcephfs-dev. 2021-01-27T09:42:22.618 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../086-libcephfs-dev_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:42:22.681 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libcephfs-dev (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:22.772 INFO:teuthology.orchestra.run.smithi078.stdout:Adding system user cephadm....done 2021-01-27T09:42:22.909 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-01-27T09:42:23.096 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package nvme-cli. 2021-01-27T09:42:23.115 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-01-27T09:42:23.198 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-01-27T09:42:23.427 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-01-27T09:42:23.667 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-atomicwrites. 2021-01-27T09:42:23.686 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-01-27T09:42:23.725 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-01-27T09:42:23.904 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-01-27T09:42:24.004 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-py (1.8.1-1) ... 2021-01-27T09:42:24.103 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-attr. 2021-01-27T09:42:24.121 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-01-27T09:42:24.161 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-01-27T09:42:24.306 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-01-27T09:42:24.539 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-webencodings. 2021-01-27T09:42:24.559 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-01-27T09:42:24.588 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-27T09:42:24.708 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-01-27T09:42:24.942 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-html5lib. 2021-01-27T09:42:24.961 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-01-27T09:42:25.001 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-01-27T09:42:25.027 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-01-27T09:42:25.326 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-01-27T09:42:25.402 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-01-27T09:42:25.422 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.2_amd64.deb ... 2021-01-27T09:42:25.469 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-27T09:42:25.645 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-27T09:42:25.912 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-27T09:42:25.998 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-packaging. 2021-01-27T09:42:26.018 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-01-27T09:42:26.055 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-packaging (20.3-1) ... 2021-01-27T09:42:26.180 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-ceph-argparse (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:26.442 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pastescript. 2021-01-27T09:42:26.463 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-01-27T09:42:26.473 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-27T09:42:26.508 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-01-27T09:42:26.624 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-01-27T09:42:26.903 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pluggy. 2021-01-27T09:42:26.923 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-01-27T09:42:26.941 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-01-27T09:42:26.961 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-01-27T09:42:27.234 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-27T09:42:27.315 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-psutil. 2021-01-27T09:42:27.335 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-01-27T09:42:27.381 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-01-27T09:42:27.569 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-01-27T09:42:27.776 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-py. 2021-01-27T09:42:27.796 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../097-python3-py_1.8.1-1_all.deb ... 2021-01-27T09:42:27.833 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-py (1.8.1-1) ... 2021-01-27T09:42:27.995 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-01-27T09:42:28.212 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pyinotify. 2021-01-27T09:42:28.233 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-01-27T09:42:28.270 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-27T09:42:28.313 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-01-27T09:42:28.581 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjaeger (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:28.648 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package python3-pytest. 2021-01-27T09:42:28.668 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-01-27T09:42:28.706 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-01-27T09:42:28.778 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-01-27T09:42:29.235 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package radosgw. 2021-01-27T09:42:29.255 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../100-radosgw_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:42:29.293 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking radosgw (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:29.320 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-01-27T09:42:29.617 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-packaging (20.3-1) ... 2021-01-27T09:42:29.943 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-01-27T09:42:30.103 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-27T09:42:30.379 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-01-27T09:42:30.497 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package rbd-fuse. 2021-01-27T09:42:30.516 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../101-rbd-fuse_17.0.0-139-g164b0f63-1focal_amd64.deb ... 2021-01-27T09:42:30.554 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking rbd-fuse (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:30.814 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-01-27T09:42:30.956 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-attr (19.3.0-2) ... 2021-01-27T09:42:31.157 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-27T09:42:31.392 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-27T09:42:31.518 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-01-27T09:42:31.566 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up socat (1.7.3.3-2) ... 2021-01-27T09:42:31.654 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-01-27T09:42:31.726 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-ceph-common (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:31.879 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up cephadm (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:32.027 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-01-27T09:42:32.404 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-27T09:42:32.530 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-01-27T09:42:32.656 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-01-27T09:42:32.982 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-json-pointer (2.0-0ubuntu1) ... 2021-01-27T09:42:33.058 INFO:teuthology.orchestra.run.smithi146.stdout:Adding system user cephadm....done 2021-01-27T09:42:33.252 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-01-27T09:42:33.258 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-27T09:42:33.576 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-01-27T09:42:33.703 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-01-27T09:42:33.886 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-01-27T09:42:34.071 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-01-27T09:42:34.197 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-py (1.8.1-1) ... 2021-01-27T09:42:34.204 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-01-27T09:42:34.531 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-modules-core (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:34.615 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-01-27T09:42:34.656 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-27T09:42:34.807 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-01-27T09:42:35.100 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-01-27T09:42:35.125 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-01-27T09:42:35.384 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-27T09:42:35.493 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-01-27T09:42:35.702 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-01-27T09:42:35.869 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-01-27T09:42:36.046 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-01-27T09:42:36.262 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-27T09:42:36.334 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-01-27T09:42:36.456 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-27T09:42:36.596 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-27T09:42:36.757 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-27T09:42:36.964 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-ceph-argparse (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:37.076 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-01-27T09:42:37.365 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-27T09:42:37.435 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjs-underscore (1.9.1~dfsg-1) ... 2021-01-27T09:42:37.491 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-01-27T09:42:37.561 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-27T09:42:37.687 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-01-27T09:42:37.859 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-01-27T09:42:38.055 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librados2 (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:38.214 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-01-27T09:42:38.218 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-27T09:42:38.586 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-01-27T09:42:39.071 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-01-27T09:42:39.439 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-01-27T09:42:39.683 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librgw2 (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:39.784 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libjaeger (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:39.821 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-27T09:42:39.907 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-01-27T09:42:39.948 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-01-27T09:42:40.341 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jsonpatch (1.23-3) ... 2021-01-27T09:42:40.342 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-01-27T09:42:40.454 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/jsonpatch-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-01-27T09:42:40.701 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-01-27T09:42:40.726 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-packaging (20.3-1) ... 2021-01-27T09:42:40.994 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-01-27T09:42:41.127 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-01-27T09:42:41.253 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-27T09:42:41.387 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcephfs2 (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:41.496 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libradosstriper1 (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:41.630 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-27T09:42:41.679 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-01-27T09:42:41.940 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-27T09:42:42.214 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-01-27T09:42:42.616 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-27T09:42:43.005 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librbd1 (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:43.092 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up socat (1.7.3.3-2) ... 2021-01-27T09:42:43.105 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-27T09:42:43.218 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-ceph-common (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:43.231 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-01-27T09:42:43.349 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rsa (4.0-3) ... 2021-01-27T09:42:43.619 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-01-27T09:42:43.658 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-01-27T09:42:43.951 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-fuse (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:44.046 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-27T09:42:44.165 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-27T09:42:44.167 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-27T09:42:44.172 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-01-27T09:42:44.297 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-01-27T09:42:44.628 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcephfs-dev (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:44.674 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-json-pointer (2.0-0ubuntu1) ... 2021-01-27T09:42:44.795 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-01-27T09:42:45.018 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-27T09:42:45.143 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-01-27T09:42:45.426 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-01-27T09:42:45.507 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rados (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:45.633 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-top (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:45.751 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rbd (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:45.870 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-01-27T09:42:45.885 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up rbd-fuse (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:46.003 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-routes (2.4.1-2) ... 2021-01-27T09:42:46.212 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-01-27T09:42:46.313 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-01-27T09:42:46.588 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-modules-core (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:46.625 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rgw (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:46.716 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-27T09:42:46.840 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-01-27T09:42:46.850 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cephfs (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:46.967 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-shell (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:47.110 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-01-27T09:42:47.208 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-01-27T09:42:47.609 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-27T09:42:47.997 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-common (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:48.001 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-01-27T09:42:48.474 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-01-27T09:42:48.591 INFO:teuthology.orchestra.run.smithi078.stdout:Adding group ceph....done 2021-01-27T09:42:48.838 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-01-27T09:42:48.963 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-27T09:42:48.976 INFO:teuthology.orchestra.run.smithi078.stdout:Adding system user ceph....done 2021-01-27T09:42:49.110 INFO:teuthology.orchestra.run.smithi078.stdout:Setting system user ceph properties....done 2021-01-27T09:42:49.275 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-01-27T09:42:49.340 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-27T09:42:49.656 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-01-27T09:42:49.741 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-01-27T09:42:50.181 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-mirror (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:50.200 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libjs-underscore (1.9.1~dfsg-1) ... 2021-01-27T09:42:50.307 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-test (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:50.327 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-27T09:42:50.433 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up radosgw (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:50.453 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-01-27T09:42:50.731 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-27T09:42:50.732 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-27T09:42:50.870 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librados2 (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:50.996 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-01-27T09:42:51.352 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-base (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:51.689 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-01-27T09:42:52.145 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mds (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:52.355 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-27T09:42:52.355 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-27T09:42:52.805 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:52.835 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librgw2 (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:52.961 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-27T09:42:53.038 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-27T09:42:53.038 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-27T09:42:53.087 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-01-27T09:42:53.481 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-rook (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:53.606 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-jsonpatch (1.23-3) ... 2021-01-27T09:42:53.624 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-osd (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:53.706 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/bin/jsonpatch-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-01-27T09:42:54.016 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-01-27T09:42:54.111 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-27T09:42:54.111 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-27T09:42:54.383 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-01-27T09:42:54.693 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-k8sevents (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:54.826 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libcephfs2 (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:54.944 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libradosstriper1 (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:55.070 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-27T09:42:55.161 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-diskprediction-local (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:55.304 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mon (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:55.504 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-27T09:42:55.526 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-27T09:42:55.527 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-27T09:42:55.980 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-cephadm (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:56.123 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:56.274 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-dashboard (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:56.418 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-01-27T09:42:56.685 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-01-27T09:42:56.810 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up librbd1 (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:56.936 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-27T09:42:57.062 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-01-27T09:42:57.187 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rsa (4.0-3) ... 2021-01-27T09:42:57.581 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-01-27T09:42:57.956 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-fuse (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:58.258 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-27T09:42:58.259 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-27T09:42:59.177 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libcephfs-dev (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:42:59.311 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-01-27T09:42:59.712 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-01-27T09:42:59.788 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.1) ... 2021-01-27T09:43:00.173 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rados (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:43:00.196 INFO:teuthology.orchestra.run.smithi078.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-01-27T09:43:00.199 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-01-27T09:43:00.265 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2021-01-27T09:43:00.299 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up cephfs-top (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:43:00.417 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2021-01-27T09:43:00.418 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2021-01-27T09:43:00.425 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rbd (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:43:00.553 INFO:teuthology.orchestra.run.smithi078.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2021-01-27T09:43:00.554 INFO:teuthology.orchestra.run.smithi078.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-01-27T09:43:00.554 INFO:teuthology.orchestra.run.smithi078.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-01-27T09:43:00.554 INFO:teuthology.orchestra.run.smithi078.stdout:network-manager is already the newest version (1.22.10-1ubuntu2.2). 2021-01-27T09:43:00.554 INFO:teuthology.orchestra.run.smithi078.stdout:network-manager set to manually installed. 2021-01-27T09:43:00.555 INFO:teuthology.orchestra.run.smithi078.stdout:util-linux is already the newest version (2.34-0.1ubuntu9.1). 2021-01-27T09:43:00.555 INFO:teuthology.orchestra.run.smithi078.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-01-27T09:43:00.555 INFO:teuthology.orchestra.run.smithi078.stdout:The following package was automatically installed and is no longer required: 2021-01-27T09:43:00.555 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.71.0 2021-01-27T09:43:00.555 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove it. 2021-01-27T09:43:00.556 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2021-01-27T09:43:00.556 INFO:teuthology.orchestra.run.smithi078.stdout: libfl-dev libfl2 liblzo2-2 2021-01-27T09:43:00.556 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2021-01-27T09:43:00.557 INFO:teuthology.orchestra.run.smithi078.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-01-27T09:43:00.568 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up rbd-fuse (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:43:00.578 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2021-01-27T09:43:00.579 INFO:teuthology.orchestra.run.smithi078.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-01-27T09:43:00.579 INFO:teuthology.orchestra.run.smithi078.stdout: libssl-dev 2021-01-27T09:43:00.685 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-routes (2.4.1-2) ... 2021-01-27T09:43:00.777 INFO:teuthology.orchestra.run.smithi078.stdout:0 upgraded, 10 newly installed, 0 to remove and 22 not upgraded. 2021-01-27T09:43:00.777 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 2,912 kB of archives. 2021-01-27T09:43:00.778 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-01-27T09:43:00.778 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-01-27T09:43:01.062 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-01-27T09:43:01.238 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-01-27T09:43:01.375 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-01-27T09:43:01.381 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-01-27T09:43:01.401 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-01-27T09:43:01.406 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-01-27T09:43:01.407 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-01-27T09:43:01.411 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-01-27T09:43:01.412 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-01-27T09:43:01.413 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.1 [1,582 kB] 2021-01-27T09:43:01.455 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-rgw (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:43:01.699 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-cephfs (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:43:01.825 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up cephfs-shell (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:43:01.912 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 2,912 kB in 1s (3,141 kB/s) 2021-01-27T09:43:01.926 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-01-27T09:43:02.069 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package flex. 2021-01-27T09:43:02.120 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 121452 files and directories currently installed.) 2021-01-27T09:43:02.123 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../0-flex_2.6.4-6.2_amd64.deb ... 2021-01-27T09:43:02.158 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking flex (2.6.4-6.2) ... 2021-01-27T09:43:02.655 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package bison. 2021-01-27T09:43:02.671 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../1-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-01-27T09:43:02.717 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-01-27T09:43:03.112 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-common (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:43:03.184 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-01-27T09:43:03.198 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../2-liblzo2-2_2.10-2_amd64.deb ... 2021-01-27T09:43:03.285 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-01-27T09:43:03.654 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package dump. 2021-01-27T09:43:03.672 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../3-dump_0.4b46-6_amd64.deb ... 2021-01-27T09:43:03.712 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking dump (0.4b46-6) ... 2021-01-27T09:43:03.874 INFO:teuthology.orchestra.run.smithi146.stdout:Adding group ceph....done 2021-01-27T09:43:04.041 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package indent. 2021-01-27T09:43:04.056 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../4-indent_2.2.12-1_amd64.deb ... 2021-01-27T09:43:04.091 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking indent (2.2.12-1) ... 2021-01-27T09:43:04.357 INFO:teuthology.orchestra.run.smithi146.stdout:Adding system user ceph....done 2021-01-27T09:43:04.360 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-01-27T09:43:04.378 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../5-libaio-dev_0.3.112-5_amd64.deb ... 2021-01-27T09:43:04.418 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-01-27T09:43:04.609 INFO:teuthology.orchestra.run.smithi146.stdout:Setting system user ceph properties....done 2021-01-27T09:43:04.674 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-01-27T09:43:04.690 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../6-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-01-27T09:43:04.757 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-01-27T09:43:04.830 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-01-27T09:43:05.060 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libfl2:amd64. 2021-01-27T09:43:05.075 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../7-libfl2_2.6.4-6.2_amd64.deb ... 2021-01-27T09:43:05.135 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-01-27T09:43:05.372 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-01-27T09:43:05.463 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-01-27T09:43:05.478 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-01-27T09:43:05.538 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-01-27T09:43:05.774 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-01-27T09:43:05.790 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../9-libssl-dev_1.1.1f-1ubuntu2.1_amd64.deb ... 2021-01-27T09:43:05.832 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.1) ... 2021-01-27T09:43:06.290 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up cephfs-mirror (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:43:06.351 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up flex (2.6.4-6.2) ... 2021-01-27T09:43:06.416 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-test (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:43:06.478 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-01-27T09:43:06.558 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up radosgw (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:43:06.604 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-01-27T09:43:06.755 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.1) ... 2021-01-27T09:43:06.871 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-27T09:43:06.871 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-27T09:43:06.881 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-01-27T09:43:07.007 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-01-27T09:43:07.142 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up dump (0.4b46-6) ... 2021-01-27T09:43:07.229 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-01-27T09:43:07.285 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-01-27T09:43:07.375 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-01-27T09:43:07.478 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up indent (2.2.12-1) ... 2021-01-27T09:43:07.604 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-01-27T09:43:07.731 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.1) ... 2021-01-27T09:43:07.899 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-01-27T09:43:08.427 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-base (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:43:08.866 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-01-27T09:43:09.803 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mds (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:43:10.052 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-01-27T09:43:10.073 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-27T09:43:10.073 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-27T09:43:10.974 INFO:teuthology.orchestra.run.smithi078.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-01-27T09:43:10.977 DEBUG:teuthology.parallel:result is None 2021-01-27T09:43:11.005 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:43:11.276 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-27T09:43:11.276 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-27T09:43:12.256 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-rook (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:43:12.407 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-osd (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:43:13.282 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-27T09:43:13.589 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-27T09:43:14.202 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-k8sevents (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:43:14.327 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-diskprediction-local (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:43:14.478 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mon (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:43:14.739 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-27T09:43:14.739 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-27T09:43:15.688 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-cephadm (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:43:15.847 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:43:15.973 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up ceph-mgr-dashboard (17.0.0-139-g164b0f63-1focal) ... 2021-01-27T09:43:16.125 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-01-27T09:43:16.650 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-01-27T09:43:22.328 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.1) ... 2021-01-27T09:43:22.997 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-01-27T09:43:23.005 DEBUG:teuthology.orchestra.run.smithi146:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-01-27T09:43:23.137 INFO:teuthology.orchestra.run.smithi146.stdout:Reading package lists... 2021-01-27T09:43:23.291 INFO:teuthology.orchestra.run.smithi146.stdout:Building dependency tree... 2021-01-27T09:43:23.292 INFO:teuthology.orchestra.run.smithi146.stdout:Reading state information... 2021-01-27T09:43:23.425 INFO:teuthology.orchestra.run.smithi146.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2021-01-27T09:43:23.425 INFO:teuthology.orchestra.run.smithi146.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-01-27T09:43:23.425 INFO:teuthology.orchestra.run.smithi146.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-01-27T09:43:23.426 INFO:teuthology.orchestra.run.smithi146.stdout:network-manager is already the newest version (1.22.10-1ubuntu2.2). 2021-01-27T09:43:23.426 INFO:teuthology.orchestra.run.smithi146.stdout:network-manager set to manually installed. 2021-01-27T09:43:23.426 INFO:teuthology.orchestra.run.smithi146.stdout:util-linux is already the newest version (2.34-0.1ubuntu9.1). 2021-01-27T09:43:23.426 INFO:teuthology.orchestra.run.smithi146.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-01-27T09:43:23.427 INFO:teuthology.orchestra.run.smithi146.stdout:The following package was automatically installed and is no longer required: 2021-01-27T09:43:23.427 INFO:teuthology.orchestra.run.smithi146.stdout: libboost-iostreams1.71.0 2021-01-27T09:43:23.428 INFO:teuthology.orchestra.run.smithi146.stdout:Use 'sudo apt autoremove' to remove it. 2021-01-27T09:43:23.428 INFO:teuthology.orchestra.run.smithi146.stdout:The following additional packages will be installed: 2021-01-27T09:43:23.428 INFO:teuthology.orchestra.run.smithi146.stdout: libfl-dev libfl2 liblzo2-2 2021-01-27T09:43:23.428 INFO:teuthology.orchestra.run.smithi146.stdout:Suggested packages: 2021-01-27T09:43:23.428 INFO:teuthology.orchestra.run.smithi146.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-01-27T09:43:23.464 INFO:teuthology.orchestra.run.smithi146.stdout:The following NEW packages will be installed: 2021-01-27T09:43:23.465 INFO:teuthology.orchestra.run.smithi146.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-01-27T09:43:23.466 INFO:teuthology.orchestra.run.smithi146.stdout: libssl-dev 2021-01-27T09:43:23.663 INFO:teuthology.orchestra.run.smithi146.stdout:0 upgraded, 10 newly installed, 0 to remove and 22 not upgraded. 2021-01-27T09:43:23.664 INFO:teuthology.orchestra.run.smithi146.stdout:Need to get 2,912 kB of archives. 2021-01-27T09:43:23.664 INFO:teuthology.orchestra.run.smithi146.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-01-27T09:43:23.664 INFO:teuthology.orchestra.run.smithi146.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-01-27T09:43:24.138 INFO:teuthology.orchestra.run.smithi146.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-01-27T09:43:24.279 INFO:teuthology.orchestra.run.smithi146.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-01-27T09:43:24.287 INFO:teuthology.orchestra.run.smithi146.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-01-27T09:43:24.303 INFO:teuthology.orchestra.run.smithi146.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-01-27T09:43:24.311 INFO:teuthology.orchestra.run.smithi146.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-01-27T09:43:24.312 INFO:teuthology.orchestra.run.smithi146.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-01-27T09:43:24.317 INFO:teuthology.orchestra.run.smithi146.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-01-27T09:43:24.318 INFO:teuthology.orchestra.run.smithi146.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-01-27T09:43:24.318 INFO:teuthology.orchestra.run.smithi146.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.1 [1,582 kB] 2021-01-27T09:43:24.962 INFO:teuthology.orchestra.run.smithi146.stdout:Fetched 2,912 kB in 1s (3,066 kB/s) 2021-01-27T09:43:25.126 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package flex. 2021-01-27T09:43:25.219 INFO:teuthology.orchestra.run.smithi146.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 123944 files and directories currently installed.) 2021-01-27T09:43:25.223 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../0-flex_2.6.4-6.2_amd64.deb ... 2021-01-27T09:43:25.264 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking flex (2.6.4-6.2) ... 2021-01-27T09:43:25.777 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package bison. 2021-01-27T09:43:25.800 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../1-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-01-27T09:43:25.863 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-01-27T09:43:26.382 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-01-27T09:43:26.401 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../2-liblzo2-2_2.10-2_amd64.deb ... 2021-01-27T09:43:26.481 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-01-27T09:43:26.876 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package dump. 2021-01-27T09:43:26.897 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../3-dump_0.4b46-6_amd64.deb ... 2021-01-27T09:43:26.935 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking dump (0.4b46-6) ... 2021-01-27T09:43:27.271 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package indent. 2021-01-27T09:43:27.292 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../4-indent_2.2.12-1_amd64.deb ... 2021-01-27T09:43:27.330 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking indent (2.2.12-1) ... 2021-01-27T09:43:27.665 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-01-27T09:43:27.686 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../5-libaio-dev_0.3.112-5_amd64.deb ... 2021-01-27T09:43:27.724 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-01-27T09:43:28.077 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-01-27T09:43:28.097 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../6-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-01-27T09:43:28.135 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-01-27T09:43:28.496 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libfl2:amd64. 2021-01-27T09:43:28.510 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../7-libfl2_2.6.4-6.2_amd64.deb ... 2021-01-27T09:43:28.554 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-01-27T09:43:28.857 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-01-27T09:43:28.876 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-01-27T09:43:28.915 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-01-27T09:43:29.602 INFO:teuthology.orchestra.run.smithi146.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-01-27T09:43:29.623 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing to unpack .../9-libssl-dev_1.1.1f-1ubuntu2.1_amd64.deb ... 2021-01-27T09:43:29.668 INFO:teuthology.orchestra.run.smithi146.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.1) ... 2021-01-27T09:43:30.192 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up flex (2.6.4-6.2) ... 2021-01-27T09:43:30.323 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-01-27T09:43:30.449 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-01-27T09:43:30.575 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.1) ... 2021-01-27T09:43:30.692 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-01-27T09:43:30.818 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-01-27T09:43:30.944 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up dump (0.4b46-6) ... 2021-01-27T09:43:31.073 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-01-27T09:43:31.138 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-01-27T09:43:31.239 INFO:teuthology.orchestra.run.smithi146.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-01-27T09:43:31.306 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up indent (2.2.12-1) ... 2021-01-27T09:43:31.432 INFO:teuthology.orchestra.run.smithi146.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-01-27T09:43:31.568 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.1) ... 2021-01-27T09:43:31.727 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-01-27T09:43:35.755 INFO:teuthology.orchestra.run.smithi146.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-01-27T09:43:36.835 INFO:teuthology.orchestra.run.smithi146.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-01-27T09:43:36.843 DEBUG:teuthology.parallel:result is None 2021-01-27T09:43:36.844 DEBUG:teuthology.orchestra.run.smithi146:> sudo lsb_release -is 2021-01-27T09:43:36.917 INFO:teuthology.orchestra.run.smithi146.stdout:Ubuntu 2021-01-27T09:43:36.926 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T09:43:36.927 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=164b0f632a5fe3384fa7cbb10929c65ed7cc0f12 2021-01-27T09:43:37.093 DEBUG:teuthology.orchestra.run.smithi146:> dpkg-query -W -f '${Version}' ceph 2021-01-27T09:43:37.136 INFO:teuthology.orchestra.run.smithi146.stdout:17.0.0-139-g164b0f63-1focal 2021-01-27T09:43:37.137 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-139-g164b0f63-1focal 2021-01-27T09:43:37.138 INFO:teuthology.task.install:The correct ceph version 17.0.0-139-g164b0f63-1focal is installed. 2021-01-27T09:43:37.138 DEBUG:teuthology.orchestra.run.smithi078:> sudo lsb_release -is 2021-01-27T09:43:37.184 INFO:teuthology.orchestra.run.smithi078.stdout:Ubuntu 2021-01-27T09:43:37.189 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T09:43:37.190 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=164b0f632a5fe3384fa7cbb10929c65ed7cc0f12 2021-01-27T09:43:37.351 DEBUG:teuthology.orchestra.run.smithi078:> dpkg-query -W -f '${Version}' ceph 2021-01-27T09:43:37.377 INFO:teuthology.orchestra.run.smithi078.stdout:17.0.0-139-g164b0f63-1focal 2021-01-27T09:43:37.378 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-139-g164b0f63-1focal 2021-01-27T09:43:37.378 INFO:teuthology.task.install:The correct ceph version 17.0.0-139-g164b0f63-1focal is installed. 2021-01-27T09:43:37.379 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-01-27T09:43:37.379 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:43:37.379 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-01-27T09:43:37.415 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2021-01-27T09:43:37.416 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-01-27T09:43:37.432 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-01-27T09:43:37.432 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:43:37.433 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/daemon-helper 2021-01-27T09:43:37.468 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-01-27T09:43:37.550 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2021-01-27T09:43:37.551 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2021-01-27T09:43:37.567 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-01-27T09:43:37.623 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-01-27T09:43:37.624 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:43:37.624 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/adjust-ulimits 2021-01-27T09:43:37.662 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-01-27T09:43:37.695 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2021-01-27T09:43:37.695 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2021-01-27T09:43:37.712 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-01-27T09:43:37.723 INFO:teuthology.run_tasks:Running task ceph... 2021-01-27T09:43:37.787 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-01-27T09:43:37.787 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /var/log/ceph 2021-01-27T09:43:37.790 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 777 /var/log/ceph 2021-01-27T09:43:37.825 INFO:tasks.ceph:Disabling ceph logrotate... 2021-01-27T09:43:37.826 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/logrotate.d/ceph 2021-01-27T09:43:37.828 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/logrotate.d/ceph 2021-01-27T09:43:37.863 INFO:tasks.ceph:Creating extra log directories... 2021-01-27T09:43:37.864 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-01-27T09:43:37.886 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-01-27T09:43:37.980 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2021-01-27T09:43:37.980 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2021-01-27T09:43:37.981 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2021-01-27T09:43:37.982 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:43:37.982 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-01-27T09:43:38.002 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-01-27T09:43:38.091 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2021-01-27T09:43:38.092 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-01-27T09:43:38.099 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-01-27T09:43:38.142 INFO:tasks.ceph:Creating ceph cluster ceph... 2021-01-27T09:43:38.142 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', 'Throttler Limit has been hit. Some message processing may be significantly delayed.', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-01-27T09:43:38.142 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/jcollin-2021-01-27_09:11:59-fs-wip-jcollin-dispatch-queue-throttle-test-distro-basic-smithi/5833404', 'branch': 'wip-jcollin-dispatch-queue-throttle-test', 'description': 'fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag_enable session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}}', 'email': 'jcollin@redhat.com', 'first_in_suite': False, 'job_id': '5833404', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'jcollin-2021-01-27_09:11:59-fs-wip-jcollin-dispatch-queue-throttle-test-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-jcollin-dispatch-queue-throttle-test'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', 'Throttler Limit has been hit. Some message processing may be significantly delayed.', 'SLOW_OPS', 'slow request'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '164b0f632a5fe3384fa7cbb10929c65ed7cc0f12'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'sha1': '164b0f632a5fe3384fa7cbb10929c65ed7cc0f12'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-jcollin-dispatch-queue-throttle-test', 'sha1': '164b0f632a5fe3384fa7cbb10929c65ed7cc0f12'}}, 'owner': 'scheduled_jcollin@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'sha1': '164b0f632a5fe3384fa7cbb10929c65ed7cc0f12', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-jcollin-dispatch-queue-throttle-test', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_wip-jcollin-dispatch-queue-throttle-test/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '164b0f632a5fe3384fa7cbb10929c65ed7cc0f12', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': '164b0f632a5fe3384fa7cbb10929c65ed7cc0f12'}}, {'ceph': None}, {'kclient': None}, {'mds_thrash': None}, {'workunit': {'clients': {'all': ['suites/ffsb.sh']}}}], 'teuthology_branch': 'master', 'timestamp': '2021-01-27_09:11:59', 'tube': 'smithi', 'user': 'jcollin', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.9388', 'targets': {'smithi146.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDA3evINg9x2K0MA9X0CUPpqITBfMM/flucqtn5muhr5wUxXyxaewdkYGQm2UR/q7ukg0Z4IdG13LhTbeB8cW9ay6wPBYaOdPoKlclqZblLlTRUZu1QnJv45VOEmPDevUdMobvZGyKpRom1vRKfGrpX/qOpjNJHinzOjfblNoUr2P/b8GEe+w11tGeDApaLT/v7WmOo0X/LZ0iTH0kJZ2JwO1iL6mbYLoSUveD8uETgi7r8XpWjQ4I8/X8t2a1Gm167BRtKHu0zANq5VlFNZApqiqi8D1sHZPo0L/5MOk1Rm6WmN1JXIljn98KAAGMiWkfqr1ZyRbN3oipZFqD6rKWX3CwAqo+6hoJ0aA/vZDIpMQUWMxqqizU56hhlTkOrllZwCaAbeDWRrdDWEzSgfS32Rqhj0OqtuY3m8o1gjNIPfvxiw06R2ZQaIgIyoIoGKy6+d302avV1xfGpuh18qYmxH35zjGeBJnnKSagCtc/5pwBJU5tLYTuKaWrkko4vl7c=', 'smithi078.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyrFlzi4uwS8PL4QOIWjUvs4VRQxYIteBp9IKQhu4tyBL9knFedSXBeTcQmzyVOA4/UMBRoDS4Jm7xu5mxwH8Ocx+C89sevcoWl0gf5dpbL2S1wU/MHKxJlZGmyzXLSZNBKHKQmbLhnspU6+Xo5wPn1RMny1gHRDBVIO4258j4x2TbUXFkuhXZJjFy+R/hVIRJkb9Q9JpCWQz/gCT0GEBy5d2WgiL1c5vuIwl+Qxf13gSGYOGWdxAXfi8O+kVy0m2KhD5pL5wZxQXZZ5xBv8a4uBUgBKaXdit+ecnINpjwPMqe1cuVZTcRx75YIoOWQZfsLepYHgPdJXCEQniabYwcnSS/esfvIDvXi2iD2iofUYe/FNzeYIXdqpdi6X/xxMU9ojtCRuhkAo61plk8EAfxxorQBx+t9LBJPYB/n9BTdJE+jt17YL+N5QakMQK9zhliGh92fynbVhRR0lLNTyXJ2TPIE7fxqK1HTcQeFrZEeq0MzjSZXom1bOuiIKpw3KU='}} 2021-01-27T09:43:38.143 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-01-27T09:43:38.146 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-01-27T09:43:38.167 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/run/ceph 2021-01-27T09:43:38.194 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/run/ceph 2021-01-27T09:43:38.233 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:43:38.233 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/scratch_devs of=/dev/stdout 2021-01-27T09:43:38.250 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-01-27T09:43:38.250 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-01-27T09:43:38.318 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-01-27T09:43:38.318 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T09:43:38.318 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 498 Links: 1 2021-01-27T09:43:38.319 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T09:43:38.319 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2021-01-27 09:40:22.523766507 +0000 2021-01-27T09:43:38.319 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2021-01-27 09:40:22.255766513 +0000 2021-01-27T09:43:38.319 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2021-01-27 09:40:22.255766513 +0000 2021-01-27T09:43:38.319 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2021-01-27T09:43:38.343 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2021-01-27T09:43:38.343 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2021-01-27T09:43:38.343 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000682316 s, 750 kB/s 2021-01-27T09:43:38.353 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-01-27T09:43:38.371 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-01-27T09:43:38.371 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T09:43:38.371 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 505 Links: 1 2021-01-27T09:43:38.371 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T09:43:38.372 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2021-01-27 09:40:22.831766500 +0000 2021-01-27T09:43:38.372 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2021-01-27 09:40:22.827766500 +0000 2021-01-27T09:43:38.372 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2021-01-27 09:40:22.827766500 +0000 2021-01-27T09:43:38.372 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2021-01-27T09:43:38.396 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2021-01-27T09:43:38.397 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2021-01-27T09:43:38.397 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000853081 s, 600 kB/s 2021-01-27T09:43:38.407 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-01-27T09:43:38.429 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-01-27T09:43:38.429 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T09:43:38.430 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 510 Links: 1 2021-01-27T09:43:38.430 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T09:43:38.430 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2021-01-27 09:40:23.699766481 +0000 2021-01-27T09:43:38.430 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2021-01-27 09:40:23.419766487 +0000 2021-01-27T09:43:38.431 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2021-01-27 09:40:23.419766487 +0000 2021-01-27T09:43:38.431 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2021-01-27T09:43:38.447 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2021-01-27T09:43:38.448 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2021-01-27T09:43:38.448 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000842434 s, 608 kB/s 2021-01-27T09:43:38.458 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-01-27T09:43:38.522 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-01-27T09:43:38.523 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T09:43:38.523 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 519 Links: 1 2021-01-27T09:43:38.523 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T09:43:38.523 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2021-01-27 09:40:24.335766467 +0000 2021-01-27T09:43:38.523 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2021-01-27 09:40:24.035766473 +0000 2021-01-27T09:43:38.524 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2021-01-27 09:40:24.035766473 +0000 2021-01-27T09:43:38.524 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2021-01-27T09:43:38.539 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2021-01-27T09:43:38.539 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2021-01-27T09:43:38.540 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000707675 s, 723 kB/s 2021-01-27T09:43:38.550 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-01-27T09:43:38.550 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2021-01-27T09:43:38.550 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/scratch_devs of=/dev/stdout 2021-01-27T09:43:38.557 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-01-27T09:43:38.558 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-01-27T09:43:38.565 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-01-27T09:43:38.566 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T09:43:38.566 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 346 Links: 1 2021-01-27T09:43:38.566 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T09:43:38.567 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2021-01-27 09:39:56.026015840 +0000 2021-01-27T09:43:38.567 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2021-01-27 09:39:56.022015840 +0000 2021-01-27T09:43:38.568 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2021-01-27 09:39:56.022015840 +0000 2021-01-27T09:43:38.568 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2021-01-27T09:43:38.576 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2021-01-27T09:43:38.577 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2021-01-27T09:43:38.577 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.00118547 s, 432 kB/s 2021-01-27T09:43:38.581 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-01-27T09:43:38.588 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-01-27T09:43:38.589 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T09:43:38.589 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 352 Links: 1 2021-01-27T09:43:38.590 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T09:43:38.590 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2021-01-27 09:39:56.530015834 +0000 2021-01-27T09:43:38.590 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2021-01-27 09:39:56.370015836 +0000 2021-01-27T09:43:38.590 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2021-01-27 09:39:56.370015836 +0000 2021-01-27T09:43:38.591 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2021-01-27T09:43:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2021-01-27T09:43:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2021-01-27T09:43:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000331824 s, 1.5 MB/s 2021-01-27T09:43:38.603 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-01-27T09:43:38.651 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-01-27T09:43:38.651 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T09:43:38.652 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 362 Links: 1 2021-01-27T09:43:38.652 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T09:43:38.652 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2021-01-27 09:39:56.894015830 +0000 2021-01-27T09:43:38.653 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2021-01-27 09:39:56.742015832 +0000 2021-01-27T09:43:38.653 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2021-01-27 09:39:56.742015832 +0000 2021-01-27T09:43:38.653 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2021-01-27T09:43:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2021-01-27T09:43:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2021-01-27T09:43:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000408593 s, 1.3 MB/s 2021-01-27T09:43:38.666 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-01-27T09:43:38.673 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-01-27T09:43:38.673 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T09:43:38.673 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 6h/6d Inode: 366 Links: 1 2021-01-27T09:43:38.674 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T09:43:38.674 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2021-01-27 09:39:57.298015826 +0000 2021-01-27T09:43:38.674 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2021-01-27 09:39:57.134015828 +0000 2021-01-27T09:43:38.674 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2021-01-27 09:39:57.134015828 +0000 2021-01-27T09:43:38.675 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2021-01-27T09:43:38.683 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2021-01-27T09:43:38.683 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2021-01-27T09:43:38.683 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000410686 s, 1.2 MB/s 2021-01-27T09:43:38.688 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-01-27T09:43:38.688 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-01-27T09:43:38.689 INFO:tasks.ceph:Generating config... 2021-01-27T09:43:38.691 INFO:tasks.ceph:[client] client mount timeout = 600 2021-01-27T09:43:38.691 INFO:tasks.ceph:[client] debug client = 20 2021-01-27T09:43:38.692 INFO:tasks.ceph:[client] debug ms = 1 2021-01-27T09:43:38.692 INFO:tasks.ceph:[client] rados mon op timeout = 15m 2021-01-27T09:43:38.693 INFO:tasks.ceph:[client] rados osd op timeout = 15m 2021-01-27T09:43:38.693 INFO:tasks.ceph:[global] ms die on skipped message = False 2021-01-27T09:43:38.693 INFO:tasks.ceph:[mds] debug mds = 20 2021-01-27T09:43:38.693 INFO:tasks.ceph:[mds] debug ms = 1 2021-01-27T09:43:38.694 INFO:tasks.ceph:[mds] mds bal frag = True 2021-01-27T09:43:38.694 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2021-01-27T09:43:38.694 INFO:tasks.ceph:[mds] mds bal merge size = 5 2021-01-27T09:43:38.695 INFO:tasks.ceph:[mds] mds bal split bits = 3 2021-01-27T09:43:38.695 INFO:tasks.ceph:[mds] mds bal split size = 100 2021-01-27T09:43:38.695 INFO:tasks.ceph:[mds] mds debug frag = True 2021-01-27T09:43:38.696 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2021-01-27T09:43:38.696 INFO:tasks.ceph:[mds] mds op complaint time = 180 2021-01-27T09:43:38.696 INFO:tasks.ceph:[mds] mds verify scatter = True 2021-01-27T09:43:38.696 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2021-01-27T09:43:38.697 INFO:tasks.ceph:[mds] ms inject delay max = 1 2021-01-27T09:43:38.697 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2021-01-27T09:43:38.697 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2021-01-27T09:43:38.698 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2021-01-27T09:43:38.698 INFO:tasks.ceph:[mds] osd op complaint time = 180 2021-01-27T09:43:38.698 INFO:tasks.ceph:[mds] rados mon op timeout = 15m 2021-01-27T09:43:38.698 INFO:tasks.ceph:[mds] rados osd op timeout = 15m 2021-01-27T09:43:38.699 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-01-27T09:43:38.699 INFO:tasks.ceph:[mgr] debug ms = 1 2021-01-27T09:43:38.699 INFO:tasks.ceph:[mon] debug mon = 20 2021-01-27T09:43:38.700 INFO:tasks.ceph:[mon] debug ms = 1 2021-01-27T09:43:38.700 INFO:tasks.ceph:[mon] debug paxos = 20 2021-01-27T09:43:38.700 INFO:tasks.ceph:[mon] mon op complaint time = 120 2021-01-27T09:43:38.701 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2021-01-27T09:43:38.701 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2021-01-27T09:43:38.701 INFO:tasks.ceph:[osd] debug bluefs = 20 2021-01-27T09:43:38.701 INFO:tasks.ceph:[osd] debug bluestore = 20 2021-01-27T09:43:38.702 INFO:tasks.ceph:[osd] debug filestore = 20 2021-01-27T09:43:38.702 INFO:tasks.ceph:[osd] debug journal = 20 2021-01-27T09:43:38.702 INFO:tasks.ceph:[osd] debug ms = 20 2021-01-27T09:43:38.703 INFO:tasks.ceph:[osd] debug osd = 25 2021-01-27T09:43:38.703 INFO:tasks.ceph:[osd] debug rocksdb = 10 2021-01-27T09:43:38.703 INFO:tasks.ceph:[osd] filestore flush min = 0 2021-01-27T09:43:38.703 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2021-01-27T09:43:38.704 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2021-01-27T09:43:38.704 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2021-01-27T09:43:38.704 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2021-01-27T09:43:38.705 INFO:tasks.ceph:[osd] ms inject delay max = 1 2021-01-27T09:43:38.705 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2021-01-27T09:43:38.705 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2021-01-27T09:43:38.706 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2021-01-27T09:43:38.706 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2021-01-27T09:43:38.706 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2021-01-27T09:43:38.706 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2021-01-27T09:43:38.707 INFO:tasks.ceph:[osd] osd op complaint time = 180 2021-01-27T09:43:38.707 INFO:tasks.ceph:Setting up mon.a... 2021-01-27T09:43:38.708 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2021-01-27T09:43:38.776 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.keyring 2021-01-27T09:43:38.784 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2021-01-27T09:43:38.848 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-01-27T09:43:38.881 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.146'), ('mon.b', '172.21.15.78'), ('mon.c', '[v2:172.21.15.78:3301,v1:172.21.15.78:6790]')] 2021-01-27T09:43:38.882 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.146,172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}} 2021-01-27T09:43:38.883 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:43:38.884 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2021-01-27T09:43:38.902 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.146 --add b 172.21.15.78 --addv c '[v2:172.21.15.78:3301,v1:172.21.15.78:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2021-01-27T09:43:39.005 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2021-01-27T09:43:39.006 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: generated fsid 968a1bec-aac5-444e-b70f-7770587be945 2021-01-27T09:43:39.006 INFO:teuthology.orchestra.run.smithi146.stdout:epoch 0 2021-01-27T09:43:39.006 INFO:teuthology.orchestra.run.smithi146.stdout:fsid 968a1bec-aac5-444e-b70f-7770587be945 2021-01-27T09:43:39.006 INFO:teuthology.orchestra.run.smithi146.stdout:last_changed 2021-01-27T09:43:39.010260+0000 2021-01-27T09:43:39.007 INFO:teuthology.orchestra.run.smithi146.stdout:created 2021-01-27T09:43:39.010260+0000 2021-01-27T09:43:39.007 INFO:teuthology.orchestra.run.smithi146.stdout:min_mon_release 0 (unknown) 2021-01-27T09:43:39.007 INFO:teuthology.orchestra.run.smithi146.stdout:election_strategy: 1 2021-01-27T09:43:39.007 INFO:teuthology.orchestra.run.smithi146.stdout:0: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.a 2021-01-27T09:43:39.008 INFO:teuthology.orchestra.run.smithi146.stdout:1: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.b 2021-01-27T09:43:39.008 INFO:teuthology.orchestra.run.smithi146.stdout:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2021-01-27T09:43:39.008 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2021-01-27T09:43:39.010 DEBUG:teuthology.orchestra.run.smithi146:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2021-01-27T09:43:39.027 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 968a1bec-aac5-444e-b70f-7770587be945... 2021-01-27T09:43:39.029 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-01-27T09:43:39.032 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-01-27T09:43:39.065 INFO:teuthology.orchestra.run.smithi078.stdout:[global] 2021-01-27T09:43:39.065 INFO:teuthology.orchestra.run.smithi078.stdout: chdir = "" 2021-01-27T09:43:39.066 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-01-27T09:43:39.066 INFO:teuthology.orchestra.run.smithi078.stdout: auth supported = cephx 2021-01-27T09:43:39.066 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.066 INFO:teuthology.orchestra.run.smithi078.stdout: filestore xattr use omap = true 2021-01-27T09:43:39.066 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.067 INFO:teuthology.orchestra.run.smithi078.stdout: mon clock drift allowed = 1.000 2021-01-27T09:43:39.067 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.067 INFO:teuthology.orchestra.run.smithi078.stdout: osd crush chooseleaf type = 0 2021-01-27T09:43:39.067 INFO:teuthology.orchestra.run.smithi078.stdout: auth debug = true 2021-01-27T09:43:39.068 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.068 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on old message = true 2021-01-27T09:43:39.068 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on bug = true 2021-01-27T09:43:39.068 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.068 INFO:teuthology.orchestra.run.smithi078.stdout: mon max pg per osd = 10000 # >= luminous 2021-01-27T09:43:39.069 INFO:teuthology.orchestra.run.smithi078.stdout: mon pg warn max object skew = 0 2021-01-27T09:43:39.069 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.069 INFO:teuthology.orchestra.run.smithi078.stdout: # disable pg_autoscaler by default for new pools 2021-01-27T09:43:39.069 INFO:teuthology.orchestra.run.smithi078.stdout: osd_pool_default_pg_autoscale_mode = off 2021-01-27T09:43:39.069 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.070 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default size = 2 2021-01-27T09:43:39.070 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.070 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow primary affinity = true 2021-01-27T09:43:39.070 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow pg remap = true 2021-01-27T09:43:39.071 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on legacy crush tunables = false 2021-01-27T09:43:39.071 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on crush straw calc version zero = false 2021-01-27T09:43:39.071 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on no sortbitwise = false 2021-01-27T09:43:39.071 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on osd down out interval zero = false 2021-01-27T09:43:39.071 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on too few osds = false 2021-01-27T09:43:39.072 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-01-27T09:43:39.072 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_no_redundancy = false 2021-01-27T09:43:39.072 INFO:teuthology.orchestra.run.smithi078.stdout: mon_allow_pool_size_one = true 2021-01-27T09:43:39.072 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.072 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-01-27T09:43:39.073 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.073 INFO:teuthology.orchestra.run.smithi078.stdout: osd default data pool replay window = 5 2021-01-27T09:43:39.073 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.073 INFO:teuthology.orchestra.run.smithi078.stdout: mon allow pool delete = true 2021-01-27T09:43:39.073 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.074 INFO:teuthology.orchestra.run.smithi078.stdout: mon cluster log file level = debug 2021-01-27T09:43:39.074 INFO:teuthology.orchestra.run.smithi078.stdout: debug asserts on shutdown = true 2021-01-27T09:43:39.074 INFO:teuthology.orchestra.run.smithi078.stdout: mon health detail to clog = false 2021-01-27T09:43:39.074 INFO:teuthology.orchestra.run.smithi078.stdout: mon host = "172.21.15.146,172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790]" 2021-01-27T09:43:39.075 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on skipped message = False 2021-01-27T09:43:39.075 INFO:teuthology.orchestra.run.smithi078.stdout: fsid = 968a1bec-aac5-444e-b70f-7770587be945 2021-01-27T09:43:39.075 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.075 INFO:teuthology.orchestra.run.smithi078.stdout:[osd] 2021-01-27T09:43:39.075 INFO:teuthology.orchestra.run.smithi078.stdout: osd journal size = 100 2021-01-27T09:43:39.076 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.076 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub load threshold = 5.0 2021-01-27T09:43:39.076 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub max interval = 600 2021-01-27T09:43:39.076 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.076 INFO:teuthology.orchestra.run.smithi078.stdout: osd recover clone overlap = true 2021-01-27T09:43:39.077 INFO:teuthology.orchestra.run.smithi078.stdout: osd recovery max chunk = 1048576 2021-01-27T09:43:39.077 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.077 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug shutdown = true 2021-01-27T09:43:39.077 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug op order = true 2021-01-27T09:43:39.077 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug verify stray on activate = true 2021-01-27T09:43:39.078 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.078 INFO:teuthology.orchestra.run.smithi078.stdout: osd open classes on start = true 2021-01-27T09:43:39.078 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug pg log writeout = true 2021-01-27T09:43:39.078 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.078 INFO:teuthology.orchestra.run.smithi078.stdout: osd deep scrub update digest min age = 30 2021-01-27T09:43:39.079 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.079 INFO:teuthology.orchestra.run.smithi078.stdout: osd map max advance = 10 2021-01-27T09:43:39.079 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.079 INFO:teuthology.orchestra.run.smithi078.stdout: journal zero on create = true 2021-01-27T09:43:39.080 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.080 INFO:teuthology.orchestra.run.smithi078.stdout: filestore ondisk finisher threads = 3 2021-01-27T09:43:39.080 INFO:teuthology.orchestra.run.smithi078.stdout: filestore apply finisher threads = 3 2021-01-27T09:43:39.080 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.080 INFO:teuthology.orchestra.run.smithi078.stdout: bdev debug aio = true 2021-01-27T09:43:39.081 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug misdirected ops = true 2021-01-27T09:43:39.081 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore block size = 96636764160 2021-01-27T09:43:39.081 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore fsck on mount = True 2021-01-27T09:43:39.081 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluefs = 20 2021-01-27T09:43:39.081 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluestore = 20 2021-01-27T09:43:39.082 INFO:teuthology.orchestra.run.smithi078.stdout: debug filestore = 20 2021-01-27T09:43:39.082 INFO:teuthology.orchestra.run.smithi078.stdout: debug journal = 20 2021-01-27T09:43:39.082 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 20 2021-01-27T09:43:39.082 INFO:teuthology.orchestra.run.smithi078.stdout: debug osd = 25 2021-01-27T09:43:39.082 INFO:teuthology.orchestra.run.smithi078.stdout: debug rocksdb = 10 2021-01-27T09:43:39.083 INFO:teuthology.orchestra.run.smithi078.stdout: filestore flush min = 0 2021-01-27T09:43:39.083 INFO:teuthology.orchestra.run.smithi078.stdout: mon client directed command retry = 5 2021-01-27T09:43:39.083 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd backfillfull_ratio = 0.85 2021-01-27T09:43:39.083 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd full ratio = 0.9 2021-01-27T09:43:39.083 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd nearfull ratio = 0.8 2021-01-27T09:43:39.084 INFO:teuthology.orchestra.run.smithi078.stdout: ms inject delay max = 1 2021-01-27T09:43:39.084 INFO:teuthology.orchestra.run.smithi078.stdout: ms inject delay probability = 0.005 2021-01-27T09:43:39.084 INFO:teuthology.orchestra.run.smithi078.stdout: ms inject delay type = client mds 2021-01-27T09:43:39.084 INFO:teuthology.orchestra.run.smithi078.stdout: ms inject socket failures = 2500 2021-01-27T09:43:39.084 INFO:teuthology.orchestra.run.smithi078.stdout: osd failsafe full ratio = 0.95 2021-01-27T09:43:39.085 INFO:teuthology.orchestra.run.smithi078.stdout: osd max markdown count = 1000 2021-01-27T09:43:39.085 INFO:teuthology.orchestra.run.smithi078.stdout: osd objectstore = bluestore 2021-01-27T09:43:39.085 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2021-01-27T09:43:39.085 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.086 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr] 2021-01-27T09:43:39.086 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2021-01-27T09:43:39.086 INFO:teuthology.orchestra.run.smithi078.stdout: debug mgr = 20 2021-01-27T09:43:39.086 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2021-01-27T09:43:39.087 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2021-01-27T09:43:39.087 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2021-01-27T09:43:39.087 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2021-01-27T09:43:39.087 INFO:teuthology.orchestra.run.smithi078.stdout: mgr/telemetry/nag = false 2021-01-27T09:43:39.087 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.088 INFO:teuthology.orchestra.run.smithi078.stdout:[mon] 2021-01-27T09:43:39.088 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2021-01-27T09:43:39.088 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2021-01-27T09:43:39.088 INFO:teuthology.orchestra.run.smithi078.stdout: debug paxos = 20 2021-01-27T09:43:39.089 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2021-01-27T09:43:39.089 INFO:teuthology.orchestra.run.smithi078.stdout: mon data avail warn = 5 2021-01-27T09:43:39.089 INFO:teuthology.orchestra.run.smithi078.stdout: mon mgr mkfs grace = 240 2021-01-27T09:43:39.089 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2021-01-27T09:43:39.090 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd reporter subtree level = osd 2021-01-27T09:43:39.090 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd prime pg temp = true 2021-01-27T09:43:39.090 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2021-01-27T09:43:39.090 INFO:teuthology.orchestra.run.smithi078.stdout: mon op complaint time = 120 2021-01-27T09:43:39.090 INFO:teuthology.orchestra.run.smithi078.stdout: 2021-01-27T09:43:39.091 INFO:teuthology.orchestra.run.smithi078.stdout:[client] 2021-01-27T09:43:39.091 INFO:teuthology.orchestra.run.smithi078.stdout: rgw cache enabled = true 2021-01-27T09:43:39.091 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable ops log = true 2021-01-27T09:43:39.091 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable usage log = true 2021-01-27T09:43:39.091 INFO:teuthology.orchestra.run.smithi078.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-01-27T09:43:39.092 INFO:teuthology.orchestra.run.smithi078.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-01-27T09:43:39.092 INFO:teuthology.orchestra.run.smithi078.stdout: client mount timeout = 600 2021-01-27T09:43:39.092 INFO:teuthology.orchestra.run.smithi078.stdout: debug client = 20 2021-01-27T09:43:39.092 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2021-01-27T09:43:39.092 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 15m 2021-01-27T09:43:39.093 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 15m 2021-01-27T09:43:39.093 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.a] 2021-01-27T09:43:39.093 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.b] 2021-01-27T09:43:39.093 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.c] 2021-01-27T09:43:39.094 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2021-01-27T09:43:39.094 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2021-01-27T09:43:39.094 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.e] 2021-01-27T09:43:39.094 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2021-01-27T09:43:39.094 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.d] 2021-01-27T09:43:39.095 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.f] 2021-01-27T09:43:39.095 INFO:teuthology.orchestra.run.smithi078.stdout:[mds] 2021-01-27T09:43:39.095 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds = 20 2021-01-27T09:43:39.095 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2021-01-27T09:43:39.095 INFO:teuthology.orchestra.run.smithi078.stdout: mds bal frag = True 2021-01-27T09:43:39.096 INFO:teuthology.orchestra.run.smithi078.stdout: mds bal fragment size max = 10000 2021-01-27T09:43:39.096 INFO:teuthology.orchestra.run.smithi078.stdout: mds bal merge size = 5 2021-01-27T09:43:39.096 INFO:teuthology.orchestra.run.smithi078.stdout: mds bal split bits = 3 2021-01-27T09:43:39.096 INFO:teuthology.orchestra.run.smithi078.stdout: mds bal split size = 100 2021-01-27T09:43:39.096 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug frag = True 2021-01-27T09:43:39.097 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug scatterstat = True 2021-01-27T09:43:39.097 INFO:teuthology.orchestra.run.smithi078.stdout: mds op complaint time = 180 2021-01-27T09:43:39.097 INFO:teuthology.orchestra.run.smithi078.stdout: mds verify scatter = True 2021-01-27T09:43:39.097 INFO:teuthology.orchestra.run.smithi078.stdout: mon client directed command retry = 5 2021-01-27T09:43:39.097 INFO:teuthology.orchestra.run.smithi078.stdout: ms inject delay max = 1 2021-01-27T09:43:39.098 INFO:teuthology.orchestra.run.smithi078.stdout: ms inject delay probability = 0.005 2021-01-27T09:43:39.098 INFO:teuthology.orchestra.run.smithi078.stdout: ms inject delay type = client mds osd 2021-01-27T09:43:39.098 INFO:teuthology.orchestra.run.smithi078.stdout: ms inject socket failures = 2500 2021-01-27T09:43:39.098 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2021-01-27T09:43:39.098 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 15m 2021-01-27T09:43:39.099 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 15m 2021-01-27T09:43:39.117 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2021-01-27T09:43:39.117 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2021-01-27T09:43:39.118 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-01-27T09:43:39.118 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2021-01-27T09:43:39.118 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.118 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2021-01-27T09:43:39.119 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.119 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2021-01-27T09:43:39.119 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.119 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2021-01-27T09:43:39.119 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2021-01-27T09:43:39.120 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.120 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2021-01-27T09:43:39.120 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2021-01-27T09:43:39.120 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.120 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2021-01-27T09:43:39.121 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2021-01-27T09:43:39.121 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.121 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2021-01-27T09:43:39.121 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2021-01-27T09:43:39.121 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.122 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2021-01-27T09:43:39.122 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.122 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2021-01-27T09:43:39.122 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2021-01-27T09:43:39.123 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2021-01-27T09:43:39.123 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2021-01-27T09:43:39.123 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2021-01-27T09:43:39.123 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2021-01-27T09:43:39.123 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2021-01-27T09:43:39.124 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-01-27T09:43:39.124 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2021-01-27T09:43:39.124 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2021-01-27T09:43:39.124 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.124 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-01-27T09:43:39.125 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.125 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2021-01-27T09:43:39.125 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.125 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2021-01-27T09:43:39.125 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.126 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2021-01-27T09:43:39.126 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2021-01-27T09:43:39.126 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2021-01-27T09:43:39.126 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.146,172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790]" 2021-01-27T09:43:39.127 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on skipped message = False 2021-01-27T09:43:39.127 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = 968a1bec-aac5-444e-b70f-7770587be945 2021-01-27T09:43:39.127 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.127 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2021-01-27T09:43:39.127 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2021-01-27T09:43:39.128 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.128 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2021-01-27T09:43:39.128 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2021-01-27T09:43:39.128 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.128 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2021-01-27T09:43:39.129 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2021-01-27T09:43:39.129 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.129 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2021-01-27T09:43:39.129 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2021-01-27T09:43:39.130 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2021-01-27T09:43:39.130 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.130 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2021-01-27T09:43:39.130 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2021-01-27T09:43:39.130 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.131 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2021-01-27T09:43:39.131 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.131 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2021-01-27T09:43:39.131 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.131 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2021-01-27T09:43:39.132 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.132 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2021-01-27T09:43:39.132 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2021-01-27T09:43:39.132 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.132 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2021-01-27T09:43:39.133 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2021-01-27T09:43:39.133 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2021-01-27T09:43:39.133 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2021-01-27T09:43:39.133 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 20 2021-01-27T09:43:39.134 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 20 2021-01-27T09:43:39.134 INFO:teuthology.orchestra.run.smithi146.stdout: debug filestore = 20 2021-01-27T09:43:39.134 INFO:teuthology.orchestra.run.smithi146.stdout: debug journal = 20 2021-01-27T09:43:39.134 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 20 2021-01-27T09:43:39.134 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 25 2021-01-27T09:43:39.135 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 10 2021-01-27T09:43:39.135 INFO:teuthology.orchestra.run.smithi146.stdout: filestore flush min = 0 2021-01-27T09:43:39.135 INFO:teuthology.orchestra.run.smithi146.stdout: mon client directed command retry = 5 2021-01-27T09:43:39.135 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2021-01-27T09:43:39.135 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2021-01-27T09:43:39.136 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2021-01-27T09:43:39.136 INFO:teuthology.orchestra.run.smithi146.stdout: ms inject delay max = 1 2021-01-27T09:43:39.136 INFO:teuthology.orchestra.run.smithi146.stdout: ms inject delay probability = 0.005 2021-01-27T09:43:39.136 INFO:teuthology.orchestra.run.smithi146.stdout: ms inject delay type = client mds 2021-01-27T09:43:39.136 INFO:teuthology.orchestra.run.smithi146.stdout: ms inject socket failures = 2500 2021-01-27T09:43:39.137 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2021-01-27T09:43:39.137 INFO:teuthology.orchestra.run.smithi146.stdout: osd max markdown count = 1000 2021-01-27T09:43:39.137 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2021-01-27T09:43:39.137 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2021-01-27T09:43:39.137 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.138 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2021-01-27T09:43:39.138 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2021-01-27T09:43:39.138 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2021-01-27T09:43:39.138 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2021-01-27T09:43:39.138 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2021-01-27T09:43:39.139 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2021-01-27T09:43:39.139 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2021-01-27T09:43:39.139 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2021-01-27T09:43:39.139 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.140 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2021-01-27T09:43:39.140 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2021-01-27T09:43:39.140 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2021-01-27T09:43:39.140 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2021-01-27T09:43:39.140 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2021-01-27T09:43:39.141 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2021-01-27T09:43:39.141 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2021-01-27T09:43:39.141 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2021-01-27T09:43:39.141 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2021-01-27T09:43:39.141 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2021-01-27T09:43:39.142 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2021-01-27T09:43:39.142 INFO:teuthology.orchestra.run.smithi146.stdout: mon op complaint time = 120 2021-01-27T09:43:39.142 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:43:39.142 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2021-01-27T09:43:39.142 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2021-01-27T09:43:39.143 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2021-01-27T09:43:39.143 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2021-01-27T09:43:39.143 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-01-27T09:43:39.143 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-01-27T09:43:39.143 INFO:teuthology.orchestra.run.smithi146.stdout: client mount timeout = 600 2021-01-27T09:43:39.144 INFO:teuthology.orchestra.run.smithi146.stdout: debug client = 20 2021-01-27T09:43:39.144 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2021-01-27T09:43:39.144 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 15m 2021-01-27T09:43:39.144 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 15m 2021-01-27T09:43:39.145 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2021-01-27T09:43:39.145 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2021-01-27T09:43:39.145 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2021-01-27T09:43:39.145 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2021-01-27T09:43:39.145 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2021-01-27T09:43:39.146 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.e] 2021-01-27T09:43:39.146 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2021-01-27T09:43:39.146 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2021-01-27T09:43:39.146 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.f] 2021-01-27T09:43:39.146 INFO:teuthology.orchestra.run.smithi146.stdout:[mds] 2021-01-27T09:43:39.147 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds = 20 2021-01-27T09:43:39.147 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2021-01-27T09:43:39.147 INFO:teuthology.orchestra.run.smithi146.stdout: mds bal frag = True 2021-01-27T09:43:39.147 INFO:teuthology.orchestra.run.smithi146.stdout: mds bal fragment size max = 10000 2021-01-27T09:43:39.147 INFO:teuthology.orchestra.run.smithi146.stdout: mds bal merge size = 5 2021-01-27T09:43:39.148 INFO:teuthology.orchestra.run.smithi146.stdout: mds bal split bits = 3 2021-01-27T09:43:39.148 INFO:teuthology.orchestra.run.smithi146.stdout: mds bal split size = 100 2021-01-27T09:43:39.148 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug frag = True 2021-01-27T09:43:39.148 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug scatterstat = True 2021-01-27T09:43:39.148 INFO:teuthology.orchestra.run.smithi146.stdout: mds op complaint time = 180 2021-01-27T09:43:39.149 INFO:teuthology.orchestra.run.smithi146.stdout: mds verify scatter = True 2021-01-27T09:43:39.149 INFO:teuthology.orchestra.run.smithi146.stdout: mon client directed command retry = 5 2021-01-27T09:43:39.149 INFO:teuthology.orchestra.run.smithi146.stdout: ms inject delay max = 1 2021-01-27T09:43:39.149 INFO:teuthology.orchestra.run.smithi146.stdout: ms inject delay probability = 0.005 2021-01-27T09:43:39.149 INFO:teuthology.orchestra.run.smithi146.stdout: ms inject delay type = client mds osd 2021-01-27T09:43:39.150 INFO:teuthology.orchestra.run.smithi146.stdout: ms inject socket failures = 2500 2021-01-27T09:43:39.150 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2021-01-27T09:43:39.150 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 15m 2021-01-27T09:43:39.150 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 15m 2021-01-27T09:43:39.151 INFO:tasks.ceph:Creating admin key on mon.a... 2021-01-27T09:43:39.152 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2021-01-27T09:43:39.229 INFO:tasks.ceph:Copying monmap to all nodes... 2021-01-27T09:43:39.229 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:43:39.230 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2021-01-27T09:43:39.249 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:43:39.249 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2021-01-27T09:43:39.263 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi146.front.sepia.ceph.com 2021-01-27T09:43:39.264 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:43:39.264 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.keyring 2021-01-27T09:43:39.264 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-01-27T09:43:39.376 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:43:39.377 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-01-27T09:43:39.391 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi078.front.sepia.ceph.com 2021-01-27T09:43:39.392 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2021-01-27T09:43:39.392 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.keyring 2021-01-27T09:43:39.393 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-01-27T09:43:39.419 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2021-01-27T09:43:39.420 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-01-27T09:43:39.427 INFO:tasks.ceph:Setting up mon nodes... 2021-01-27T09:43:39.428 INFO:tasks.ceph:Setting up mgr nodes... 2021-01-27T09:43:39.428 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2021-01-27T09:43:39.530 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2021-01-27T09:43:39.539 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2021-01-27T09:43:39.597 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2021-01-27T09:43:39.600 INFO:tasks.ceph:Setting up mds nodes... 2021-01-27T09:43:39.601 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2021-01-27T09:43:39.697 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2021-01-27T09:43:39.704 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2021-01-27T09:43:39.747 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2021-01-27T09:43:39.841 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2021-01-27T09:43:39.849 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2021-01-27T09:43:39.883 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2021-01-27T09:43:39.973 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2021-01-27T09:43:39.981 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2021-01-27T09:43:40.015 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2021-01-27T09:43:40.062 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2021-01-27T09:43:40.065 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2021-01-27T09:43:40.080 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2021-01-27T09:43:40.115 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2021-01-27T09:43:40.118 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2021-01-27T09:43:40.175 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2021-01-27T09:43:40.212 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2021-01-27T09:43:40.214 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2021-01-27T09:43:40.230 INFO:tasks.ceph_client:Setting up client nodes... 2021-01-27T09:43:40.231 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-01-27T09:43:40.300 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.client.0.keyring 2021-01-27T09:43:40.330 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-01-27T09:43:40.331 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-01-27T09:43:40.331 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2021-01-27T09:43:40.366 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-01-27T09:43:40.367 INFO:tasks.ceph:role: osd.0 2021-01-27T09:43:40.367 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com 2021-01-27T09:43:40.368 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-01-27T09:43:40.963 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-01-27T09:43:40.963 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2021-01-27T09:43:40.963 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-01-27T09:43:40.963 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 2021-01-27T09:43:40.964 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-01-27T09:43:40.964 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2021-01-27T09:43:40.964 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-01-27T09:43:40.964 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-01-27T09:43:40.964 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-01-27T09:43:40.965 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-01-27T09:43:40.973 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2021-01-27T09:43:40.974 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2021-01-27T09:43:41.084 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2021-01-27T09:43:41.171 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: /sbin/restorecon: command not found 2021-01-27T09:43:41.173 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-27T09:43:41.173 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2021-01-27T09:43:41.262 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-01-27T09:43:41.263 INFO:tasks.ceph:role: osd.1 2021-01-27T09:43:41.263 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com 2021-01-27T09:43:41.263 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-01-27T09:43:41.757 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-01-27T09:43:41.757 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2021-01-27T09:43:41.757 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-01-27T09:43:41.758 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 2021-01-27T09:43:41.758 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-01-27T09:43:41.758 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2021-01-27T09:43:41.758 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-01-27T09:43:41.759 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-01-27T09:43:41.759 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-01-27T09:43:41.759 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-01-27T09:43:41.764 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2021-01-27T09:43:41.765 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2021-01-27T09:43:41.848 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2021-01-27T09:43:41.868 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: /sbin/restorecon: command not found 2021-01-27T09:43:41.869 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-27T09:43:41.869 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2021-01-27T09:43:41.908 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-01-27T09:43:41.908 INFO:tasks.ceph:role: osd.2 2021-01-27T09:43:41.908 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com 2021-01-27T09:43:41.909 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-01-27T09:43:42.444 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-01-27T09:43:42.444 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2021-01-27T09:43:42.445 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-01-27T09:43:42.445 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 2021-01-27T09:43:42.445 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-01-27T09:43:42.446 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2021-01-27T09:43:42.446 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-01-27T09:43:42.446 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-01-27T09:43:42.446 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-01-27T09:43:42.446 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-01-27T09:43:42.450 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2021-01-27T09:43:42.451 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2021-01-27T09:43:42.535 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2021-01-27T09:43:42.554 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: /sbin/restorecon: command not found 2021-01-27T09:43:42.555 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-27T09:43:42.556 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2021-01-27T09:43:42.588 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-01-27T09:43:42.589 INFO:tasks.ceph:role: osd.3 2021-01-27T09:43:42.589 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com 2021-01-27T09:43:42.590 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-01-27T09:43:43.150 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-01-27T09:43:43.150 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2021-01-27T09:43:43.151 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-01-27T09:43:43.151 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 2021-01-27T09:43:43.151 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-01-27T09:43:43.151 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2021-01-27T09:43:43.152 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-01-27T09:43:43.152 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-01-27T09:43:43.152 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-01-27T09:43:43.152 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-01-27T09:43:43.156 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2021-01-27T09:43:43.156 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2021-01-27T09:43:43.291 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2021-01-27T09:43:43.309 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: /sbin/restorecon: command not found 2021-01-27T09:43:43.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-27T09:43:43.311 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-01-27T09:43:43.459 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:43.461+0000 7f4061c72080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2021-01-27T09:43:43.464 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:43.465+0000 7f4061c72080 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2021-01-27T09:43:43.464 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:43.465+0000 7f4061c72080 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-01-27T09:43:43.464 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:43.465+0000 7f4061c72080 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-01-27T09:43:43.465 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:43.465+0000 7f4061c72080 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-01-27T09:43:43.474 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:43.473+0000 7f4061c72080 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2021-01-27T09:43:46.505 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-01-27T09:43:46.543 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-01-27T09:43:46.667 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:46.665+0000 7fcb2fe94080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2021-01-27T09:43:46.668 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:46.665+0000 7fcb2fe94080 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2021-01-27T09:43:46.668 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:46.665+0000 7fcb2fe94080 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-01-27T09:43:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:46.665+0000 7fcb2fe94080 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-01-27T09:43:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:46.665+0000 7fcb2fe94080 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-01-27T09:43:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:46.669+0000 7fcb2fe94080 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2021-01-27T09:43:49.714 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-01-27T09:43:49.752 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-01-27T09:43:49.827 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:49.825+0000 7fc098ef9080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2021-01-27T09:43:49.828 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:49.829+0000 7fc098ef9080 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2021-01-27T09:43:49.828 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:49.829+0000 7fc098ef9080 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-01-27T09:43:49.829 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:49.829+0000 7fc098ef9080 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-01-27T09:43:49.829 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:49.829+0000 7fc098ef9080 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-01-27T09:43:49.831 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:49.829+0000 7fc098ef9080 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2021-01-27T09:43:52.871 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-01-27T09:43:52.908 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-01-27T09:43:53.032 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:53.033+0000 7f54c5291080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2021-01-27T09:43:53.033 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:53.033+0000 7f54c5291080 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2021-01-27T09:43:53.033 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:53.033+0000 7f54c5291080 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-01-27T09:43:53.034 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:53.033+0000 7f54c5291080 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-01-27T09:43:53.034 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:53.033+0000 7f54c5291080 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-01-27T09:43:53.036 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:43:53.037+0000 7f54c5291080 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2021-01-27T09:43:56.064 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-01-27T09:43:56.103 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2021-01-27T09:43:56.120 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-01-27T09:43:56.120 INFO:tasks.ceph:role: osd.4 2021-01-27T09:43:56.121 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com 2021-01-27T09:43:56.121 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-01-27T09:43:56.638 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-01-27T09:43:56.638 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2021-01-27T09:43:56.638 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-01-27T09:43:56.639 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 2021-01-27T09:43:56.639 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-01-27T09:43:56.639 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2021-01-27T09:43:56.639 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-01-27T09:43:56.639 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-01-27T09:43:56.640 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-01-27T09:43:56.640 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-01-27T09:43:56.641 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2021-01-27T09:43:56.641 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2021-01-27T09:43:56.739 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2021-01-27T09:43:56.748 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2021-01-27T09:43:56.748 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-27T09:43:56.749 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2021-01-27T09:43:56.765 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-01-27T09:43:56.765 INFO:tasks.ceph:role: osd.5 2021-01-27T09:43:56.766 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com 2021-01-27T09:43:56.766 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-01-27T09:43:57.325 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-01-27T09:43:57.326 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2021-01-27T09:43:57.326 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-01-27T09:43:57.326 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 2021-01-27T09:43:57.327 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-01-27T09:43:57.327 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2021-01-27T09:43:57.327 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-01-27T09:43:57.327 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-01-27T09:43:57.328 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-01-27T09:43:57.328 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-01-27T09:43:57.329 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2021-01-27T09:43:57.329 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2021-01-27T09:43:57.367 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2021-01-27T09:43:57.420 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2021-01-27T09:43:57.421 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-27T09:43:57.422 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2021-01-27T09:43:57.432 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-01-27T09:43:57.433 INFO:tasks.ceph:role: osd.6 2021-01-27T09:43:57.433 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com 2021-01-27T09:43:57.434 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-01-27T09:43:57.892 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-01-27T09:43:57.893 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2021-01-27T09:43:57.893 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-01-27T09:43:57.893 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 2021-01-27T09:43:57.893 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-01-27T09:43:57.893 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2021-01-27T09:43:57.894 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-01-27T09:43:57.894 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-01-27T09:43:57.894 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-01-27T09:43:57.894 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-01-27T09:43:57.895 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2021-01-27T09:43:57.896 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2021-01-27T09:43:57.955 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2021-01-27T09:43:57.966 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2021-01-27T09:43:57.967 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-27T09:43:57.967 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2021-01-27T09:43:57.979 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-01-27T09:43:57.979 INFO:tasks.ceph:role: osd.7 2021-01-27T09:43:57.980 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com 2021-01-27T09:43:57.980 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-01-27T09:43:58.516 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-01-27T09:43:58.516 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2021-01-27T09:43:58.517 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-01-27T09:43:58.517 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 2021-01-27T09:43:58.518 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-01-27T09:43:58.518 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2021-01-27T09:43:58.518 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-01-27T09:43:58.519 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-01-27T09:43:58.519 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-01-27T09:43:58.520 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-01-27T09:43:58.521 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2021-01-27T09:43:58.522 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2021-01-27T09:43:58.590 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2021-01-27T09:43:58.602 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2021-01-27T09:43:58.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-27T09:43:58.603 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-01-27T09:43:58.656 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:43:58.655+0000 7f7affe66080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2021-01-27T09:43:58.657 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:43:58.659+0000 7f7affe66080 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2021-01-27T09:43:58.658 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:43:58.659+0000 7f7affe66080 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-01-27T09:43:58.658 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:43:58.659+0000 7f7affe66080 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-01-27T09:43:58.658 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:43:58.659+0000 7f7affe66080 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-01-27T09:43:58.659 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:43:58.659+0000 7f7affe66080 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2021-01-27T09:44:01.644 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-01-27T09:44:01.661 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-01-27T09:44:01.696 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:01.695+0000 7fe70f5a6080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2021-01-27T09:44:01.697 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:01.695+0000 7fe70f5a6080 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2021-01-27T09:44:01.697 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:01.695+0000 7fe70f5a6080 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-01-27T09:44:01.697 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:01.695+0000 7fe70f5a6080 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-01-27T09:44:01.697 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:01.695+0000 7fe70f5a6080 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-01-27T09:44:01.698 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:01.699+0000 7fe70f5a6080 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2021-01-27T09:44:04.668 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-01-27T09:44:04.685 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-01-27T09:44:04.768 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:04.767+0000 7f5fcf504080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2021-01-27T09:44:04.769 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:04.767+0000 7f5fcf504080 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2021-01-27T09:44:04.769 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:04.771+0000 7f5fcf504080 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-01-27T09:44:04.769 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:04.771+0000 7f5fcf504080 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-01-27T09:44:04.770 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:04.771+0000 7f5fcf504080 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-01-27T09:44:04.770 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:04.771+0000 7f5fcf504080 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2021-01-27T09:44:07.739 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-01-27T09:44:07.755 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-01-27T09:44:07.795 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:07.795+0000 7f7659df8080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2021-01-27T09:44:07.795 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:07.795+0000 7f7659df8080 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2021-01-27T09:44:07.796 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:07.795+0000 7f7659df8080 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-01-27T09:44:07.796 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:07.795+0000 7f7659df8080 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-01-27T09:44:07.797 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:07.795+0000 7f7659df8080 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-01-27T09:44:07.798 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:07.795+0000 7f7659df8080 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2021-01-27T09:44:08.145 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:44:08.148 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:44:10.752 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-01-27T09:44:10.769 INFO:tasks.ceph:Reading keys from all nodes... 2021-01-27T09:44:10.770 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:44:10.770 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2021-01-27T09:44:10.806 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:44:10.806 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2021-01-27T09:44:10.839 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:44:10.840 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2021-01-27T09:44:10.873 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:44:10.873 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2021-01-27T09:44:10.902 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:44:10.902 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2021-01-27T09:44:10.977 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:44:10.978 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2021-01-27T09:44:11.014 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:44:11.014 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2021-01-27T09:44:11.050 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:44:11.051 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2021-01-27T09:44:11.132 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2021-01-27T09:44:11.132 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2021-01-27T09:44:11.149 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2021-01-27T09:44:11.150 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2021-01-27T09:44:11.161 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2021-01-27T09:44:11.161 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2021-01-27T09:44:11.172 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2021-01-27T09:44:11.172 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2021-01-27T09:44:11.232 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2021-01-27T09:44:11.232 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2021-01-27T09:44:11.243 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2021-01-27T09:44:11.244 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2021-01-27T09:44:11.298 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2021-01-27T09:44:11.298 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2021-01-27T09:44:11.312 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2021-01-27T09:44:11.312 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2021-01-27T09:44:11.323 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:44:11.323 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2021-01-27T09:44:11.349 INFO:tasks.ceph:Adding keys to all mons... 2021-01-27T09:44:11.349 DEBUG:teuthology.orchestra.run.smithi078:> sudo tee -a /etc/ceph/ceph.keyring 2021-01-27T09:44:11.352 DEBUG:teuthology.orchestra.run.smithi146:> sudo tee -a /etc/ceph/ceph.keyring 2021-01-27T09:44:11.401 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.y] 2021-01-27T09:44:11.402 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDLNRFgPGfmHxAARHM6XeQSzo/6R7uBXMeGlA== 2021-01-27T09:44:11.402 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2021-01-27T09:44:11.402 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDLNRFgXhXRKRAA+0KMdNmfev94u7ubvgGJNw== 2021-01-27T09:44:11.402 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2021-01-27T09:44:11.403 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDLNRFgACxwMhAAGesJqjxI9Dq4k/Qd9XFVQQ== 2021-01-27T09:44:11.403 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.e] 2021-01-27T09:44:11.403 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDLNRFgkZxFOhAAMpcEhRDUmkGG6t+BBoOnzw== 2021-01-27T09:44:11.403 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.0] 2021-01-27T09:44:11.403 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDPNRFgsBSrGxAA7i5iFh+UlWt8iSUs6mPV8Q== 2021-01-27T09:44:11.404 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.1] 2021-01-27T09:44:11.404 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDSNRFgEMjjJxAAHMKFbdAp+T4zUf4es1rXXA== 2021-01-27T09:44:11.404 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.2] 2021-01-27T09:44:11.404 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDVNRFg4WmSMRAAGLVVJOSf4CdzRVP8W0EHkg== 2021-01-27T09:44:11.404 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.3] 2021-01-27T09:44:11.405 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDZNRFgGEM0AhAAu3DFdwfjzz2llC6vx58/jA== 2021-01-27T09:44:11.405 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.x] 2021-01-27T09:44:11.405 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDLNRFgK/DZIxAA4CIYNE6GK4+Qo8EDfrVBoA== 2021-01-27T09:44:11.405 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2021-01-27T09:44:11.406 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDMNRFg6Iz0AxAAhLsycOc2p0zNilWgXi+mEg== 2021-01-27T09:44:11.406 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.d] 2021-01-27T09:44:11.406 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDMNRFgNfcjBxAALxxHgNABUEGGRA8B4J4uxg== 2021-01-27T09:44:11.406 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.f] 2021-01-27T09:44:11.406 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDMNRFgUTjiDBAAvgycSOELSVKQFVSB9tsU+g== 2021-01-27T09:44:11.407 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.4] 2021-01-27T09:44:11.407 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDeNRFgZApbJxAA1BqRdJM0RTLHKotMAkYseQ== 2021-01-27T09:44:11.407 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.5] 2021-01-27T09:44:11.407 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDhNRFgfui5KRAAPS63RsYEfUkd5hkLeUQWWg== 2021-01-27T09:44:11.407 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.6] 2021-01-27T09:44:11.408 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDkNRFgQUwNLhAAYM28Ym2a/M9SVmrM6+5NAw== 2021-01-27T09:44:11.408 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.7] 2021-01-27T09:44:11.408 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDnNRFgmxqbLxAAUHs0f/khzzvP/m1Y0P+2/Q== 2021-01-27T09:44:11.408 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2021-01-27T09:44:11.409 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDMNRFgztQwEhAAATkVTnDR1zd3vFpFOP5nTg== 2021-01-27T09:44:11.427 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.y] 2021-01-27T09:44:11.427 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDLNRFgPGfmHxAARHM6XeQSzo/6R7uBXMeGlA== 2021-01-27T09:44:11.428 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2021-01-27T09:44:11.428 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDLNRFgXhXRKRAA+0KMdNmfev94u7ubvgGJNw== 2021-01-27T09:44:11.428 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2021-01-27T09:44:11.428 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDLNRFgACxwMhAAGesJqjxI9Dq4k/Qd9XFVQQ== 2021-01-27T09:44:11.428 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.e] 2021-01-27T09:44:11.429 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDLNRFgkZxFOhAAMpcEhRDUmkGG6t+BBoOnzw== 2021-01-27T09:44:11.429 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.0] 2021-01-27T09:44:11.429 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDPNRFgsBSrGxAA7i5iFh+UlWt8iSUs6mPV8Q== 2021-01-27T09:44:11.429 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.1] 2021-01-27T09:44:11.430 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDSNRFgEMjjJxAAHMKFbdAp+T4zUf4es1rXXA== 2021-01-27T09:44:11.430 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.2] 2021-01-27T09:44:11.430 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDVNRFg4WmSMRAAGLVVJOSf4CdzRVP8W0EHkg== 2021-01-27T09:44:11.430 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.3] 2021-01-27T09:44:11.430 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDZNRFgGEM0AhAAu3DFdwfjzz2llC6vx58/jA== 2021-01-27T09:44:11.431 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.x] 2021-01-27T09:44:11.431 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDLNRFgK/DZIxAA4CIYNE6GK4+Qo8EDfrVBoA== 2021-01-27T09:44:11.431 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2021-01-27T09:44:11.431 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDMNRFg6Iz0AxAAhLsycOc2p0zNilWgXi+mEg== 2021-01-27T09:44:11.431 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2021-01-27T09:44:11.432 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDMNRFgNfcjBxAALxxHgNABUEGGRA8B4J4uxg== 2021-01-27T09:44:11.432 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.f] 2021-01-27T09:44:11.432 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDMNRFgUTjiDBAAvgycSOELSVKQFVSB9tsU+g== 2021-01-27T09:44:11.432 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.4] 2021-01-27T09:44:11.432 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDeNRFgZApbJxAA1BqRdJM0RTLHKotMAkYseQ== 2021-01-27T09:44:11.433 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.5] 2021-01-27T09:44:11.433 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDhNRFgfui5KRAAPS63RsYEfUkd5hkLeUQWWg== 2021-01-27T09:44:11.433 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.6] 2021-01-27T09:44:11.433 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDkNRFgQUwNLhAAYM28Ym2a/M9SVmrM6+5NAw== 2021-01-27T09:44:11.434 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.7] 2021-01-27T09:44:11.434 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDnNRFgmxqbLxAAUHs0f/khzzvP/m1Y0P+2/Q== 2021-01-27T09:44:11.434 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2021-01-27T09:44:11.434 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDMNRFgztQwEhAAATkVTnDR1zd3vFpFOP5nTg== 2021-01-27T09:44:11.436 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-01-27T09:44:11.454 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-01-27T09:44:11.530 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-01-27T09:44:11.533 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-01-27T09:44:11.609 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-01-27T09:44:11.611 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-01-27T09:44:11.687 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-01-27T09:44:11.689 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-01-27T09:44:11.761 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-27T09:44:11.774 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-27T09:44:11.848 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-27T09:44:11.851 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-27T09:44:11.927 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-27T09:44:11.933 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-27T09:44:12.002 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-27T09:44:12.106 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-27T09:44:12.182 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-01-27T09:44:12.210 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-01-27T09:44:12.285 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-01-27T09:44:12.296 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-01-27T09:44:12.366 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-01-27T09:44:12.388 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-01-27T09:44:12.461 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-01-27T09:44:12.465 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-01-27T09:44:12.537 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-27T09:44:12.550 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-27T09:44:12.621 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-27T09:44:12.624 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-27T09:44:12.695 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-27T09:44:12.698 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-27T09:44:12.770 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-27T09:44:12.782 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-27T09:44:12.856 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-01-27T09:44:12.858 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-01-27T09:44:12.934 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-01-27T09:44:12.935 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2021-01-27T09:44:12.968 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-01-27T09:44:13.058 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2021-01-27T09:44:13.091 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2021-01-27T09:44:13.107 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-01-27T09:44:13.221 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2021-01-27T09:44:13.235 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2021-01-27T09:44:13.245 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-01-27T09:44:13.362 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2021-01-27T09:44:13.377 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-01-27T09:44:13.379 DEBUG:teuthology.orchestra.run.smithi146:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-01-27T09:44:13.398 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2021-01-27T09:44:13.398 INFO:tasks.ceph.mon.a:Restarting daemon 2021-01-27T09:44:13.399 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2021-01-27T09:44:13.405 INFO:tasks.ceph.mon.a:Started 2021-01-27T09:44:13.405 INFO:tasks.ceph.mon.b:Restarting daemon 2021-01-27T09:44:13.406 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2021-01-27T09:44:13.426 INFO:tasks.ceph.mon.b:Started 2021-01-27T09:44:13.426 INFO:tasks.ceph.mon.c:Restarting daemon 2021-01-27T09:44:13.427 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2021-01-27T09:44:13.429 INFO:tasks.ceph.mon.c:Started 2021-01-27T09:44:13.430 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2021-01-27T09:44:13.430 INFO:tasks.ceph.mgr.y:Restarting daemon 2021-01-27T09:44:13.430 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2021-01-27T09:44:13.437 INFO:tasks.ceph.mgr.y:Started 2021-01-27T09:44:13.438 INFO:tasks.ceph.mgr.x:Restarting daemon 2021-01-27T09:44:13.438 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2021-01-27T09:44:13.441 INFO:tasks.ceph.mgr.x:Started 2021-01-27T09:44:13.441 INFO:tasks.ceph:Setting crush tunables to default 2021-01-27T09:44:13.442 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd crush tunables default 2021-01-27T09:44:13.582 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.581+0000 7ff8f0d66700 1 Processor -- start 2021-01-27T09:44:13.583 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.581+0000 7ff8f0d66700 1 -- start start 2021-01-27T09:44:13.584 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.585+0000 7ff8f0d66700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff8ec0bce70 0x7ff8ec14dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:13.584 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.585+0000 7ff8f0d66700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff8ec0bd250 0x7ff8ec063050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:13.584 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.585+0000 7ff8f0d66700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8ec064240 con 0x7ff8ec136bf0 2021-01-27T09:44:13.585 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.585+0000 7ff8f0d66700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ec14e400 con 0x7ff8ec0bd250 2021-01-27T09:44:13.585 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.585+0000 7ff8f0d66700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ec14e6a0 con 0x7ff8ec0bce70 2021-01-27T09:44:13.586 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.585+0000 7ff8ead9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff8ec136bf0 0x7ff8ec064910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:33320/0 (socket says 172.21.15.146:33320) 2021-01-27T09:44:13.586 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.585+0000 7ff8e9d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff8ec0bd250 0x7ff8ec063050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:13.586 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.585+0000 7ff8ead9d700 1 -- 172.21.15.146:0/3763228429 learned_addr learned my addr 172.21.15.146:0/3763228429 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:13.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.585+0000 7ff8ea59c700 1 --2- 172.21.15.146:0/3763228429 >> v2:172.21.15.146:3300/0 conn(0x7ff8ec0bce70 0x7ff8ec14dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:13.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.585+0000 7ff8e9d9b700 1 -- 172.21.15.146:0/3763228429 >> v2:172.21.15.78:3300/0 conn(0x7ff8ec0bd250 msgr2=0x7ff8ec063050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-01-27T09:44:13.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.585+0000 7ff8e9d9b700 1 -- 172.21.15.146:0/3763228429 >> v2:172.21.15.78:3300/0 conn(0x7ff8ec0bd250 msgr2=0x7ff8ec063050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-01-27T09:44:13.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.585+0000 7ff8e9d9b700 1 --2- 172.21.15.146:0/3763228429 >> v2:172.21.15.78:3300/0 conn(0x7ff8ec0bd250 0x7ff8ec063050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-01-27T09:44:13.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.585+0000 7ff8ea59c700 1 -- 172.21.15.146:0/3763228429 >> v2:172.21.15.146:3300/0 conn(0x7ff8ec0bce70 msgr2=0x7ff8ec14dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-01-27T09:44:13.588 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.585+0000 7ff8ea59c700 1 -- 172.21.15.146:0/3763228429 >> v2:172.21.15.146:3300/0 conn(0x7ff8ec0bce70 msgr2=0x7ff8ec14dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-01-27T09:44:13.588 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.585+0000 7ff8ea59c700 1 --2- 172.21.15.146:0/3763228429 >> v2:172.21.15.146:3300/0 conn(0x7ff8ec0bce70 0x7ff8ec14dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-01-27T09:44:13.588 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.585+0000 7ff8e9d9b700 1 --2- 172.21.15.146:0/3763228429 >> v2:172.21.15.78:3300/0 conn(0x7ff8ec0bd250 0x7ff8ec063050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-01-27T09:44:13.588 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.585+0000 7ff8ea59c700 1 --2- 172.21.15.146:0/3763228429 >> v2:172.21.15.146:3300/0 conn(0x7ff8ec0bce70 0x7ff8ec14dde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-01-27T09:44:13.788 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.789+0000 7ff8ea59c700 1 --2- 172.21.15.146:0/3763228429 >> v2:172.21.15.146:3300/0 conn(0x7ff8ec0bce70 0x7ff8ec14dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:13.788 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.789+0000 7ff8e9d9b700 1 --2- 172.21.15.146:0/3763228429 >> v2:172.21.15.78:3300/0 conn(0x7ff8ec0bd250 0x7ff8ec063050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:13.789 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.789+0000 7ff8e9d9b700 1 -- 172.21.15.146:0/3763228429 >> v2:172.21.15.78:3300/0 conn(0x7ff8ec0bd250 msgr2=0x7ff8ec063050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-01-27T09:44:13.789 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.789+0000 7ff8e9d9b700 1 -- 172.21.15.146:0/3763228429 >> v2:172.21.15.78:3300/0 conn(0x7ff8ec0bd250 msgr2=0x7ff8ec063050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-01-27T09:44:13.789 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.789+0000 7ff8e9d9b700 1 --2- 172.21.15.146:0/3763228429 >> v2:172.21.15.78:3300/0 conn(0x7ff8ec0bd250 0x7ff8ec063050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-01-27T09:44:13.789 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.789+0000 7ff8ea59c700 1 -- 172.21.15.146:0/3763228429 >> v2:172.21.15.146:3300/0 conn(0x7ff8ec0bce70 msgr2=0x7ff8ec14dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-01-27T09:44:13.790 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.789+0000 7ff8ea59c700 1 -- 172.21.15.146:0/3763228429 >> v2:172.21.15.146:3300/0 conn(0x7ff8ec0bce70 msgr2=0x7ff8ec14dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-01-27T09:44:13.790 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.789+0000 7ff8ea59c700 1 --2- 172.21.15.146:0/3763228429 >> v2:172.21.15.146:3300/0 conn(0x7ff8ec0bce70 0x7ff8ec14dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-01-27T09:44:13.790 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.789+0000 7ff8e9d9b700 1 --2- 172.21.15.146:0/3763228429 >> v2:172.21.15.78:3300/0 conn(0x7ff8ec0bd250 0x7ff8ec063050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-01-27T09:44:13.790 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.789+0000 7ff8ea59c700 1 --2- 172.21.15.146:0/3763228429 >> v2:172.21.15.146:3300/0 conn(0x7ff8ec0bce70 0x7ff8ec14dde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-01-27T09:44:13.819 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.817+0000 7ff8e959a700 1 -- 172.21.15.146:0/3763228429 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973536105 0 0) 0x7ff8ec064240 con 0x7ff8ec136bf0 2021-01-27T09:44:13.819 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.817+0000 7ff8e959a700 1 -- 172.21.15.146:0/3763228429 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8d0003270 con 0x7ff8ec136bf0 2021-01-27T09:44:13.822 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.821+0000 7ff8e959a700 1 -- 172.21.15.146:0/3763228429 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 308327476 0 0) 0x7ff8d0003270 con 0x7ff8ec136bf0 2021-01-27T09:44:13.822 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.821+0000 7ff8e959a700 1 -- 172.21.15.146:0/3763228429 >> v2:172.21.15.146:3300/0 conn(0x7ff8ec0bce70 msgr2=0x7ff8ec14dde0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:44:13.822 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.821+0000 7ff8e959a700 1 --2- 172.21.15.146:0/3763228429 >> v2:172.21.15.146:3300/0 conn(0x7ff8ec0bce70 0x7ff8ec14dde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:13.822 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.821+0000 7ff8e959a700 1 -- 172.21.15.146:0/3763228429 >> v2:172.21.15.78:3300/0 conn(0x7ff8ec0bd250 msgr2=0x7ff8ec063050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:44:13.823 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.821+0000 7ff8e959a700 1 --2- 172.21.15.146:0/3763228429 >> v2:172.21.15.78:3300/0 conn(0x7ff8ec0bd250 0x7ff8ec063050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:13.823 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.821+0000 7ff8e959a700 1 -- 172.21.15.146:0/3763228429 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec14e940 con 0x7ff8ec136bf0 2021-01-27T09:44:13.823 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.821+0000 7ff8e959a700 1 -- 172.21.15.146:0/3763228429 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3890990827 0 0) 0x7ff8e40018a0 con 0x7ff8ec136bf0 2021-01-27T09:44:13.823 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.821+0000 7ff8e959a700 1 -- 172.21.15.146:0/3763228429 >> v1:172.21.15.78:6789/0 conn(0x7ff8ec136bf0 legacy=0x7ff8ec064910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:13.823 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.821+0000 7ff8e959a700 1 --2- 172.21.15.146:0/3763228429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8d0003760 0x7ff8d0003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:13.824 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.821+0000 7ff8e959a700 1 --2- 172.21.15.146:0/3763228429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d0004510 0x7ff8d0004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:13.824 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.821+0000 7ff8e959a700 1 --2- 172.21.15.146:0/3763228429 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff8d0004e80 0x7ff8d0013f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:13.824 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.821+0000 7ff8e959a700 1 -- 172.21.15.146:0/3763228429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec14e400 con 0x7ff8d0004510 2021-01-27T09:44:13.824 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.821+0000 7ff8e959a700 1 -- 172.21.15.146:0/3763228429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec14e6a0 con 0x7ff8d0003760 2021-01-27T09:44:13.824 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.821+0000 7ff8e959a700 1 -- 172.21.15.146:0/3763228429 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d0004290 con 0x7ff8d0004e80 2021-01-27T09:44:13.825 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.821+0000 7ff8ead9d700 1 --2- 172.21.15.146:0/3763228429 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff8d0004e80 0x7ff8d0013f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:13.825 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.821+0000 7ff8e9d9b700 1 --2- 172.21.15.146:0/3763228429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d0004510 0x7ff8d0004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:13.825 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.821+0000 7ff8ead9d700 1 -- 172.21.15.146:0/3763228429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8d0003760 msgr2=0x7ff8d0003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:13.825 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.821+0000 7ff8ead9d700 1 --2- 172.21.15.146:0/3763228429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8d0003760 0x7ff8d0003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:44:13.826 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.821+0000 7ff8ead9d700 1 -- 172.21.15.146:0/3763228429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d0004510 msgr2=0x7ff8d0004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:13.826 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.821+0000 7ff8ead9d700 1 --2- 172.21.15.146:0/3763228429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8d0004510 0x7ff8d0004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:13.826 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.821+0000 7ff8ead9d700 1 -- 172.21.15.146:0/3763228429 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d0003270 con 0x7ff8d0004e80 2021-01-27T09:44:13.828 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.821+0000 7ff8ead9d700 1 -- 172.21.15.146:0/3763228429 reap_dead start 2021-01-27T09:44:13.828 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.821+0000 7ff8ead9d700 1 --2- 172.21.15.146:0/3763228429 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff8d0004e80 0x7ff8d0013f70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7ff8e400c840 tx=0x7ff8ec14b940).ready entity=mon.2 client_cookie=85df584ffcc51ae server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:13.828 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.825+0000 7ff8e959a700 1 -- 172.21.15.146:0/3763228429 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4005bb0 con 0x7ff8d0004e80 2021-01-27T09:44:13.828 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.825+0000 7ff8e959a700 1 -- 172.21.15.146:0/3763228429 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e4005d10 con 0x7ff8d0004e80 2021-01-27T09:44:13.829 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.825+0000 7ff8e959a700 1 -- 172.21.15.146:0/3763228429 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4007320 con 0x7ff8d0004e80 2021-01-27T09:44:13.829 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.825+0000 7ff8f0d66700 1 -- 172.21.15.146:0/3763228429 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff8d0004e80 msgr2=0x7ff8d0013f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:13.829 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.825+0000 7ff8f0d66700 1 --2- 172.21.15.146:0/3763228429 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff8d0004e80 0x7ff8d0013f70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7ff8e400c840 tx=0x7ff8ec14b940).stop 2021-01-27T09:44:13.829 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.825+0000 7ff8f0d66700 1 -- 172.21.15.146:0/3763228429 shutdown_connections 2021-01-27T09:44:13.829 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.825+0000 7ff8f0d66700 1 --2- 172.21.15.146:0/3763228429 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff8d0004e80 0x7ff8d0013f70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:13.830 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.825+0000 7ff8f0d66700 1 -- 172.21.15.146:0/3763228429 >> 172.21.15.146:0/3763228429 conn(0x7ff8ec060910 msgr2=0x7ff8ec062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:13.830 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.825+0000 7ff8f0d66700 1 -- 172.21.15.146:0/3763228429 shutdown_connections 2021-01-27T09:44:13.830 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.825+0000 7ff8f0d66700 1 -- 172.21.15.146:0/3763228429 wait complete. 2021-01-27T09:44:13.832 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.829+0000 7ff8f0d66700 1 Processor -- start 2021-01-27T09:44:13.832 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.829+0000 7ff8f0d66700 1 -- start start 2021-01-27T09:44:13.832 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.829+0000 7ff8f0d66700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8d0004e80 0x7ff8ec136090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:13.832 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.829+0000 7ff8f0d66700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff8ec0b7610 0x7ff8ec0bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:13.833 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.829+0000 7ff8f0d66700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8ec14ae60 0x7ff8ec14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:13.833 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.829+0000 7ff8f0d66700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec0b8b20 con 0x7ff8ec14ae60 2021-01-27T09:44:13.833 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.829+0000 7ff8f0d66700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec134f80 con 0x7ff8d0004e80 2021-01-27T09:44:13.833 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.829+0000 7ff8f0d66700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec14b7e0 con 0x7ff8ec0b7610 2021-01-27T09:44:13.833 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.833+0000 7ff8ead9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8ec14ae60 0x7ff8ec14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:13.834 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.833+0000 7ff8ea59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8d0004e80 0x7ff8ec136090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:13.834 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.833+0000 7ff8ead9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8ec14ae60 0x7ff8ec14b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:48610/0 (socket says 172.21.15.146:48610) 2021-01-27T09:44:13.834 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.833+0000 7ff8ead9d700 1 -- 172.21.15.146:0/740864264 learned_addr learned my addr 172.21.15.146:0/740864264 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:13.835 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.833+0000 7ff8e9d9b700 1 --2- 172.21.15.146:0/740864264 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff8ec0b7610 0x7ff8ec0bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:13.835 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.833+0000 7ff8ea59c700 1 -- 172.21.15.146:0/740864264 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff8ec0b7610 msgr2=0x7ff8ec0bf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:13.835 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.833+0000 7ff8ea59c700 1 --2- 172.21.15.146:0/740864264 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff8ec0b7610 0x7ff8ec0bf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:13.835 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.833+0000 7ff8ea59c700 1 -- 172.21.15.146:0/740864264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8ec14ae60 msgr2=0x7ff8ec14b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:13.835 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.833+0000 7ff8ea59c700 1 --2- 172.21.15.146:0/740864264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8ec14ae60 0x7ff8ec14b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:13.836 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.833+0000 7ff8ea59c700 1 -- 172.21.15.146:0/740864264 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec1351d0 con 0x7ff8d0004e80 2021-01-27T09:44:13.837 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.833+0000 7ff8ea59c700 1 --2- 172.21.15.146:0/740864264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8d0004e80 0x7ff8ec136090 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7ff8dc00d7b0 tx=0x7ff8dc008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:13.837 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.837+0000 7ff8da7fc700 1 -- 172.21.15.146:0/740864264 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc012570 con 0x7ff8d0004e80 2021-01-27T09:44:13.837 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.837+0000 7ff8da7fc700 1 -- 172.21.15.146:0/740864264 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8dc0126d0 con 0x7ff8d0004e80 2021-01-27T09:44:13.838 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.837+0000 7ff8da7fc700 1 -- 172.21.15.146:0/740864264 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc012a70 con 0x7ff8d0004e80 2021-01-27T09:44:13.838 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.837+0000 7ff8f0d66700 1 -- 172.21.15.146:0/740864264 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ec135470 con 0x7ff8d0004e80 2021-01-27T09:44:13.838 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.837+0000 7ff8f0d66700 1 -- 172.21.15.146:0/740864264 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ec0b94b0 con 0x7ff8d0004e80 2021-01-27T09:44:13.839 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.837+0000 7ff8da7fc700 1 -- 172.21.15.146:0/740864264 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7ff8dc01d6c0 con 0x7ff8d0004e80 2021-01-27T09:44:13.839 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.837+0000 7ff8f0d66700 1 -- 172.21.15.146:0/740864264 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8ec062380 con 0x7ff8d0004e80 2021-01-27T09:44:13.839 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.837+0000 7ff8da7fc700 1 -- 172.21.15.146:0/740864264 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7ff8dc0063a0 con 0x7ff8d0004e80 2021-01-27T09:44:13.841 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.841+0000 7ff8da7fc700 1 -- 172.21.15.146:0/740864264 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72015 (secure 0 0 0) 0x7ff8ec062380 con 0x7ff8d0004e80 2021-01-27T09:44:13.912 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.913+0000 7ff8f0d66700 1 -- 172.21.15.146:0/740864264 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff8ec044ee0 con 0x7ff8d0004e80 2021-01-27T09:44:13.922 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.921+0000 7ff8da7fc700 1 -- 172.21.15.146:0/740864264 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff8dc012e60 con 0x7ff8d0004e80 2021-01-27T09:44:13.925 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.925+0000 7ff8f0d66700 1 -- 172.21.15.146:0/740864264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8d0004e80 msgr2=0x7ff8ec136090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:13.926 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.925+0000 7ff8f0d66700 1 --2- 172.21.15.146:0/740864264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8d0004e80 0x7ff8ec136090 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7ff8dc00d7b0 tx=0x7ff8dc008040).stop 2021-01-27T09:44:13.926 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.925+0000 7ff8f0d66700 1 -- 172.21.15.146:0/740864264 shutdown_connections 2021-01-27T09:44:13.926 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.925+0000 7ff8f0d66700 1 --2- 172.21.15.146:0/740864264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8ec14ae60 0x7ff8ec14b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:13.926 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.925+0000 7ff8f0d66700 1 --2- 172.21.15.146:0/740864264 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff8ec0b7610 0x7ff8ec0bf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:13.927 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.925+0000 7ff8f0d66700 1 --2- 172.21.15.146:0/740864264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8d0004e80 0x7ff8ec136090 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:13.927 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.925+0000 7ff8f0d66700 1 -- 172.21.15.146:0/740864264 >> 172.21.15.146:0/740864264 conn(0x7ff8ec060910 msgr2=0x7ff8ec0be0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:13.927 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.925+0000 7ff8f0d66700 1 -- 172.21.15.146:0/740864264 shutdown_connections 2021-01-27T09:44:13.928 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:13.925+0000 7ff8f0d66700 1 -- 172.21.15.146:0/740864264 wait complete. 2021-01-27T09:44:13.928 INFO:teuthology.orchestra.run.smithi146.stderr:adjusted tunables profile to default 2021-01-27T09:44:13.947 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2021-01-27T09:44:13.948 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:44:13.948 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2021-01-27T09:44:13.984 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:44:13.984 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2021-01-27T09:44:14.019 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:44:14.019 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2021-01-27T09:44:14.052 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:44:14.052 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2021-01-27T09:44:14.085 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2021-01-27T09:44:14.085 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2021-01-27T09:44:14.100 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2021-01-27T09:44:14.101 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2021-01-27T09:44:14.160 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2021-01-27T09:44:14.161 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2021-01-27T09:44:14.170 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2021-01-27T09:44:14.170 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2021-01-27T09:44:14.180 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 25441909-a40b-4d82-828d-326685513ec4 0 2021-01-27T09:44:14.335 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.335+0000 7ff26f59e700 1 Processor -- start 2021-01-27T09:44:14.335 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.335+0000 7ff26f59e700 1 -- start start 2021-01-27T09:44:14.337 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.335+0000 7ff26f59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff2700672d0 0x7ff2700c0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:14.338 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.335+0000 7ff26f59e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff2700676b0 0x7ff2701512e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:14.338 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.335+0000 7ff26f59e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2700c1140 con 0x7ff270069580 2021-01-27T09:44:14.338 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.335+0000 7ff26f59e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff270065110 con 0x7ff2700676b0 2021-01-27T09:44:14.338 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.335+0000 7ff26f59e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2700653b0 con 0x7ff2700672d0 2021-01-27T09:44:14.339 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.335+0000 7ff26dd9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff2700676b0 0x7ff2701512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:14.339 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.335+0000 7ff26ed9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff270069580 0x7ff27014ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44194/0 (socket says 172.21.15.78:44194) 2021-01-27T09:44:14.339 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.335+0000 7ff26ed9d700 1 -- 172.21.15.78:0/1232256553 learned_addr learned my addr 172.21.15.78:0/1232256553 (peer_addr_for_me v1:172.21.15.78:0/0) 2021-01-27T09:44:14.339 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.339+0000 7ff26d59a700 1 -- 172.21.15.78:0/1232256553 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358548048 0 0) 0x7ff2700c1140 con 0x7ff270069580 2021-01-27T09:44:14.340 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.339+0000 7ff26d59a700 1 -- 172.21.15.78:0/1232256553 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff250003270 con 0x7ff270069580 2021-01-27T09:44:14.340 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.339+0000 7ff26e59c700 1 --2- 172.21.15.78:0/1232256553 >> v2:172.21.15.146:3300/0 conn(0x7ff2700672d0 0x7ff2700c0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:14.340 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.339+0000 7ff26dd9b700 1 -- 172.21.15.78:0/1232256553 >> v2:172.21.15.146:3300/0 conn(0x7ff2700672d0 msgr2=0x7ff2700c0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:14.340 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.339+0000 7ff26dd9b700 1 --2- 172.21.15.78:0/1232256553 >> v2:172.21.15.146:3300/0 conn(0x7ff2700672d0 0x7ff2700c0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.340 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.339+0000 7ff26dd9b700 1 -- 172.21.15.78:0/1232256553 >> v1:172.21.15.78:6789/0 conn(0x7ff270069580 legacy=0x7ff27014ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:14.341 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.339+0000 7ff26d59a700 1 -- 172.21.15.78:0/1232256553 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2899773109 0 0) 0x7ff250003270 con 0x7ff270069580 2021-01-27T09:44:14.341 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.339+0000 7ff26dd9b700 1 -- 172.21.15.78:0/1232256553 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff270065650 con 0x7ff2700676b0 2021-01-27T09:44:14.341 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.339+0000 7ff26e59c700 1 --2- 172.21.15.78:0/1232256553 >> v2:172.21.15.146:3300/0 conn(0x7ff2700672d0 0x7ff2700c0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:44:14.341 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.339+0000 7ff26dd9b700 1 --2- 172.21.15.78:0/1232256553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2700676b0 0x7ff2701512e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ff270061da0 tx=0x7ff258006e20).ready entity=mon.0 client_cookie=f456ada1fbebe398 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:14.341 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.339+0000 7ff26d59a700 1 -- 172.21.15.78:0/1232256553 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2600018a0 con 0x7ff2700676b0 2021-01-27T09:44:14.342 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.339+0000 7ff26d59a700 1 -- 172.21.15.78:0/1232256553 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25800be80 con 0x7ff2700676b0 2021-01-27T09:44:14.342 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.339+0000 7ff26d59a700 1 -- 172.21.15.78:0/1232256553 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff258009770 con 0x7ff2700676b0 2021-01-27T09:44:14.345 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.339+0000 7ff26f59e700 1 -- 172.21.15.78:0/1232256553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2700676b0 msgr2=0x7ff2701512e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:14.345 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.339+0000 7ff26f59e700 1 --2- 172.21.15.78:0/1232256553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2700676b0 0x7ff2701512e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ff270061da0 tx=0x7ff258006e20).stop 2021-01-27T09:44:14.346 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.339+0000 7ff26f59e700 1 -- 172.21.15.78:0/1232256553 shutdown_connections 2021-01-27T09:44:14.346 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.339+0000 7ff26f59e700 1 --2- 172.21.15.78:0/1232256553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2700676b0 0x7ff2701512e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.346 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.339+0000 7ff26f59e700 1 --2- 172.21.15.78:0/1232256553 >> v2:172.21.15.146:3300/0 conn(0x7ff2700672d0 0x7ff2700c0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.346 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.339+0000 7ff26f59e700 1 -- 172.21.15.78:0/1232256553 >> 172.21.15.78:0/1232256553 conn(0x7ff270067da0 msgr2=0x7ff2700681b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:14.347 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.339+0000 7ff26f59e700 1 -- 172.21.15.78:0/1232256553 shutdown_connections 2021-01-27T09:44:14.347 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.339+0000 7ff26f59e700 1 -- 172.21.15.78:0/1232256553 wait complete. 2021-01-27T09:44:14.347 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff26f59e700 1 Processor -- start 2021-01-27T09:44:14.347 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff26f59e700 1 -- start start 2021-01-27T09:44:14.347 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff26f59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2700672d0 0x7ff270141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:14.348 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff26f59e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff270069580 0x7ff27015dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:14.348 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff26f59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2700c3a40 0x7ff27015ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:14.348 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff26f59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27015e4d0 con 0x7ff2700672d0 2021-01-27T09:44:14.348 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff26f59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27014ed90 con 0x7ff2700c3a40 2021-01-27T09:44:14.348 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff26f59e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27014f030 con 0x7ff270069580 2021-01-27T09:44:14.349 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff26e59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2700672d0 0x7ff270141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:14.349 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff26dd9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff270069580 0x7ff27015dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:14.349 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff26dd9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff270069580 0x7ff27015dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55110/0 (socket says 172.21.15.78:55110) 2021-01-27T09:44:14.349 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff26dd9b700 1 -- 172.21.15.78:0/3133861134 learned_addr learned my addr 172.21.15.78:0/3133861134 (peer_addr_for_me v2:172.21.15.78:0/0) 2021-01-27T09:44:14.350 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff26ed9d700 1 --2- 172.21.15.78:0/3133861134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2700c3a40 0x7ff27015ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:14.350 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff26dd9b700 1 -- 172.21.15.78:0/3133861134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2700c3a40 msgr2=0x7ff27015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:14.350 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff26dd9b700 1 --2- 172.21.15.78:0/3133861134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2700c3a40 0x7ff27015ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.350 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff26dd9b700 1 -- 172.21.15.78:0/3133861134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2700672d0 msgr2=0x7ff270141e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:14.351 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff26dd9b700 1 --2- 172.21.15.78:0/3133861134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2700672d0 0x7ff270141e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.351 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff26dd9b700 1 -- 172.21.15.78:0/3133861134 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27014f2d0 con 0x7ff270069580 2021-01-27T09:44:14.351 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff26dd9b700 1 --2- 172.21.15.78:0/3133861134 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff270069580 0x7ff27015dfe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff258010000 tx=0x7ff258016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:14.351 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff2667fc700 1 -- 172.21.15.78:0/3133861134 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2580118c0 con 0x7ff270069580 2021-01-27T09:44:14.351 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff2667fc700 1 -- 172.21.15.78:0/3133861134 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff258011a20 con 0x7ff270069580 2021-01-27T09:44:14.352 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff2667fc700 1 -- 172.21.15.78:0/3133861134 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff258011dc0 con 0x7ff270069580 2021-01-27T09:44:14.352 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff26f59e700 1 -- 172.21.15.78:0/3133861134 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff27014f570 con 0x7ff270069580 2021-01-27T09:44:14.352 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff26f59e700 1 -- 172.21.15.78:0/3133861134 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27014fab0 con 0x7ff270069580 2021-01-27T09:44:14.352 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff2667fc700 1 -- 172.21.15.78:0/3133861134 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7ff25800f070 con 0x7ff270069580 2021-01-27T09:44:14.353 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.343+0000 7ff2667fc700 1 -- 172.21.15.78:0/3133861134 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7ff25801ddb0 con 0x7ff270069580 2021-01-27T09:44:14.353 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.347+0000 7ff26f59e700 1 -- 172.21.15.78:0/3133861134 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff27006a190 con 0x7ff270069580 2021-01-27T09:44:14.353 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.351+0000 7ff2667fc700 1 -- 172.21.15.78:0/3133861134 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72015 (secure 0 0 0) 0x7ff258016070 con 0x7ff270069580 2021-01-27T09:44:14.422 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.423+0000 7ff26f59e700 1 -- 172.21.15.78:0/3133861134 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd new", "uuid": "25441909-a40b-4d82-828d-326685513ec4", "id": 0} v 0) v1 -- 0x7ff270060810 con 0x7ff270069580 2021-01-27T09:44:14.432 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.431+0000 7ff2667fc700 1 -- 172.21.15.78:0/3133861134 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "25441909-a40b-4d82-828d-326685513ec4", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff258027460 con 0x7ff270069580 2021-01-27T09:44:14.433 INFO:teuthology.orchestra.run.smithi078.stdout:0 2021-01-27T09:44:14.434 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.435+0000 7ff26f59e700 1 -- 172.21.15.78:0/3133861134 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff270069580 msgr2=0x7ff27015dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:14.434 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.435+0000 7ff26f59e700 1 --2- 172.21.15.78:0/3133861134 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff270069580 0x7ff27015dfe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff258010000 tx=0x7ff258016000).stop 2021-01-27T09:44:14.434 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.435+0000 7ff26f59e700 1 -- 172.21.15.78:0/3133861134 shutdown_connections 2021-01-27T09:44:14.434 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.435+0000 7ff26f59e700 1 --2- 172.21.15.78:0/3133861134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2700c3a40 0x7ff27015ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.435 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.435+0000 7ff26f59e700 1 --2- 172.21.15.78:0/3133861134 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff270069580 0x7ff27015dfe0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.435 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.435+0000 7ff26f59e700 1 --2- 172.21.15.78:0/3133861134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2700672d0 0x7ff270141e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.435 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.435+0000 7ff26f59e700 1 -- 172.21.15.78:0/3133861134 >> 172.21.15.78:0/3133861134 conn(0x7ff270067da0 msgr2=0x7ff2700bcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:14.435 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.435+0000 7ff26f59e700 1 -- 172.21.15.78:0/3133861134 shutdown_connections 2021-01-27T09:44:14.436 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.435+0000 7ff26f59e700 1 -- 172.21.15.78:0/3133861134 wait complete. 2021-01-27T09:44:14.448 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 825bbc51-2ffe-4612-a300-00960e48be02 1 2021-01-27T09:44:14.551 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.551+0000 7fbefd666700 1 Processor -- start 2021-01-27T09:44:14.551 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.551+0000 7fbefd666700 1 -- start start 2021-01-27T09:44:14.554 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.551+0000 7fbefd666700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbef80629b0 0x7fbef814e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:14.554 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.551+0000 7fbefd666700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbef8062d90 0x7fbef814ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:14.554 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.551+0000 7fbefd666700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef81519b0 con 0x7fbef8066f60 2021-01-27T09:44:14.554 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.551+0000 7fbefd666700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef814ef50 con 0x7fbef80629b0 2021-01-27T09:44:14.555 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.551+0000 7fbefd666700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef8151c50 con 0x7fbef8062d90 2021-01-27T09:44:14.555 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.551+0000 7fbef7fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbef80629b0 0x7fbef814e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:14.555 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.551+0000 7fbef7fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbef80629b0 0x7fbef814e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58794/0 (socket says 172.21.15.78:58794) 2021-01-27T09:44:14.555 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.551+0000 7fbef7fff700 1 -- 172.21.15.78:0/281320589 learned_addr learned my addr 172.21.15.78:0/281320589 (peer_addr_for_me v2:172.21.15.78:0/0) 2021-01-27T09:44:14.555 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.551+0000 7fbef77fe700 1 --2- 172.21.15.78:0/281320589 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbef8062d90 0x7fbef814ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:14.556 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbef7fff700 1 -- 172.21.15.78:0/281320589 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbef8062d90 msgr2=0x7fbef814ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:14.556 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbef7fff700 1 --2- 172.21.15.78:0/281320589 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbef8062d90 0x7fbef814ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.556 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbef7fff700 1 -- 172.21.15.78:0/281320589 >> v1:172.21.15.146:6789/0 conn(0x7fbef8066f60 legacy=0x7fbef8064240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:14.556 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbef7fff700 1 -- 172.21.15.78:0/281320589 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef8151ef0 con 0x7fbef80629b0 2021-01-27T09:44:14.556 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbef77fe700 1 --2- 172.21.15.78:0/281320589 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbef8062d90 0x7fbef814ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:14.557 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbef7fff700 1 --2- 172.21.15.78:0/281320589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbef80629b0 0x7fbef814e570 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fbee800ba20 tx=0x7fbee8006ee0).ready entity=mon.0 client_cookie=af223f72a660af6e server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:14.557 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbef6ffd700 1 -- 172.21.15.78:0/281320589 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee8009890 con 0x7fbef80629b0 2021-01-27T09:44:14.557 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbef6ffd700 1 -- 172.21.15.78:0/281320589 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee80099f0 con 0x7fbef80629b0 2021-01-27T09:44:14.557 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbef6ffd700 1 -- 172.21.15.78:0/281320589 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee8009d70 con 0x7fbef80629b0 2021-01-27T09:44:14.557 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbefd666700 1 -- 172.21.15.78:0/281320589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbef80629b0 msgr2=0x7fbef814e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:14.558 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbefd666700 1 --2- 172.21.15.78:0/281320589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbef80629b0 0x7fbef814e570 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fbee800ba20 tx=0x7fbee8006ee0).stop 2021-01-27T09:44:14.558 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbefd666700 1 -- 172.21.15.78:0/281320589 shutdown_connections 2021-01-27T09:44:14.558 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbefd666700 1 --2- 172.21.15.78:0/281320589 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbef8062d90 0x7fbef814ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.558 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbefd666700 1 --2- 172.21.15.78:0/281320589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbef80629b0 0x7fbef814e570 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.558 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbefd666700 1 -- 172.21.15.78:0/281320589 >> 172.21.15.78:0/281320589 conn(0x7fbef80c1220 msgr2=0x7fbef80c1630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:14.559 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbefd666700 1 -- 172.21.15.78:0/281320589 shutdown_connections 2021-01-27T09:44:14.559 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbefd666700 1 -- 172.21.15.78:0/281320589 wait complete. 2021-01-27T09:44:14.562 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbefd666700 1 Processor -- start 2021-01-27T09:44:14.562 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbefd666700 1 -- start start 2021-01-27T09:44:14.563 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbefd666700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef80629b0 0x7fbef8147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:14.563 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbefd666700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbef8062d90 0x7fbef80bff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:14.563 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbefd666700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbef8066f60 0x7fbef80c0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:14.563 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbefd666700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef80c08f0 con 0x7fbef8066f60 2021-01-27T09:44:14.564 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.555+0000 7fbefd666700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef814bc50 con 0x7fbef80629b0 2021-01-27T09:44:14.564 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.559+0000 7fbefd666700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef8160e40 con 0x7fbef8062d90 2021-01-27T09:44:14.564 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.559+0000 7fbef77fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbef8062d90 0x7fbef80bff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:14.564 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.559+0000 7fbefce65700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbef8066f60 0x7fbef80c0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:14.564 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.559+0000 7fbef77fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbef8062d90 0x7fbef80bff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55120/0 (socket says 172.21.15.78:55120) 2021-01-27T09:44:14.565 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.559+0000 7fbef77fe700 1 -- 172.21.15.78:0/3678568657 learned_addr learned my addr 172.21.15.78:0/3678568657 (peer_addr_for_me v2:172.21.15.78:0/0) 2021-01-27T09:44:14.565 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.559+0000 7fbef77fe700 1 -- 172.21.15.78:0/3678568657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef80629b0 msgr2=0x7fbef8147d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:14.565 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.559+0000 7fbef77fe700 1 --2- 172.21.15.78:0/3678568657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef80629b0 0x7fbef8147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:44:14.565 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.559+0000 7fbef77fe700 1 -- 172.21.15.78:0/3678568657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbef8066f60 msgr2=0x7fbef80c0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:14.565 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.559+0000 7fbef77fe700 1 --2- 172.21.15.78:0/3678568657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbef8066f60 0x7fbef80c0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.566 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.559+0000 7fbef77fe700 1 -- 172.21.15.78:0/3678568657 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef80bf030 con 0x7fbef8062d90 2021-01-27T09:44:14.566 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.559+0000 7fbefce65700 1 --2- 172.21.15.78:0/3678568657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbef8066f60 0x7fbef80c0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:14.566 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.559+0000 7fbef77fe700 1 --2- 172.21.15.78:0/3678568657 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbef8062d90 0x7fbef80bff10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fbeec00ef50 tx=0x7fbeec006e20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:14.566 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.559+0000 7fbedffff700 1 -- 172.21.15.78:0/3678568657 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec00cb60 con 0x7fbef8062d90 2021-01-27T09:44:14.566 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.559+0000 7fbedffff700 1 -- 172.21.15.78:0/3678568657 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeec00ccc0 con 0x7fbef8062d90 2021-01-27T09:44:14.567 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.559+0000 7fbefd666700 1 -- 172.21.15.78:0/3678568657 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef8161070 con 0x7fbef8062d90 2021-01-27T09:44:14.567 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.559+0000 7fbedffff700 1 -- 172.21.15.78:0/3678568657 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec0123f0 con 0x7fbef8062d90 2021-01-27T09:44:14.567 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.559+0000 7fbefd666700 1 -- 172.21.15.78:0/3678568657 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef80bf530 con 0x7fbef8062d90 2021-01-27T09:44:14.567 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.559+0000 7fbedffff700 1 -- 172.21.15.78:0/3678568657 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fbeec0129c0 con 0x7fbef8062d90 2021-01-27T09:44:14.567 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.559+0000 7fbedffff700 1 -- 172.21.15.78:0/3678568657 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7fbeec01ca70 con 0x7fbef8062d90 2021-01-27T09:44:14.568 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.559+0000 7fbefd666700 1 -- 172.21.15.78:0/3678568657 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef80c1e30 con 0x7fbef8062d90 2021-01-27T09:44:14.568 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.563+0000 7fbedffff700 1 -- 172.21.15.78:0/3678568657 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72015 (secure 0 0 0) 0x7fbeec012de0 con 0x7fbef8062d90 2021-01-27T09:44:14.636 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.635+0000 7fbefd666700 1 -- 172.21.15.78:0/3678568657 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd new", "uuid": "825bbc51-2ffe-4612-a300-00960e48be02", "id": 1} v 0) v1 -- 0x7fbef8063420 con 0x7fbef8062d90 2021-01-27T09:44:14.645 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.647+0000 7fbedffff700 1 -- 172.21.15.78:0/3678568657 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "825bbc51-2ffe-4612-a300-00960e48be02", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbeec01ccb0 con 0x7fbef8062d90 2021-01-27T09:44:14.646 INFO:teuthology.orchestra.run.smithi078.stdout:1 2021-01-27T09:44:14.647 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.647+0000 7fbefd666700 1 -- 172.21.15.78:0/3678568657 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbef8062d90 msgr2=0x7fbef80bff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:14.647 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.647+0000 7fbefd666700 1 --2- 172.21.15.78:0/3678568657 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbef8062d90 0x7fbef80bff10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fbeec00ef50 tx=0x7fbeec006e20).stop 2021-01-27T09:44:14.647 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.647+0000 7fbefd666700 1 -- 172.21.15.78:0/3678568657 shutdown_connections 2021-01-27T09:44:14.648 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.647+0000 7fbefd666700 1 --2- 172.21.15.78:0/3678568657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbef8066f60 0x7fbef80c0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.648 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.647+0000 7fbefd666700 1 --2- 172.21.15.78:0/3678568657 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbef8062d90 0x7fbef80bff10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.648 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.647+0000 7fbefd666700 1 --2- 172.21.15.78:0/3678568657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef80629b0 0x7fbef8147d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:44:14.648 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.647+0000 7fbefd666700 1 -- 172.21.15.78:0/3678568657 >> 172.21.15.78:0/3678568657 conn(0x7fbef80c1220 msgr2=0x7fbef814b370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:14.649 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.647+0000 7fbefd666700 1 -- 172.21.15.78:0/3678568657 shutdown_connections 2021-01-27T09:44:14.649 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.647+0000 7fbefd666700 1 -- 172.21.15.78:0/3678568657 wait complete. 2021-01-27T09:44:14.660 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new e568b97a-8e71-4ab9-bd64-056892110b3c 2 2021-01-27T09:44:14.762 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.763+0000 7f159a262700 1 Processor -- start 2021-01-27T09:44:14.762 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.763+0000 7f159a262700 1 -- start start 2021-01-27T09:44:14.764 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.763+0000 7f159a262700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15940b9910 0x7f15940bb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:14.764 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.763+0000 7f159a262700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f15940b9cf0 0x7f159414bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:14.765 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.763+0000 7f159a262700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159414f180 con 0x7f15940bf2b0 2021-01-27T09:44:14.765 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.763+0000 7f159a262700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f159414f3b0 con 0x7f15940b9cf0 2021-01-27T09:44:14.765 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.763+0000 7f159a262700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159414f650 con 0x7f15940b9910 2021-01-27T09:44:14.765 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.763+0000 7f1599260700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15940b9910 0x7f15940bb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:14.765 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.763+0000 7f1598a5f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f15940b9cf0 0x7f159414bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:14.766 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.763+0000 7f1599260700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15940b9910 0x7f15940bb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55126/0 (socket says 172.21.15.78:55126) 2021-01-27T09:44:14.766 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.763+0000 7f1599260700 1 -- 172.21.15.78:0/4161174514 learned_addr learned my addr 172.21.15.78:0/4161174514 (peer_addr_for_me v2:172.21.15.78:0/0) 2021-01-27T09:44:14.766 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.763+0000 7f1598a5f700 1 -- 172.21.15.78:0/4161174514 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15940b9910 msgr2=0x7f15940bb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:14.766 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.763+0000 7f1598a5f700 1 --2- 172.21.15.78:0/4161174514 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15940b9910 0x7f15940bb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.767 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.763+0000 7f1598a5f700 1 -- 172.21.15.78:0/4161174514 >> v1:172.21.15.146:6789/0 conn(0x7f15940bf2b0 legacy=0x7f1594145930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:14.767 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.763+0000 7f1598a5f700 1 -- 172.21.15.78:0/4161174514 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159414f8f0 con 0x7f15940b9cf0 2021-01-27T09:44:14.767 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.763+0000 7f1599260700 1 --2- 172.21.15.78:0/4161174514 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15940b9910 0x7f15940bb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:14.767 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.763+0000 7f1598a5f700 1 --2- 172.21.15.78:0/4161174514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15940b9cf0 0x7f159414bd80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f159000b9c0 tx=0x7f1590006e20).ready entity=mon.0 client_cookie=603affb501e93446 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:14.767 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.767+0000 7f157ffff700 1 -- 172.21.15.78:0/4161174514 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1590009830 con 0x7f15940b9cf0 2021-01-27T09:44:14.768 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.767+0000 7f157ffff700 1 -- 172.21.15.78:0/4161174514 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1590009990 con 0x7f15940b9cf0 2021-01-27T09:44:14.768 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.767+0000 7f157ffff700 1 -- 172.21.15.78:0/4161174514 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1590009d10 con 0x7f15940b9cf0 2021-01-27T09:44:14.770 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.767+0000 7f159a262700 1 -- 172.21.15.78:0/4161174514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15940b9cf0 msgr2=0x7f159414bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:14.771 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.767+0000 7f159a262700 1 --2- 172.21.15.78:0/4161174514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15940b9cf0 0x7f159414bd80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f159000b9c0 tx=0x7f1590006e20).stop 2021-01-27T09:44:14.771 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.767+0000 7f159a262700 1 -- 172.21.15.78:0/4161174514 shutdown_connections 2021-01-27T09:44:14.771 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.767+0000 7f159a262700 1 --2- 172.21.15.78:0/4161174514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15940b9cf0 0x7f159414bd80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.771 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.767+0000 7f159a262700 1 --2- 172.21.15.78:0/4161174514 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15940b9910 0x7f15940bb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.771 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.767+0000 7f159a262700 1 -- 172.21.15.78:0/4161174514 >> 172.21.15.78:0/4161174514 conn(0x7f15940644f0 msgr2=0x7f1594067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:14.772 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.767+0000 7f159a262700 1 -- 172.21.15.78:0/4161174514 shutdown_connections 2021-01-27T09:44:14.772 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.767+0000 7f159a262700 1 -- 172.21.15.78:0/4161174514 wait complete. 2021-01-27T09:44:14.772 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.767+0000 7f159a262700 1 Processor -- start 2021-01-27T09:44:14.772 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.767+0000 7f159a262700 1 -- start start 2021-01-27T09:44:14.772 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f159a262700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15940b9910 0x7f1594063130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:14.773 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f159a262700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15940b9cf0 0x7f159415b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:14.773 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f159a262700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15940bf2b0 0x7f159415bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:14.773 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f159a262700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1594148e10 con 0x7f15940bf2b0 2021-01-27T09:44:14.773 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f159a262700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1594147070 con 0x7f15940b9cf0 2021-01-27T09:44:14.774 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f159a262700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159415c010 con 0x7f15940b9910 2021-01-27T09:44:14.774 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f1599260700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15940b9910 0x7f1594063130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:14.774 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f1599a61700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15940bf2b0 0x7f159415bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:14.774 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f1599260700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15940b9910 0x7f1594063130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55132/0 (socket says 172.21.15.78:55132) 2021-01-27T09:44:14.774 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f1599260700 1 -- 172.21.15.78:0/678364802 learned_addr learned my addr 172.21.15.78:0/678364802 (peer_addr_for_me v2:172.21.15.78:0/0) 2021-01-27T09:44:14.775 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f1599a61700 1 -- 172.21.15.78:0/678364802 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15940b9910 msgr2=0x7f1594063130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:14.775 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f1599a61700 1 --2- 172.21.15.78:0/678364802 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15940b9910 0x7f1594063130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.775 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f1598a5f700 1 --2- 172.21.15.78:0/678364802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15940b9cf0 0x7f159415b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:14.775 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f1599a61700 1 -- 172.21.15.78:0/678364802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15940b9cf0 msgr2=0x7f159415b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:14.775 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f1599a61700 1 --2- 172.21.15.78:0/678364802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15940b9cf0 0x7f159415b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.776 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f1599a61700 1 -- 172.21.15.78:0/678364802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15941499a0 con 0x7f15940bf2b0 2021-01-27T09:44:14.776 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f1599a61700 1 --2- 172.21.15.78:0/678364802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15940bf2b0 0x7f159415bb20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f158c00b8b0 tx=0x7f158c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:14.776 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f1585ffb700 1 -- 172.21.15.78:0/678364802 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c00d600 con 0x7f15940bf2b0 2021-01-27T09:44:14.776 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f1585ffb700 1 -- 172.21.15.78:0/678364802 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c00d760 con 0x7f15940bf2b0 2021-01-27T09:44:14.776 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f1585ffb700 1 -- 172.21.15.78:0/678364802 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c00db00 con 0x7f15940bf2b0 2021-01-27T09:44:14.777 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f159a262700 1 -- 172.21.15.78:0/678364802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1594149070 con 0x7f15940bf2b0 2021-01-27T09:44:14.777 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f159a262700 1 -- 172.21.15.78:0/678364802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15941472d0 con 0x7f15940bf2b0 2021-01-27T09:44:14.777 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f1585ffb700 1 -- 172.21.15.78:0/678364802 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f158c0196c0 con 0x7f15940bf2b0 2021-01-27T09:44:14.777 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f1585ffb700 1 -- 172.21.15.78:0/678364802 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f158c00f8b0 con 0x7f15940bf2b0 2021-01-27T09:44:14.778 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.771+0000 7f159a262700 1 -- 172.21.15.78:0/678364802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1594062a10 con 0x7f15940bf2b0 2021-01-27T09:44:14.778 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.775+0000 7f1585ffb700 1 -- 172.21.15.78:0/678364802 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72015 (secure 0 0 0) 0x7f158c019b30 con 0x7f15940bf2b0 2021-01-27T09:44:14.847 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.847+0000 7f159a262700 1 -- 172.21.15.78:0/678364802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e568b97a-8e71-4ab9-bd64-056892110b3c", "id": 2} v 0) v1 -- 0x7f15940b9480 con 0x7f15940bf2b0 2021-01-27T09:44:14.855 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.855+0000 7f1585ffb700 1 -- 172.21.15.78:0/678364802 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e568b97a-8e71-4ab9-bd64-056892110b3c", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f158c00f460 con 0x7f15940bf2b0 2021-01-27T09:44:14.855 INFO:teuthology.orchestra.run.smithi078.stdout:2 2021-01-27T09:44:14.857 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.855+0000 7f159a262700 1 -- 172.21.15.78:0/678364802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15940bf2b0 msgr2=0x7f159415bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:14.857 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.855+0000 7f159a262700 1 --2- 172.21.15.78:0/678364802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15940bf2b0 0x7f159415bb20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f158c00b8b0 tx=0x7f158c009060).stop 2021-01-27T09:44:14.857 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.855+0000 7f159a262700 1 -- 172.21.15.78:0/678364802 shutdown_connections 2021-01-27T09:44:14.857 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.859+0000 7f159a262700 1 --2- 172.21.15.78:0/678364802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15940bf2b0 0x7f159415bb20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.858 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.859+0000 7f159a262700 1 --2- 172.21.15.78:0/678364802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15940b9cf0 0x7f159415b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.858 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.859+0000 7f159a262700 1 --2- 172.21.15.78:0/678364802 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15940b9910 0x7f1594063130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.858 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.859+0000 7f159a262700 1 -- 172.21.15.78:0/678364802 >> 172.21.15.78:0/678364802 conn(0x7f15940644f0 msgr2=0x7f159414a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:14.858 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.859+0000 7f159a262700 1 -- 172.21.15.78:0/678364802 shutdown_connections 2021-01-27T09:44:14.859 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.859+0000 7f159a262700 1 -- 172.21.15.78:0/678364802 wait complete. 2021-01-27T09:44:14.868 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new f5d50f63-f74a-4aea-a62d-51c38db4d002 3 2021-01-27T09:44:14.971 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.971+0000 7f321759e700 1 Processor -- start 2021-01-27T09:44:14.972 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.971+0000 7f321759e700 1 -- start start 2021-01-27T09:44:14.973 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.971+0000 7f321759e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f32180643e0 0x7f321814ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:14.973 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.971+0000 7f321759e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f32180676a0 0x7f3218144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:14.973 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.971+0000 7f321759e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32180bc500 con 0x7f32180647c0 2021-01-27T09:44:14.974 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.971+0000 7f321759e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321814b320 con 0x7f32180643e0 2021-01-27T09:44:14.974 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.971+0000 7f321759e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321814b5c0 con 0x7f32180676a0 2021-01-27T09:44:14.974 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.975+0000 7f321659c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f32180643e0 0x7f321814ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:14.974 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.975+0000 7f321659c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f32180643e0 0x7f321814ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58818/0 (socket says 172.21.15.78:58818) 2021-01-27T09:44:14.975 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.975+0000 7f321659c700 1 -- 172.21.15.78:0/3315324294 learned_addr learned my addr 172.21.15.78:0/3315324294 (peer_addr_for_me v2:172.21.15.78:0/0) 2021-01-27T09:44:14.975 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.975+0000 7f321659c700 1 -- 172.21.15.78:0/3315324294 >> v2:172.21.15.146:3300/0 conn(0x7f32180676a0 msgr2=0x7f3218144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:14.975 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.975+0000 7f321659c700 1 --2- 172.21.15.78:0/3315324294 >> v2:172.21.15.146:3300/0 conn(0x7f32180676a0 0x7f3218144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:44:14.975 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.975+0000 7f321659c700 1 -- 172.21.15.78:0/3315324294 >> v1:172.21.15.146:6789/0 conn(0x7f32180647c0 legacy=0x7f32180608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:14.975 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.975+0000 7f321659c700 1 -- 172.21.15.78:0/3315324294 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321814b860 con 0x7f32180643e0 2021-01-27T09:44:14.976 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.975+0000 7f321659c700 1 --2- 172.21.15.78:0/3315324294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32180643e0 0x7f321814ac90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f3218064f60 tx=0x7f3208006ee0).ready entity=mon.0 client_cookie=9825492f8f3cddd6 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:14.976 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.975+0000 7f321559a700 1 -- 172.21.15.78:0/3315324294 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3208009890 con 0x7f32180643e0 2021-01-27T09:44:14.976 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.975+0000 7f321559a700 1 -- 172.21.15.78:0/3315324294 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32080099f0 con 0x7f32180643e0 2021-01-27T09:44:14.976 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.975+0000 7f321559a700 1 -- 172.21.15.78:0/3315324294 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3208009d70 con 0x7f32180643e0 2021-01-27T09:44:14.979 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.975+0000 7f321759e700 1 -- 172.21.15.78:0/3315324294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32180643e0 msgr2=0x7f321814ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:14.979 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.975+0000 7f321759e700 1 --2- 172.21.15.78:0/3315324294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32180643e0 0x7f321814ac90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f3218064f60 tx=0x7f3208006ee0).stop 2021-01-27T09:44:14.980 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.975+0000 7f321759e700 1 -- 172.21.15.78:0/3315324294 shutdown_connections 2021-01-27T09:44:14.980 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.975+0000 7f321759e700 1 --2- 172.21.15.78:0/3315324294 >> v2:172.21.15.146:3300/0 conn(0x7f32180676a0 0x7f3218144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:44:14.980 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.975+0000 7f321759e700 1 --2- 172.21.15.78:0/3315324294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32180643e0 0x7f321814ac90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.980 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.975+0000 7f321759e700 1 -- 172.21.15.78:0/3315324294 >> 172.21.15.78:0/3315324294 conn(0x7f32180c1220 msgr2=0x7f32180c1630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:14.980 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.975+0000 7f321759e700 1 -- 172.21.15.78:0/3315324294 shutdown_connections 2021-01-27T09:44:14.981 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.975+0000 7f321759e700 1 -- 172.21.15.78:0/3315324294 wait complete. 2021-01-27T09:44:14.981 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.975+0000 7f321759e700 1 Processor -- start 2021-01-27T09:44:14.981 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.975+0000 7f321759e700 1 -- start start 2021-01-27T09:44:14.981 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.975+0000 7f321759e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32180643e0 0x7f3218142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:14.981 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f321759e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32180647c0 0x7f32181508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:14.982 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f321759e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32180676a0 0x7f3218150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:14.982 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f321759e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321813b390 con 0x7f32180647c0 2021-01-27T09:44:14.982 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f321759e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3218061900 con 0x7f32180643e0 2021-01-27T09:44:14.982 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f321759e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3218151290 con 0x7f32180676a0 2021-01-27T09:44:14.982 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f3215d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32180647c0 0x7f32181508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:14.983 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f3216d9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32180676a0 0x7f3218150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:14.983 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f3216d9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32180676a0 0x7f3218150da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55146/0 (socket says 172.21.15.78:55146) 2021-01-27T09:44:14.983 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f3216d9d700 1 -- 172.21.15.78:0/2521781114 learned_addr learned my addr 172.21.15.78:0/2521781114 (peer_addr_for_me v2:172.21.15.78:0/0) 2021-01-27T09:44:14.983 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f3215d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32180647c0 0x7f32181508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58828/0 (socket says 172.21.15.78:58828) 2021-01-27T09:44:14.984 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f321659c700 1 --2- 172.21.15.78:0/2521781114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32180643e0 0x7f3218142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:14.984 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f3216d9d700 1 -- 172.21.15.78:0/2521781114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32180643e0 msgr2=0x7f3218142d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:14.984 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f3216d9d700 1 --2- 172.21.15.78:0/2521781114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32180643e0 0x7f3218142d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.984 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f3216d9d700 1 -- 172.21.15.78:0/2521781114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32180647c0 msgr2=0x7f32181508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:14.984 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f3216d9d700 1 --2- 172.21.15.78:0/2521781114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32180647c0 0x7f32181508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:14.985 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f3216d9d700 1 -- 172.21.15.78:0/2521781114 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3218061390 con 0x7f32180676a0 2021-01-27T09:44:14.985 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f321659c700 1 --2- 172.21.15.78:0/2521781114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32180643e0 0x7f3218142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:44:14.985 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f3216d9d700 1 --2- 172.21.15.78:0/2521781114 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32180676a0 0x7f3218150da0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f321000bae0 tx=0x7f32100091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:14.985 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f32067fc700 1 -- 172.21.15.78:0/2521781114 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321000c7a0 con 0x7f32180676a0 2021-01-27T09:44:14.985 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f32067fc700 1 -- 172.21.15.78:0/2521781114 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321000c900 con 0x7f32180676a0 2021-01-27T09:44:14.986 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f321759e700 1 -- 172.21.15.78:0/2521781114 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3218061120 con 0x7f32180676a0 2021-01-27T09:44:14.986 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f32067fc700 1 -- 172.21.15.78:0/2521781114 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321000cab0 con 0x7f32180676a0 2021-01-27T09:44:14.986 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f321759e700 1 -- 172.21.15.78:0/2521781114 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321813b580 con 0x7f32180676a0 2021-01-27T09:44:14.986 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f32067fc700 1 -- 172.21.15.78:0/2521781114 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f321001c070 con 0x7f32180676a0 2021-01-27T09:44:14.986 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f32067fc700 1 -- 172.21.15.78:0/2521781114 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f321000ce20 con 0x7f32180676a0 2021-01-27T09:44:14.987 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.979+0000 7f321759e700 1 -- 172.21.15.78:0/2521781114 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3218044680 con 0x7f32180676a0 2021-01-27T09:44:14.987 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:14.983+0000 7f32067fc700 1 -- 172.21.15.78:0/2521781114 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72015 (secure 0 0 0) 0x7f3210034960 con 0x7f32180676a0 2021-01-27T09:44:15.054 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.055+0000 7f321759e700 1 -- 172.21.15.78:0/2521781114 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f5d50f63-f74a-4aea-a62d-51c38db4d002", "id": 3} v 0) v1 -- 0x7f321805c8e0 con 0x7f32180676a0 2021-01-27T09:44:15.062 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.063+0000 7f32067fc700 1 -- 172.21.15.78:0/2521781114 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f5d50f63-f74a-4aea-a62d-51c38db4d002", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3210023020 con 0x7f32180676a0 2021-01-27T09:44:15.063 INFO:teuthology.orchestra.run.smithi078.stdout:3 2021-01-27T09:44:15.065 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.067+0000 7f321759e700 1 -- 172.21.15.78:0/2521781114 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32180676a0 msgr2=0x7f3218150da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:15.065 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.067+0000 7f321759e700 1 --2- 172.21.15.78:0/2521781114 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32180676a0 0x7f3218150da0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f321000bae0 tx=0x7f32100091d0).stop 2021-01-27T09:44:15.065 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.067+0000 7f321759e700 1 -- 172.21.15.78:0/2521781114 shutdown_connections 2021-01-27T09:44:15.066 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.067+0000 7f321759e700 1 --2- 172.21.15.78:0/2521781114 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32180676a0 0x7f3218150da0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.067 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.067+0000 7f321759e700 1 --2- 172.21.15.78:0/2521781114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32180647c0 0x7f32181508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.067 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.067+0000 7f321759e700 1 --2- 172.21.15.78:0/2521781114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32180643e0 0x7f3218142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.067 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.067+0000 7f321759e700 1 -- 172.21.15.78:0/2521781114 >> 172.21.15.78:0/2521781114 conn(0x7f32180c1220 msgr2=0x7f321814f320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:15.068 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.067+0000 7f321759e700 1 -- 172.21.15.78:0/2521781114 shutdown_connections 2021-01-27T09:44:15.068 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.067+0000 7f321759e700 1 -- 172.21.15.78:0/2521781114 wait complete. 2021-01-27T09:44:15.078 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 782458d7-6f52-48f4-9466-67b61ef27016 4 2021-01-27T09:44:15.178 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.179+0000 7fdc4cb52700 1 Processor -- start 2021-01-27T09:44:15.179 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.179+0000 7fdc4cb52700 1 -- start start 2021-01-27T09:44:15.181 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.179+0000 7fdc4cb52700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc4814ec90 0x7fdc4814ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:15.181 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.179+0000 7fdc4cb52700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdc48062d90 0x7fdc4814b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:15.181 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.179+0000 7fdc4cb52700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc481519b0 con 0x7fdc480629b0 2021-01-27T09:44:15.181 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.179+0000 7fdc4cb52700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc48151c50 con 0x7fdc48062d90 2021-01-27T09:44:15.182 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.179+0000 7fdc4cb52700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc48151ef0 con 0x7fdc4814ec90 2021-01-27T09:44:15.182 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.179+0000 7fdc47fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdc48062d90 0x7fdc4814b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:15.182 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.179+0000 7fdc47fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdc48062d90 0x7fdc4814b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58832/0 (socket says 172.21.15.78:58832) 2021-01-27T09:44:15.182 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.179+0000 7fdc47fff700 1 -- 172.21.15.78:0/1422367320 learned_addr learned my addr 172.21.15.78:0/1422367320 (peer_addr_for_me v2:172.21.15.78:0/0) 2021-01-27T09:44:15.183 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.179+0000 7fdc477fe700 1 --1- 172.21.15.78:0/1422367320 >> v1:172.21.15.78:6789/0 conn(0x7fdc480629b0 0x7fdc4814e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44240/0 (socket says 172.21.15.78:44240) 2021-01-27T09:44:15.183 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.179+0000 7fdc46ffd700 1 --2- 172.21.15.78:0/1422367320 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc4814ec90 0x7fdc4814ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:15.183 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.179+0000 7fdc46ffd700 1 -- 172.21.15.78:0/1422367320 >> v2:172.21.15.78:3300/0 conn(0x7fdc48062d90 msgr2=0x7fdc4814b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:15.183 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.179+0000 7fdc46ffd700 1 --2- 172.21.15.78:0/1422367320 >> v2:172.21.15.78:3300/0 conn(0x7fdc48062d90 0x7fdc4814b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.183 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.179+0000 7fdc46ffd700 1 -- 172.21.15.78:0/1422367320 >> v1:172.21.15.78:6789/0 conn(0x7fdc480629b0 legacy=0x7fdc4814e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:15.184 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.179+0000 7fdc467fc700 1 -- 172.21.15.78:0/1422367320 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525588823 0 0) 0x7fdc481519b0 con 0x7fdc480629b0 2021-01-27T09:44:15.184 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc46ffd700 1 -- 172.21.15.78:0/1422367320 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc48152190 con 0x7fdc4814ec90 2021-01-27T09:44:15.184 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc47fff700 1 --2- 172.21.15.78:0/1422367320 >> v2:172.21.15.78:3300/0 conn(0x7fdc48062d90 0x7fdc4814b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:15.184 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc46ffd700 1 --2- 172.21.15.78:0/1422367320 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc4814ec90 0x7fdc4814ac40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fdc3c00b9c0 tx=0x7fdc3c006e20).ready entity=mon.2 client_cookie=3d288b61ed0c325c server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:15.184 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc467fc700 1 -- 172.21.15.78:0/1422367320 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c009870 con 0x7fdc4814ec90 2021-01-27T09:44:15.185 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc467fc700 1 -- 172.21.15.78:0/1422367320 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3c0099d0 con 0x7fdc4814ec90 2021-01-27T09:44:15.185 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc467fc700 1 -- 172.21.15.78:0/1422367320 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c009d50 con 0x7fdc4814ec90 2021-01-27T09:44:15.189 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc4cb52700 1 -- 172.21.15.78:0/1422367320 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc4814ec90 msgr2=0x7fdc4814ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:15.189 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc4cb52700 1 --2- 172.21.15.78:0/1422367320 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc4814ec90 0x7fdc4814ac40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fdc3c00b9c0 tx=0x7fdc3c006e20).stop 2021-01-27T09:44:15.189 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc4cb52700 1 -- 172.21.15.78:0/1422367320 shutdown_connections 2021-01-27T09:44:15.189 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc4cb52700 1 --2- 172.21.15.78:0/1422367320 >> v2:172.21.15.78:3300/0 conn(0x7fdc48062d90 0x7fdc4814b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.190 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc4cb52700 1 --2- 172.21.15.78:0/1422367320 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc4814ec90 0x7fdc4814ac40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.190 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc4cb52700 1 -- 172.21.15.78:0/1422367320 >> 172.21.15.78:0/1422367320 conn(0x7fdc480c1220 msgr2=0x7fdc480c1630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:15.190 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc4cb52700 1 -- 172.21.15.78:0/1422367320 shutdown_connections 2021-01-27T09:44:15.190 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc4cb52700 1 -- 172.21.15.78:0/1422367320 wait complete. 2021-01-27T09:44:15.191 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc4cb52700 1 Processor -- start 2021-01-27T09:44:15.191 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc4cb52700 1 -- start start 2021-01-27T09:44:15.191 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc4cb52700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc480629b0 0x7fdc48161800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:15.191 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc4cb52700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc48062d90 0x7fdc4814a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:15.191 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc4cb52700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc4814ec90 0x7fdc4815e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:15.192 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc4cb52700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc481443f0 con 0x7fdc48062d90 2021-01-27T09:44:15.192 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc4cb52700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc48142c20 con 0x7fdc480629b0 2021-01-27T09:44:15.192 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc4cb52700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc48144620 con 0x7fdc4814ec90 2021-01-27T09:44:15.192 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc46ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc48062d90 0x7fdc4814a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:15.192 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc47fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc4814ec90 0x7fdc4815e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:15.193 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc46ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc48062d90 0x7fdc4814a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58838/0 (socket says 172.21.15.78:58838) 2021-01-27T09:44:15.193 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.183+0000 7fdc46ffd700 1 -- 172.21.15.78:0/757375844 learned_addr learned my addr 172.21.15.78:0/757375844 (peer_addr_for_me v2:172.21.15.78:0/0) 2021-01-27T09:44:15.193 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.187+0000 7fdc47fff700 1 -- 172.21.15.78:0/757375844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc480629b0 msgr2=0x7fdc48161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:15.193 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.187+0000 7fdc47fff700 1 --2- 172.21.15.78:0/757375844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc480629b0 0x7fdc48161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:44:15.193 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.187+0000 7fdc47fff700 1 -- 172.21.15.78:0/757375844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc48062d90 msgr2=0x7fdc4814a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:15.194 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.187+0000 7fdc47fff700 1 --2- 172.21.15.78:0/757375844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc48062d90 0x7fdc4814a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.194 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.187+0000 7fdc47fff700 1 -- 172.21.15.78:0/757375844 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc481448c0 con 0x7fdc4814ec90 2021-01-27T09:44:15.194 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.187+0000 7fdc46ffd700 1 --2- 172.21.15.78:0/757375844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc48062d90 0x7fdc4814a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:15.194 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.187+0000 7fdc47fff700 1 --2- 172.21.15.78:0/757375844 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc4814ec90 0x7fdc4815e0f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fdc40006fd0 tx=0x7fdc400092d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:15.194 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.187+0000 7fdc2f7fe700 1 -- 172.21.15.78:0/757375844 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4000ccb0 con 0x7fdc4814ec90 2021-01-27T09:44:15.195 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.187+0000 7fdc2f7fe700 1 -- 172.21.15.78:0/757375844 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4000ce10 con 0x7fdc4814ec90 2021-01-27T09:44:15.195 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.187+0000 7fdc2f7fe700 1 -- 172.21.15.78:0/757375844 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40012600 con 0x7fdc4814ec90 2021-01-27T09:44:15.195 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.187+0000 7fdc4cb52700 1 -- 172.21.15.78:0/757375844 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc48144b60 con 0x7fdc4814ec90 2021-01-27T09:44:15.195 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.187+0000 7fdc4cb52700 1 -- 172.21.15.78:0/757375844 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc4815dc50 con 0x7fdc4814ec90 2021-01-27T09:44:15.195 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.187+0000 7fdc2f7fe700 1 -- 172.21.15.78:0/757375844 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fdc40005ce0 con 0x7fdc4814ec90 2021-01-27T09:44:15.196 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.187+0000 7fdc2f7fe700 1 -- 172.21.15.78:0/757375844 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7fdc40006640 con 0x7fdc4814ec90 2021-01-27T09:44:15.196 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.191+0000 7fdc4cb52700 1 -- 172.21.15.78:0/757375844 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc48063420 con 0x7fdc4814ec90 2021-01-27T09:44:15.197 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.195+0000 7fdc2f7fe700 1 -- 172.21.15.78:0/757375844 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72015 (secure 0 0 0) 0x7fdc40016020 con 0x7fdc4814ec90 2021-01-27T09:44:15.263 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.263+0000 7fdc4cb52700 1 -- 172.21.15.78:0/757375844 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd new", "uuid": "782458d7-6f52-48f4-9466-67b61ef27016", "id": 4} v 0) v1 -- 0x7fdc48044680 con 0x7fdc4814ec90 2021-01-27T09:44:15.273 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.275+0000 7fdc2f7fe700 1 -- 172.21.15.78:0/757375844 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "782458d7-6f52-48f4-9466-67b61ef27016", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdc40012b40 con 0x7fdc4814ec90 2021-01-27T09:44:15.274 INFO:teuthology.orchestra.run.smithi078.stdout:4 2021-01-27T09:44:15.275 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.275+0000 7fdc4cb52700 1 -- 172.21.15.78:0/757375844 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc4814ec90 msgr2=0x7fdc4815e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:15.275 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.275+0000 7fdc4cb52700 1 --2- 172.21.15.78:0/757375844 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc4814ec90 0x7fdc4815e0f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fdc40006fd0 tx=0x7fdc400092d0).stop 2021-01-27T09:44:15.275 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.275+0000 7fdc4cb52700 1 -- 172.21.15.78:0/757375844 shutdown_connections 2021-01-27T09:44:15.275 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.275+0000 7fdc4cb52700 1 --2- 172.21.15.78:0/757375844 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc4814ec90 0x7fdc4815e0f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.276 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.275+0000 7fdc4cb52700 1 --2- 172.21.15.78:0/757375844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc48062d90 0x7fdc4814a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.276 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.275+0000 7fdc4cb52700 1 --2- 172.21.15.78:0/757375844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc480629b0 0x7fdc48161800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:44:15.276 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.275+0000 7fdc4cb52700 1 -- 172.21.15.78:0/757375844 >> 172.21.15.78:0/757375844 conn(0x7fdc480c1220 msgr2=0x7fdc481489c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:15.276 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.275+0000 7fdc4cb52700 1 -- 172.21.15.78:0/757375844 shutdown_connections 2021-01-27T09:44:15.276 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.275+0000 7fdc4cb52700 1 -- 172.21.15.78:0/757375844 wait complete. 2021-01-27T09:44:15.289 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721 5 2021-01-27T09:44:15.390 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.391+0000 7fadd5587700 1 Processor -- start 2021-01-27T09:44:15.390 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.391+0000 7fadd5587700 1 -- start start 2021-01-27T09:44:15.392 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.391+0000 7fadd5587700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fadd00629b0 0x7fadd014e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:15.392 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.391+0000 7fadd5587700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fadd0066f60 0x7fadd014ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:15.393 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.391+0000 7fadd5587700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd01519b0 con 0x7fadd0062d90 2021-01-27T09:44:15.393 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.391+0000 7fadd5587700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd014ef50 con 0x7fadd0066f60 2021-01-27T09:44:15.393 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.391+0000 7fadd5587700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd0151c50 con 0x7fadd00629b0 2021-01-27T09:44:15.394 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.391+0000 7fadd4d86700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fadd0066f60 0x7fadd014ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:15.394 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.391+0000 7fadd4d86700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fadd0066f60 0x7fadd014ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58844/0 (socket says 172.21.15.78:58844) 2021-01-27T09:44:15.394 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.391+0000 7fadcf7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fadd0062d90 0x7fadd0064240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44256/0 (socket says 172.21.15.78:44256) 2021-01-27T09:44:15.394 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.391+0000 7fadd4d86700 1 -- 172.21.15.78:0/3757988748 learned_addr learned my addr 172.21.15.78:0/3757988748 (peer_addr_for_me v2:172.21.15.78:0/0) 2021-01-27T09:44:15.395 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.391+0000 7fadd4d86700 1 -- 172.21.15.78:0/3757988748 >> v2:172.21.15.146:3300/0 conn(0x7fadd00629b0 msgr2=0x7fadd014e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:15.395 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.391+0000 7fadd4d86700 1 --2- 172.21.15.78:0/3757988748 >> v2:172.21.15.146:3300/0 conn(0x7fadd00629b0 0x7fadd014e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:44:15.395 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.391+0000 7fadd4d86700 1 -- 172.21.15.78:0/3757988748 >> v1:172.21.15.78:6789/0 conn(0x7fadd0062d90 legacy=0x7fadd0064240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:15.395 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.391+0000 7fadd4d86700 1 -- 172.21.15.78:0/3757988748 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd0151ef0 con 0x7fadd0066f60 2021-01-27T09:44:15.395 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.391+0000 7fadd4d86700 1 --2- 172.21.15.78:0/3757988748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd0066f60 0x7fadd014ea60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fadd00652b0 tx=0x7fadc80092d0).ready entity=mon.0 client_cookie=623a6d104ab463a0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:15.396 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.391+0000 7fadceffd700 1 -- 172.21.15.78:0/3757988748 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc800bc80 con 0x7fadd0066f60 2021-01-27T09:44:15.396 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.391+0000 7fadceffd700 1 -- 172.21.15.78:0/3757988748 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc800bde0 con 0x7fadd0066f60 2021-01-27T09:44:15.396 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.391+0000 7fadceffd700 1 -- 172.21.15.78:0/3757988748 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc8011610 con 0x7fadd0066f60 2021-01-27T09:44:15.396 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.391+0000 7fadd5587700 1 -- 172.21.15.78:0/3757988748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd0066f60 msgr2=0x7fadd014ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:15.396 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.391+0000 7fadd5587700 1 --2- 172.21.15.78:0/3757988748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd0066f60 0x7fadd014ea60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fadd00652b0 tx=0x7fadc80092d0).stop 2021-01-27T09:44:15.397 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadd5587700 1 -- 172.21.15.78:0/3757988748 shutdown_connections 2021-01-27T09:44:15.397 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadd5587700 1 --2- 172.21.15.78:0/3757988748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd0066f60 0x7fadd014ea60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.397 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadd5587700 1 --2- 172.21.15.78:0/3757988748 >> v2:172.21.15.146:3300/0 conn(0x7fadd00629b0 0x7fadd014e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:44:15.397 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadd5587700 1 -- 172.21.15.78:0/3757988748 >> 172.21.15.78:0/3757988748 conn(0x7fadd00c1220 msgr2=0x7fadd00c1630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:15.397 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadd5587700 1 -- 172.21.15.78:0/3757988748 shutdown_connections 2021-01-27T09:44:15.398 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadd5587700 1 -- 172.21.15.78:0/3757988748 wait complete. 2021-01-27T09:44:15.400 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadd5587700 1 Processor -- start 2021-01-27T09:44:15.400 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadd5587700 1 -- start start 2021-01-27T09:44:15.400 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadd5587700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadd00629b0 0x7fadd01610b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:15.401 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadd5587700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd0062d90 0x7fadd00c08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:15.401 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadd5587700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadd0066f60 0x7fadd014f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:15.401 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadd5587700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd014d3c0 con 0x7fadd0062d90 2021-01-27T09:44:15.402 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadd5587700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd014ddd0 con 0x7fadd00629b0 2021-01-27T09:44:15.402 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadd5587700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd014d5f0 con 0x7fadd0066f60 2021-01-27T09:44:15.402 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadcf7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd0062d90 0x7fadd00c08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:15.402 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadd4d86700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadd0066f60 0x7fadd014f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:15.402 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadd4d86700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadd0066f60 0x7fadd014f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55172/0 (socket says 172.21.15.78:55172) 2021-01-27T09:44:15.403 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadcf7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd0062d90 0x7fadd00c08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58850/0 (socket says 172.21.15.78:58850) 2021-01-27T09:44:15.403 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadd4d86700 1 -- 172.21.15.78:0/3062721828 learned_addr learned my addr 172.21.15.78:0/3062721828 (peer_addr_for_me v2:172.21.15.78:0/0) 2021-01-27T09:44:15.403 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadcf7fe700 1 -- 172.21.15.78:0/3062721828 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadd0066f60 msgr2=0x7fadd014f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:15.403 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadcf7fe700 1 --2- 172.21.15.78:0/3062721828 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadd0066f60 0x7fadd014f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.403 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadcf7fe700 1 -- 172.21.15.78:0/3062721828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadd00629b0 msgr2=0x7fadd01610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:15.404 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadcf7fe700 1 --2- 172.21.15.78:0/3062721828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadd00629b0 0x7fadd01610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:44:15.404 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadcf7fe700 1 -- 172.21.15.78:0/3062721828 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd014d890 con 0x7fadd0062d90 2021-01-27T09:44:15.404 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadcf7fe700 1 --2- 172.21.15.78:0/3062721828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd0062d90 0x7fadd00c08e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fadc400c6e0 tx=0x7fadc4007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:15.404 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.395+0000 7fadb7fff700 1 -- 172.21.15.78:0/3062721828 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc40072e0 con 0x7fadd0062d90 2021-01-27T09:44:15.404 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.399+0000 7fadb7fff700 1 -- 172.21.15.78:0/3062721828 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc4007440 con 0x7fadd0062d90 2021-01-27T09:44:15.405 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.399+0000 7fadd5587700 1 -- 172.21.15.78:0/3062721828 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd014db30 con 0x7fadd0062d90 2021-01-27T09:44:15.405 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.399+0000 7fadb7fff700 1 -- 172.21.15.78:0/3062721828 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc4005770 con 0x7fadd0062d90 2021-01-27T09:44:15.405 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.399+0000 7fadd5587700 1 -- 172.21.15.78:0/3062721828 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd0153e30 con 0x7fadd0062d90 2021-01-27T09:44:15.405 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.399+0000 7fadd5587700 1 -- 172.21.15.78:0/3062721828 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada8004fa0 con 0x7fadd0062d90 2021-01-27T09:44:15.406 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.399+0000 7fadb7fff700 1 -- 172.21.15.78:0/3062721828 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fadc4010070 con 0x7fadd0062d90 2021-01-27T09:44:15.406 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.399+0000 7fadb7fff700 1 -- 172.21.15.78:0/3062721828 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7fadc4013d20 con 0x7fadd0062d90 2021-01-27T09:44:15.406 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.403+0000 7fadb7fff700 1 -- 172.21.15.78:0/3062721828 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72015 (secure 0 0 0) 0x7fadc4005e00 con 0x7fadd0062d90 2021-01-27T09:44:15.473 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.475+0000 7fadd5587700 1 -- 172.21.15.78:0/3062721828 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721", "id": 5} v 0) v1 -- 0x7fada80052b0 con 0x7fadd0062d90 2021-01-27T09:44:15.481 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.483+0000 7fadb7fff700 1 -- 172.21.15.78:0/3062721828 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fadc4013770 con 0x7fadd0062d90 2021-01-27T09:44:15.481 INFO:teuthology.orchestra.run.smithi078.stdout:5 2021-01-27T09:44:15.483 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.483+0000 7fadd5587700 1 -- 172.21.15.78:0/3062721828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd0062d90 msgr2=0x7fadd00c08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:15.483 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.483+0000 7fadd5587700 1 --2- 172.21.15.78:0/3062721828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd0062d90 0x7fadd00c08e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fadc400c6e0 tx=0x7fadc4007bb0).stop 2021-01-27T09:44:15.483 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.483+0000 7fadd5587700 1 -- 172.21.15.78:0/3062721828 shutdown_connections 2021-01-27T09:44:15.483 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.483+0000 7fadd5587700 1 --2- 172.21.15.78:0/3062721828 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadd0066f60 0x7fadd014f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.484 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.483+0000 7fadd5587700 1 --2- 172.21.15.78:0/3062721828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadd0062d90 0x7fadd00c08e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.484 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.483+0000 7fadd5587700 1 --2- 172.21.15.78:0/3062721828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadd00629b0 0x7fadd01610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:44:15.484 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.483+0000 7fadd5587700 1 -- 172.21.15.78:0/3062721828 >> 172.21.15.78:0/3062721828 conn(0x7fadd00c1220 msgr2=0x7fadd0146af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:15.484 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.483+0000 7fadd5587700 1 -- 172.21.15.78:0/3062721828 shutdown_connections 2021-01-27T09:44:15.485 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.483+0000 7fadd5587700 1 -- 172.21.15.78:0/3062721828 wait complete. 2021-01-27T09:44:15.494 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad 6 2021-01-27T09:44:15.599 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.599+0000 7f0fc92b9700 1 Processor -- start 2021-01-27T09:44:15.600 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.599+0000 7f0fc92b9700 1 -- start start 2021-01-27T09:44:15.602 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc92b9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0fc4060b80 0x7f0fc40b9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:15.602 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc92b9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0fc4061d20 0x7f0fc40bc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:15.602 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc92b9700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fc4060f60 0x7f0fc40bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:15.602 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc92b9700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc40b9bf0 con 0x7f0fc4061d20 2021-01-27T09:44:15.603 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc92b9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc414e150 con 0x7f0fc4060b80 2021-01-27T09:44:15.603 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc92b9700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc414e3f0 con 0x7f0fc4060f60 2021-01-27T09:44:15.603 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc8ab8700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fc4060f60 0x7f0fc40bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:15.603 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc37fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0fc4061d20 0x7f0fc40bc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:15.603 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc8ab8700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fc4060f60 0x7f0fc40bcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55178/0 (socket says 172.21.15.78:55178) 2021-01-27T09:44:15.604 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc8ab8700 1 -- 172.21.15.78:0/4106385 learned_addr learned my addr 172.21.15.78:0/4106385 (peer_addr_for_me v2:172.21.15.78:0/0) 2021-01-27T09:44:15.604 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc37fe700 1 -- 172.21.15.78:0/4106385 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fc4060f60 msgr2=0x7f0fc40bcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:15.604 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc37fe700 1 --2- 172.21.15.78:0/4106385 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fc4060f60 0x7f0fc40bcc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.605 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc37fe700 1 -- 172.21.15.78:0/4106385 >> v2:172.21.15.146:3300/0 conn(0x7f0fc4060b80 msgr2=0x7f0fc40b9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:15.605 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc37fe700 1 --2- 172.21.15.78:0/4106385 >> v2:172.21.15.146:3300/0 conn(0x7f0fc4060b80 0x7f0fc40b9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:44:15.605 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc37fe700 1 -- 172.21.15.78:0/4106385 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc414e690 con 0x7f0fc4061d20 2021-01-27T09:44:15.605 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc8ab8700 1 --2- 172.21.15.78:0/4106385 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fc4060f60 0x7f0fc40bcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:15.605 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc37fe700 1 --2- 172.21.15.78:0/4106385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fc4061d20 0x7f0fc40bc780 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0fc4060640 tx=0x7f0fb8006e20).ready entity=mon.0 client_cookie=4c32b66cfa03d744 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:15.606 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc2ffd700 1 -- 172.21.15.78:0/4106385 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb800be80 con 0x7f0fc4061d20 2021-01-27T09:44:15.606 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc2ffd700 1 -- 172.21.15.78:0/4106385 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb8009870 con 0x7f0fc4061d20 2021-01-27T09:44:15.606 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc2ffd700 1 -- 172.21.15.78:0/4106385 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8009bf0 con 0x7f0fc4061d20 2021-01-27T09:44:15.610 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc92b9700 1 -- 172.21.15.78:0/4106385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fc4061d20 msgr2=0x7f0fc40bc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:15.610 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc92b9700 1 --2- 172.21.15.78:0/4106385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fc4061d20 0x7f0fc40bc780 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0fc4060640 tx=0x7f0fb8006e20).stop 2021-01-27T09:44:15.610 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc92b9700 1 -- 172.21.15.78:0/4106385 shutdown_connections 2021-01-27T09:44:15.610 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc92b9700 1 --2- 172.21.15.78:0/4106385 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fc4060f60 0x7f0fc40bcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.611 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc92b9700 1 --2- 172.21.15.78:0/4106385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fc4061d20 0x7f0fc40bc780 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.611 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc92b9700 1 --2- 172.21.15.78:0/4106385 >> v2:172.21.15.146:3300/0 conn(0x7f0fc4060b80 0x7f0fc40b9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:44:15.611 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc92b9700 1 -- 172.21.15.78:0/4106385 >> 172.21.15.78:0/4106385 conn(0x7f0fc4067b80 msgr2=0x7f0fc40c1220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:15.611 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc92b9700 1 -- 172.21.15.78:0/4106385 shutdown_connections 2021-01-27T09:44:15.612 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc92b9700 1 -- 172.21.15.78:0/4106385 wait complete. 2021-01-27T09:44:15.612 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc92b9700 1 Processor -- start 2021-01-27T09:44:15.612 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.603+0000 7f0fc92b9700 1 -- start start 2021-01-27T09:44:15.612 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fc92b9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fc4060b80 0x7f0fc41613d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:15.612 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fc92b9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fc4060f60 0x7f0fc40bf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:15.613 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fc92b9700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fc4061d20 0x7f0fc415d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:15.613 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fc92b9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc413da10 con 0x7f0fc4060b80 2021-01-27T09:44:15.613 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fc92b9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc4064360 con 0x7f0fc4060f60 2021-01-27T09:44:15.613 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fc92b9700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc40bf6e0 con 0x7f0fc4061d20 2021-01-27T09:44:15.613 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fc8ab8700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fc4061d20 0x7f0fc415d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:15.614 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fc3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fc4060b80 0x7f0fc41613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:15.614 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fc8ab8700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fc4061d20 0x7f0fc415d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:55184/0 (socket says 172.21.15.78:55184) 2021-01-27T09:44:15.614 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fc8ab8700 1 -- 172.21.15.78:0/1251886855 learned_addr learned my addr 172.21.15.78:0/1251886855 (peer_addr_for_me v2:172.21.15.78:0/0) 2021-01-27T09:44:15.614 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fc3fff700 1 -- 172.21.15.78:0/1251886855 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fc4061d20 msgr2=0x7f0fc415d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:15.615 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fc37fe700 1 --2- 172.21.15.78:0/1251886855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fc4060f60 0x7f0fc40bf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:15.615 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fc3fff700 1 --2- 172.21.15.78:0/1251886855 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fc4061d20 0x7f0fc415d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.615 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fc3fff700 1 -- 172.21.15.78:0/1251886855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fc4060f60 msgr2=0x7f0fc40bf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:15.615 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fc3fff700 1 --2- 172.21.15.78:0/1251886855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fc4060f60 0x7f0fc40bf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.615 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fc3fff700 1 -- 172.21.15.78:0/1251886855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc40bf980 con 0x7f0fc4060b80 2021-01-27T09:44:15.616 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fc3fff700 1 --2- 172.21.15.78:0/1251886855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fc4060b80 0x7f0fc41613d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f0fb40096b0 tx=0x7f0fb4006e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:15.616 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fabfff700 1 -- 172.21.15.78:0/1251886855 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb400d4a0 con 0x7f0fc4060b80 2021-01-27T09:44:15.616 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fabfff700 1 -- 172.21.15.78:0/1251886855 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb400d600 con 0x7f0fc4060b80 2021-01-27T09:44:15.616 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fc92b9700 1 -- 172.21.15.78:0/1251886855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc41609f0 con 0x7f0fc4060b80 2021-01-27T09:44:15.616 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fabfff700 1 -- 172.21.15.78:0/1251886855 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb400d9c0 con 0x7f0fc4060b80 2021-01-27T09:44:15.617 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fc92b9700 1 -- 172.21.15.78:0/1251886855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc4160f30 con 0x7f0fc4060b80 2021-01-27T09:44:15.617 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fabfff700 1 -- 172.21.15.78:0/1251886855 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f0fb401a060 con 0x7f0fc4060b80 2021-01-27T09:44:15.617 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fabfff700 1 -- 172.21.15.78:0/1251886855 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f0fb401da60 con 0x7f0fc4060b80 2021-01-27T09:44:15.617 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.607+0000 7f0fc92b9700 1 -- 172.21.15.78:0/1251886855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc4044680 con 0x7f0fc4060b80 2021-01-27T09:44:15.618 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.611+0000 7f0fabfff700 1 -- 172.21.15.78:0/1251886855 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72015 (secure 0 0 0) 0x7f0fb4018070 con 0x7f0fc4060b80 2021-01-27T09:44:15.680 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.679+0000 7f0fc92b9700 1 -- 172.21.15.78:0/1251886855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad", "id": 6} v 0) v1 -- 0x7f0fc40bfc20 con 0x7f0fc4060b80 2021-01-27T09:44:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.687+0000 7f0fabfff700 1 -- 172.21.15.78:0/1251886855 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0fb4013620 con 0x7f0fc4060b80 2021-01-27T09:44:15.685 INFO:teuthology.orchestra.run.smithi078.stdout:6 2021-01-27T09:44:15.686 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.687+0000 7f0fc92b9700 1 -- 172.21.15.78:0/1251886855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fc4060b80 msgr2=0x7f0fc41613d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:15.686 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.687+0000 7f0fc92b9700 1 --2- 172.21.15.78:0/1251886855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fc4060b80 0x7f0fc41613d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f0fb40096b0 tx=0x7f0fb4006e30).stop 2021-01-27T09:44:15.687 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.687+0000 7f0fc92b9700 1 -- 172.21.15.78:0/1251886855 shutdown_connections 2021-01-27T09:44:15.687 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.687+0000 7f0fc92b9700 1 --2- 172.21.15.78:0/1251886855 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fc4061d20 0x7f0fc415d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.687 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.687+0000 7f0fc92b9700 1 --2- 172.21.15.78:0/1251886855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fc4060f60 0x7f0fc40bf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.687 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.687+0000 7f0fc92b9700 1 --2- 172.21.15.78:0/1251886855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fc4060b80 0x7f0fc41613d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.688 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.687+0000 7f0fc92b9700 1 -- 172.21.15.78:0/1251886855 >> 172.21.15.78:0/1251886855 conn(0x7f0fc4067b80 msgr2=0x7f0fc40bbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:15.688 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.687+0000 7f0fc92b9700 1 -- 172.21.15.78:0/1251886855 shutdown_connections 2021-01-27T09:44:15.688 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.687+0000 7f0fc92b9700 1 -- 172.21.15.78:0/1251886855 wait complete. 2021-01-27T09:44:15.700 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 851aeaf3-bcdc-4ac6-b578-c42e1bf87c76 7 2021-01-27T09:44:15.802 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.803+0000 7f3eb32b4700 1 Processor -- start 2021-01-27T09:44:15.802 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.803+0000 7f3eb32b4700 1 -- start start 2021-01-27T09:44:15.803 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.803+0000 7f3eb32b4700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3eac147e80 0x7f3eac14ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:15.803 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.803+0000 7f3eb32b4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eac063650 con 0x7f3eac069510 2021-01-27T09:44:15.804 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.803+0000 7f3eb32b4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eac0b9200 con 0x7f3eac148260 2021-01-27T09:44:15.804 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.803+0000 7f3eb32b4700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eac0b9740 con 0x7f3eac147e80 2021-01-27T09:44:15.804 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.803+0000 7f3eb22b2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3eac147e80 0x7f3eac14ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:15.804 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.803+0000 7f3eb1ab1700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3eac069510 0x7f3eac062f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44280/0 (socket says 172.21.15.78:44280) 2021-01-27T09:44:15.804 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.803+0000 7f3eb1ab1700 1 -- 172.21.15.78:0/2766308325 learned_addr learned my addr 172.21.15.78:0/2766308325 (peer_addr_for_me v1:172.21.15.78:0/0) 2021-01-27T09:44:15.806 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.803+0000 7f3eb22b2700 1 -- 172.21.15.78:0/2766308325 >> v1:172.21.15.146:6789/0 conn(0x7f3eac148260 legacy=0x7f3eac0bb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:15.806 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.803+0000 7f3eb22b2700 1 -- 172.21.15.78:0/2766308325 >> v1:172.21.15.78:6789/0 conn(0x7f3eac069510 legacy=0x7f3eac062f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:15.806 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.803+0000 7f3eb22b2700 1 -- 172.21.15.78:0/2766308325 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac0b94a0 con 0x7f3eac147e80 2021-01-27T09:44:15.806 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.803+0000 7f3eb22b2700 1 --2- 172.21.15.78:0/2766308325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3eac147e80 0x7f3eac14ec40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3eac14bba0 tx=0x7f3e9c006e20).ready entity=mon.0 client_cookie=164fc6fec5e45b40 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:15.806 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.803+0000 7f3eb12b0700 1 -- 172.21.15.78:0/2766308325 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c009830 con 0x7f3eac147e80 2021-01-27T09:44:15.807 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.803+0000 7f3eb12b0700 1 -- 172.21.15.78:0/2766308325 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9c009990 con 0x7f3eac147e80 2021-01-27T09:44:15.807 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.803+0000 7f3eb12b0700 1 -- 172.21.15.78:0/2766308325 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c009d10 con 0x7f3eac147e80 2021-01-27T09:44:15.807 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb32b4700 1 -- 172.21.15.78:0/2766308325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3eac147e80 msgr2=0x7f3eac14ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:15.807 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb32b4700 1 --2- 172.21.15.78:0/2766308325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3eac147e80 0x7f3eac14ec40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3eac14bba0 tx=0x7f3e9c006e20).stop 2021-01-27T09:44:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb32b4700 1 -- 172.21.15.78:0/2766308325 shutdown_connections 2021-01-27T09:44:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb32b4700 1 --2- 172.21.15.78:0/2766308325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3eac147e80 0x7f3eac14ec40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb32b4700 1 -- 172.21.15.78:0/2766308325 >> 172.21.15.78:0/2766308325 conn(0x7f3eac0699a0 msgr2=0x7f3eac062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb32b4700 1 -- 172.21.15.78:0/2766308325 shutdown_connections 2021-01-27T09:44:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb32b4700 1 -- 172.21.15.78:0/2766308325 wait complete. 2021-01-27T09:44:15.811 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb32b4700 1 Processor -- start 2021-01-27T09:44:15.811 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb32b4700 1 -- start start 2021-01-27T09:44:15.811 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb32b4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eac069510 0x7f3eac143280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:15.811 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb32b4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3eac147e80 0x7f3eac0bef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:15.811 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb32b4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3eac148260 0x7f3eac142990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb32b4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac0ba840 con 0x7f3eac148260 2021-01-27T09:44:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb32b4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac151270 con 0x7f3eac069510 2021-01-27T09:44:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb32b4700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac14ef80 con 0x7f3eac147e80 2021-01-27T09:44:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb2ab3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3eac148260 0x7f3eac142990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb1ab1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3eac147e80 0x7f3eac0bef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:15.813 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb2ab3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3eac148260 0x7f3eac142990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58876/0 (socket says 172.21.15.78:58876) 2021-01-27T09:44:15.813 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb2ab3700 1 -- 172.21.15.78:0/1912912188 learned_addr learned my addr 172.21.15.78:0/1912912188 (peer_addr_for_me v2:172.21.15.78:0/0) 2021-01-27T09:44:15.813 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb2ab3700 1 -- 172.21.15.78:0/1912912188 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3eac147e80 msgr2=0x7f3eac0bef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:15.813 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb2ab3700 1 --2- 172.21.15.78:0/1912912188 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3eac147e80 0x7f3eac0bef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.813 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb2ab3700 1 -- 172.21.15.78:0/1912912188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eac069510 msgr2=0x7f3eac143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:15.814 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb2ab3700 1 --2- 172.21.15.78:0/1912912188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eac069510 0x7f3eac143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:44:15.814 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb2ab3700 1 -- 172.21.15.78:0/1912912188 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac1514a0 con 0x7f3eac148260 2021-01-27T09:44:15.814 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb1ab1700 1 --2- 172.21.15.78:0/1912912188 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3eac147e80 0x7f3eac0bef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:15.814 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.807+0000 7f3eb2ab3700 1 --2- 172.21.15.78:0/1912912188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3eac148260 0x7f3eac142990 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3ea400bae0 tx=0x7f3ea40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:15.815 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.811+0000 7f3e9a7fc700 1 -- 172.21.15.78:0/1912912188 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea400c740 con 0x7f3eac148260 2021-01-27T09:44:15.815 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.811+0000 7f3e9a7fc700 1 -- 172.21.15.78:0/1912912188 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea400c8c0 con 0x7f3eac148260 2021-01-27T09:44:15.815 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.811+0000 7f3eb32b4700 1 -- 172.21.15.78:0/1912912188 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eac151740 con 0x7f3eac148260 2021-01-27T09:44:15.815 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.811+0000 7f3e9a7fc700 1 -- 172.21.15.78:0/1912912188 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea400ca70 con 0x7f3eac148260 2021-01-27T09:44:15.815 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.811+0000 7f3eb32b4700 1 -- 172.21.15.78:0/1912912188 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eac1505a0 con 0x7f3eac148260 2021-01-27T09:44:15.816 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.811+0000 7f3e9a7fc700 1 -- 172.21.15.78:0/1912912188 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f3ea401c070 con 0x7f3eac148260 2021-01-27T09:44:15.816 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.811+0000 7f3e9a7fc700 1 -- 172.21.15.78:0/1912912188 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f3ea400cde0 con 0x7f3eac148260 2021-01-27T09:44:15.816 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.811+0000 7f3eb32b4700 1 -- 172.21.15.78:0/1912912188 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eac044680 con 0x7f3eac148260 2021-01-27T09:44:15.816 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.815+0000 7f3e9a7fc700 1 -- 172.21.15.78:0/1912912188 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72015 (secure 0 0 0) 0x7f3ea4034960 con 0x7f3eac148260 2021-01-27T09:44:15.881 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.883+0000 7f3eb32b4700 1 -- 172.21.15.78:0/1912912188 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "851aeaf3-bcdc-4ac6-b578-c42e1bf87c76", "id": 7} v 0) v1 -- 0x7f3eac063d20 con 0x7f3eac148260 2021-01-27T09:44:15.886 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.887+0000 7f3e9a7fc700 1 -- 172.21.15.78:0/1912912188 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "851aeaf3-bcdc-4ac6-b578-c42e1bf87c76", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3ea4023030 con 0x7f3eac148260 2021-01-27T09:44:15.887 INFO:teuthology.orchestra.run.smithi078.stdout:7 2021-01-27T09:44:15.888 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.887+0000 7f3eb32b4700 1 -- 172.21.15.78:0/1912912188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3eac148260 msgr2=0x7f3eac142990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:15.888 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.887+0000 7f3eb32b4700 1 --2- 172.21.15.78:0/1912912188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3eac148260 0x7f3eac142990 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3ea400bae0 tx=0x7f3ea40090f0).stop 2021-01-27T09:44:15.889 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.887+0000 7f3eb32b4700 1 -- 172.21.15.78:0/1912912188 shutdown_connections 2021-01-27T09:44:15.889 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.887+0000 7f3eb32b4700 1 --2- 172.21.15.78:0/1912912188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3eac148260 0x7f3eac142990 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.889 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.887+0000 7f3eb32b4700 1 --2- 172.21.15.78:0/1912912188 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3eac147e80 0x7f3eac0bef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:15.889 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.887+0000 7f3eb32b4700 1 --2- 172.21.15.78:0/1912912188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eac069510 0x7f3eac143280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:44:15.889 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.887+0000 7f3eb32b4700 1 -- 172.21.15.78:0/1912912188 >> 172.21.15.78:0/1912912188 conn(0x7f3eac0699a0 msgr2=0x7f3eac060ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:15.890 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.887+0000 7f3eb32b4700 1 -- 172.21.15.78:0/1912912188 shutdown_connections 2021-01-27T09:44:15.890 INFO:teuthology.orchestra.run.smithi078.stderr:2021-01-27T09:44:15.887+0000 7f3eb32b4700 1 -- 172.21.15.78:0/1912912188 wait complete. 2021-01-27T09:44:15.902 INFO:tasks.ceph.osd.0:Restarting daemon 2021-01-27T09:44:15.902 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2021-01-27T09:44:15.909 INFO:tasks.ceph.osd.0:Started 2021-01-27T09:44:15.909 INFO:tasks.ceph.osd.1:Restarting daemon 2021-01-27T09:44:15.910 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2021-01-27T09:44:15.917 INFO:tasks.ceph.osd.1:Started 2021-01-27T09:44:15.917 INFO:tasks.ceph.osd.2:Restarting daemon 2021-01-27T09:44:15.918 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2021-01-27T09:44:15.924 INFO:tasks.ceph.osd.2:Started 2021-01-27T09:44:15.925 INFO:tasks.ceph.osd.3:Restarting daemon 2021-01-27T09:44:15.925 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2021-01-27T09:44:15.930 INFO:tasks.ceph.osd.3:Started 2021-01-27T09:44:15.930 INFO:tasks.ceph.osd.4:Restarting daemon 2021-01-27T09:44:15.930 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2021-01-27T09:44:15.933 INFO:tasks.ceph.osd.4:Started 2021-01-27T09:44:15.934 INFO:tasks.ceph.osd.5:Restarting daemon 2021-01-27T09:44:15.934 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2021-01-27T09:44:15.937 INFO:tasks.ceph.osd.5:Started 2021-01-27T09:44:15.937 INFO:tasks.ceph.osd.6:Restarting daemon 2021-01-27T09:44:15.938 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2021-01-27T09:44:15.940 INFO:tasks.ceph.osd.6:Started 2021-01-27T09:44:15.940 INFO:tasks.ceph.osd.7:Restarting daemon 2021-01-27T09:44:15.940 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2021-01-27T09:44:15.943 INFO:tasks.ceph.osd.7:Started 2021-01-27T09:44:15.943 INFO:tasks.ceph:Waiting for OSDs to come up 2021-01-27T09:44:16.330 INFO:tasks.ceph.osd.5.smithi078.stderr:2021-01-27T09:44:16.331+0000 7f55f5a3d080 -1 Falling back to public interface 2021-01-27T09:44:16.558 INFO:tasks.ceph.osd.6.smithi078.stderr:2021-01-27T09:44:16.559+0000 7ffa6c247080 -1 Falling back to public interface 2021-01-27T09:44:16.569 INFO:tasks.ceph.osd.4.smithi078.stderr:2021-01-27T09:44:16.571+0000 7f378da28080 -1 Falling back to public interface 2021-01-27T09:44:16.581 INFO:tasks.ceph.osd.7.smithi078.stderr:2021-01-27T09:44:16.583+0000 7fda86357080 -1 Falling back to public interface 2021-01-27T09:44:16.582 INFO:tasks.ceph.osd.0.smithi146.stderr:2021-01-27T09:44:16.581+0000 7f0ff51a0080 -1 Falling back to public interface 2021-01-27T09:44:16.583 INFO:tasks.ceph.osd.3.smithi146.stderr:2021-01-27T09:44:16.585+0000 7f04cb8a2080 -1 Falling back to public interface 2021-01-27T09:44:16.600 INFO:tasks.ceph.osd.1.smithi146.stderr:2021-01-27T09:44:16.601+0000 7fd12e0d4080 -1 Falling back to public interface 2021-01-27T09:44:16.608 INFO:tasks.ceph.osd.2.smithi146.stderr:2021-01-27T09:44:16.609+0000 7f8f26324080 -1 Falling back to public interface 2021-01-27T09:44:16.752 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-01-27T09:44:16.895 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.897+0000 7faf118c5700 1 Processor -- start 2021-01-27T09:44:16.896 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.897+0000 7faf118c5700 1 -- start start 2021-01-27T09:44:16.897 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.897+0000 7faf118c5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faf0c0bf670 0x7faf0c067110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:16.897 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.897+0000 7faf118c5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faf0c0be080 0x7faf0c0a8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:16.898 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.897+0000 7faf118c5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0c14e2f0 con 0x7faf0c14b820 2021-01-27T09:44:16.898 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.897+0000 7faf118c5700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf0c0bdaa0 con 0x7faf0c0bf670 2021-01-27T09:44:16.898 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.897+0000 7faf118c5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf0c0bdd40 con 0x7faf0c0be080 2021-01-27T09:44:16.900 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.897+0000 7faf0a7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7faf0c14b820 0x7faf0c14ec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45342/0 (socket says 172.21.15.146:45342) 2021-01-27T09:44:16.900 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.897+0000 7faf0a7fc700 1 -- 172.21.15.146:0/3010805647 learned_addr learned my addr 172.21.15.146:0/3010805647 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:16.901 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.897+0000 7faf0bfff700 1 --2- 172.21.15.146:0/3010805647 >> v2:172.21.15.146:3300/0 conn(0x7faf0c0be080 0x7faf0c0a8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:16.901 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.897+0000 7faf0affd700 1 --2- 172.21.15.146:0/3010805647 >> v2:172.21.15.78:3300/0 conn(0x7faf0c0bf670 0x7faf0c067110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:16.901 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.897+0000 7faf09ffb700 1 -- 172.21.15.146:0/3010805647 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123614582 0 0) 0x7faf0c14e2f0 con 0x7faf0c14b820 2021-01-27T09:44:16.901 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.897+0000 7faf09ffb700 1 -- 172.21.15.146:0/3010805647 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faef8003270 con 0x7faf0c14b820 2021-01-27T09:44:16.902 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf09ffb700 1 -- 172.21.15.146:0/3010805647 <== mon.1 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2282763703 0 0) 0x7faef8003270 con 0x7faf0c14b820 2021-01-27T09:44:16.902 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf09ffb700 1 -- 172.21.15.146:0/3010805647 >> v2:172.21.15.146:3300/0 conn(0x7faf0c0be080 msgr2=0x7faf0c0a8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:16.902 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf09ffb700 1 --2- 172.21.15.146:0/3010805647 >> v2:172.21.15.146:3300/0 conn(0x7faf0c0be080 0x7faf0c0a8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:16.902 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf09ffb700 1 -- 172.21.15.146:0/3010805647 >> v2:172.21.15.78:3300/0 conn(0x7faf0c0bf670 msgr2=0x7faf0c067110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:16.902 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf09ffb700 1 --2- 172.21.15.146:0/3010805647 >> v2:172.21.15.78:3300/0 conn(0x7faf0c0bf670 0x7faf0c067110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:16.903 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf09ffb700 1 -- 172.21.15.146:0/3010805647 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c14e520 con 0x7faf0c14b820 2021-01-27T09:44:16.903 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf09ffb700 1 -- 172.21.15.146:0/3010805647 <== mon.1 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3890990827 0 0) 0x7faf00001520 con 0x7faf0c14b820 2021-01-27T09:44:16.903 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf0bfff700 1 --2- 172.21.15.146:0/3010805647 >> v2:172.21.15.146:3300/0 conn(0x7faf0c0be080 0x7faf0c0a8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:44:16.903 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf09ffb700 1 -- 172.21.15.146:0/3010805647 >> v1:172.21.15.146:6789/0 conn(0x7faf0c14b820 legacy=0x7faf0c14ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:16.903 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf09ffb700 1 --2- 172.21.15.146:0/3010805647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faef8003760 0x7faef8003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:16.904 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf09ffb700 1 --2- 172.21.15.146:0/3010805647 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faef8004510 0x7faef8004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:16.904 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf09ffb700 1 --2- 172.21.15.146:0/3010805647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faef8004e80 0x7faef800d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:16.904 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf09ffb700 1 -- 172.21.15.146:0/3010805647 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c0bdaa0 con 0x7faef8004e80 2021-01-27T09:44:16.904 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf09ffb700 1 -- 172.21.15.146:0/3010805647 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c0bdd40 con 0x7faef8003760 2021-01-27T09:44:16.904 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf09ffb700 1 -- 172.21.15.146:0/3010805647 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef8004290 con 0x7faef8004510 2021-01-27T09:44:16.905 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf0affd700 1 --2- 172.21.15.146:0/3010805647 >> v2:172.21.15.78:3300/0 conn(0x7faf0c0bf670 0x7faf0c067110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:44:16.905 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf0a7fc700 1 --2- 172.21.15.146:0/3010805647 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faef8004510 0x7faef8004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:16.905 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf0bfff700 1 --2- 172.21.15.146:0/3010805647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faef8004e80 0x7faef800d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:16.905 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf0affd700 1 --2- 172.21.15.146:0/3010805647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faef8003760 0x7faef8003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:16.906 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf0a7fc700 1 -- 172.21.15.146:0/3010805647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faef8003760 msgr2=0x7faef8003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:16.906 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf0a7fc700 1 --2- 172.21.15.146:0/3010805647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faef8003760 0x7faef8003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:16.906 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf0a7fc700 1 -- 172.21.15.146:0/3010805647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faef8004e80 msgr2=0x7faef800d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:16.906 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf0a7fc700 1 --2- 172.21.15.146:0/3010805647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faef8004e80 0x7faef800d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:16.907 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf0a7fc700 1 -- 172.21.15.146:0/3010805647 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef8003270 con 0x7faef8004510 2021-01-27T09:44:16.907 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf0bfff700 1 -- 172.21.15.146:0/3010805647 reap_dead start 2021-01-27T09:44:16.910 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf0a7fc700 1 --2- 172.21.15.146:0/3010805647 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faef8004510 0x7faef8004990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7faf0000c440 tx=0x7faf0c14e6b0).ready entity=mon.2 client_cookie=104c120b23392a8c server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:16.910 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf09ffb700 1 -- 172.21.15.146:0/3010805647 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf000070d0 con 0x7faef8004510 2021-01-27T09:44:16.911 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf09ffb700 1 -- 172.21.15.146:0/3010805647 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf00007230 con 0x7faef8004510 2021-01-27T09:44:16.911 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf09ffb700 1 -- 172.21.15.146:0/3010805647 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf00005620 con 0x7faef8004510 2021-01-27T09:44:16.911 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf118c5700 1 -- 172.21.15.146:0/3010805647 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faef8004510 msgr2=0x7faef8004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:16.911 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf118c5700 1 --2- 172.21.15.146:0/3010805647 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faef8004510 0x7faef8004990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7faf0000c440 tx=0x7faf0c14e6b0).stop 2021-01-27T09:44:16.912 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf118c5700 1 -- 172.21.15.146:0/3010805647 shutdown_connections 2021-01-27T09:44:16.912 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf118c5700 1 --2- 172.21.15.146:0/3010805647 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faef8004510 0x7faef8004990 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:16.912 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf118c5700 1 -- 172.21.15.146:0/3010805647 >> 172.21.15.146:0/3010805647 conn(0x7faf0c0628a0 msgr2=0x7faf0c066660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:16.912 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf118c5700 1 -- 172.21.15.146:0/3010805647 shutdown_connections 2021-01-27T09:44:16.913 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.901+0000 7faf118c5700 1 -- 172.21.15.146:0/3010805647 wait complete. 2021-01-27T09:44:16.913 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.905+0000 7faf118c5700 1 Processor -- start 2021-01-27T09:44:16.913 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.905+0000 7faf118c5700 1 -- start start 2021-01-27T09:44:16.913 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.905+0000 7faf118c5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faef8004510 0x7faf0c0a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:16.913 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.905+0000 7faf118c5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf0c161650 0x7faf0c0bb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:16.914 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.905+0000 7faf118c5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf0c157490 0x7faf0c157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:16.914 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.905+0000 7faf118c5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c0a5080 con 0x7faf0c157490 2021-01-27T09:44:16.914 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.905+0000 7faf118c5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c15d8e0 con 0x7faef8004510 2021-01-27T09:44:16.914 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.905+0000 7faf118c5700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c15db80 con 0x7faf0c161650 2021-01-27T09:44:16.915 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.909+0000 7faf0a7fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf0c161650 0x7faf0c0bb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:16.915 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.909+0000 7faf0a7fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf0c161650 0x7faf0c0bb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:35268/0 (socket says 172.21.15.146:35268) 2021-01-27T09:44:16.915 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.909+0000 7faf0a7fc700 1 -- 172.21.15.146:0/4130078989 learned_addr learned my addr 172.21.15.146:0/4130078989 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:16.915 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.909+0000 7faf0bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf0c157490 0x7faf0c157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:16.916 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.909+0000 7faf0affd700 1 --2- 172.21.15.146:0/4130078989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faef8004510 0x7faf0c0a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:16.917 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.909+0000 7faf0a7fc700 1 -- 172.21.15.146:0/4130078989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faef8004510 msgr2=0x7faf0c0a4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:16.917 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.909+0000 7faf0a7fc700 1 --2- 172.21.15.146:0/4130078989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faef8004510 0x7faf0c0a4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:16.917 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.909+0000 7faf0a7fc700 1 -- 172.21.15.146:0/4130078989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf0c157490 msgr2=0x7faf0c157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:16.917 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.909+0000 7faf0a7fc700 1 --2- 172.21.15.146:0/4130078989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf0c157490 0x7faf0c157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:16.917 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.909+0000 7faf0a7fc700 1 -- 172.21.15.146:0/4130078989 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c15de20 con 0x7faf0c161650 2021-01-27T09:44:16.918 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.909+0000 7faf0a7fc700 1 --2- 172.21.15.146:0/4130078989 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf0c161650 0x7faf0c0bb380 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7faef8004420 tx=0x7faf00015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:16.918 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.909+0000 7faef2ffd700 1 -- 172.21.15.146:0/4130078989 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf000073a0 con 0x7faf0c161650 2021-01-27T09:44:16.918 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.909+0000 7faef2ffd700 1 -- 172.21.15.146:0/4130078989 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf00007500 con 0x7faf0c161650 2021-01-27T09:44:16.918 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.909+0000 7faef2ffd700 1 -- 172.21.15.146:0/4130078989 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf00005280 con 0x7faf0c161650 2021-01-27T09:44:16.918 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.909+0000 7faf118c5700 1 -- 172.21.15.146:0/4130078989 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0c15e0c0 con 0x7faf0c161650 2021-01-27T09:44:16.919 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.909+0000 7faf118c5700 1 -- 172.21.15.146:0/4130078989 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0c0bc220 con 0x7faf0c161650 2021-01-27T09:44:16.919 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.909+0000 7faef2ffd700 1 -- 172.21.15.146:0/4130078989 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7faf00010070 con 0x7faf0c161650 2021-01-27T09:44:16.919 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.909+0000 7faef2ffd700 1 -- 172.21.15.146:0/4130078989 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7faf00004dd0 con 0x7faf0c161650 2021-01-27T09:44:16.920 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.913+0000 7faf118c5700 1 -- 172.21.15.146:0/4130078989 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0c15db80 con 0x7faf0c161650 2021-01-27T09:44:16.920 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.917+0000 7faef2ffd700 1 -- 172.21.15.146:0/4130078989 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72015 (secure 0 0 0) 0x7faf00025060 con 0x7faf0c161650 2021-01-27T09:44:16.982 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.981+0000 7faf118c5700 1 -- 172.21.15.146:0/4130078989 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf0c060850 con 0x7faf0c161650 2021-01-27T09:44:16.983 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.985+0000 7faef2ffd700 1 -- 172.21.15.146:0/4130078989 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7001 (secure 0 0 0) 0x7faf00001c60 con 0x7faf0c161650 2021-01-27T09:44:16.984 INFO:teuthology.misc.health.smithi146.stdout: 2021-01-27T09:44:16.984 INFO:teuthology.misc.health.smithi146.stdout:{"epoch":10,"fsid":"968a1bec-aac5-444e-b70f-7770587be945","created":"2021-01-27T09:44:13.797940+0000","modified":"2021-01-27T09:44:15.886311+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"25441909-a40b-4d82-828d-326685513ec4","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"825bbc51-2ffe-4612-a300-00960e48be02","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e568b97a-8e71-4ab9-bd64-056892110b3c","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f5d50f63-f74a-4aea-a62d-51c38db4d002","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"782458d7-6f52-48f4-9466-67b61ef27016","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"851aeaf3-bcdc-4ac6-b578-c42e1bf87c76","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:44:16.985 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.985+0000 7faf118c5700 1 -- 172.21.15.146:0/4130078989 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf0c161650 msgr2=0x7faf0c0bb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:16.985 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.985+0000 7faf118c5700 1 --2- 172.21.15.146:0/4130078989 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf0c161650 0x7faf0c0bb380 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7faef8004420 tx=0x7faf00015000).stop 2021-01-27T09:44:16.986 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.985+0000 7faf118c5700 1 -- 172.21.15.146:0/4130078989 shutdown_connections 2021-01-27T09:44:16.986 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.985+0000 7faf118c5700 1 --2- 172.21.15.146:0/4130078989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf0c157490 0x7faf0c157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:16.986 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.985+0000 7faf118c5700 1 --2- 172.21.15.146:0/4130078989 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf0c161650 0x7faf0c0bb380 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:16.986 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.985+0000 7faf118c5700 1 --2- 172.21.15.146:0/4130078989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faef8004510 0x7faf0c0a4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:16.987 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.985+0000 7faf118c5700 1 -- 172.21.15.146:0/4130078989 >> 172.21.15.146:0/4130078989 conn(0x7faf0c0628a0 msgr2=0x7faf0c149620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:16.987 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.985+0000 7faf118c5700 1 -- 172.21.15.146:0/4130078989 shutdown_connections 2021-01-27T09:44:16.987 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:16.985+0000 7faf118c5700 1 -- 172.21.15.146:0/4130078989 wait complete. 2021-01-27T09:44:17.005 DEBUG:teuthology.misc:0 of 8 OSDs are up 2021-01-27T09:44:20.185 INFO:tasks.ceph.osd.5.smithi078.stderr:2021-01-27T09:44:20.183+0000 7f55f5a3d080 -1 osd.5 0 log_to_monitors {default=true} 2021-01-27T09:44:20.314 INFO:tasks.ceph.osd.6.smithi078.stderr:2021-01-27T09:44:20.315+0000 7ffa6c247080 -1 osd.6 0 log_to_monitors {default=true} 2021-01-27T09:44:20.345 INFO:tasks.ceph.osd.7.smithi078.stderr:2021-01-27T09:44:20.347+0000 7fda86357080 -1 osd.7 0 log_to_monitors {default=true} 2021-01-27T09:44:20.410 INFO:tasks.ceph.osd.4.smithi078.stderr:2021-01-27T09:44:20.411+0000 7f378da28080 -1 osd.4 0 log_to_monitors {default=true} 2021-01-27T09:44:20.505 INFO:tasks.ceph.osd.3.smithi146.stderr:2021-01-27T09:44:20.505+0000 7f04cb8a2080 -1 osd.3 0 log_to_monitors {default=true} 2021-01-27T09:44:20.614 INFO:tasks.ceph.osd.0.smithi146.stderr:2021-01-27T09:44:20.613+0000 7f0ff51a0080 -1 osd.0 0 log_to_monitors {default=true} 2021-01-27T09:44:20.666 INFO:tasks.ceph.osd.2.smithi146.stderr:2021-01-27T09:44:20.665+0000 7f8f26324080 -1 osd.2 0 log_to_monitors {default=true} 2021-01-27T09:44:20.686 INFO:tasks.ceph.osd.1.smithi146.stderr:2021-01-27T09:44:20.685+0000 7fd12e0d4080 -1 osd.1 0 log_to_monitors {default=true} 2021-01-27T09:44:21.463 INFO:tasks.ceph.osd.5.smithi078.stderr:2021-01-27T09:44:21.463+0000 7f55f11ea700 -1 osd.5 0 waiting for initial osdmap 2021-01-27T09:44:21.464 INFO:tasks.ceph.osd.6.smithi078.stderr:2021-01-27T09:44:21.463+0000 7ffa679f4700 -1 osd.6 0 waiting for initial osdmap 2021-01-27T09:44:21.466 INFO:tasks.ceph.osd.7.smithi078.stderr:2021-01-27T09:44:21.467+0000 7fda83318700 -1 osd.7 0 waiting for initial osdmap 2021-01-27T09:44:21.471 INFO:tasks.ceph.osd.4.smithi078.stderr:2021-01-27T09:44:21.467+0000 7f37891d5700 -1 osd.4 0 waiting for initial osdmap 2021-01-27T09:44:22.472 INFO:tasks.ceph.osd.2.smithi146.stderr:2021-01-27T09:44:22.473+0000 7f8f21ad1700 -1 osd.2 0 waiting for initial osdmap 2021-01-27T09:44:22.473 INFO:tasks.ceph.osd.0.smithi146.stderr:2021-01-27T09:44:22.473+0000 7f0ff094d700 -1 osd.0 0 waiting for initial osdmap 2021-01-27T09:44:22.473 INFO:tasks.ceph.osd.1.smithi146.stderr:2021-01-27T09:44:22.473+0000 7fd129881700 -1 osd.1 0 waiting for initial osdmap 2021-01-27T09:44:22.482 INFO:tasks.ceph.osd.3.smithi146.stderr:2021-01-27T09:44:22.481+0000 7f04c704f700 -1 osd.3 0 waiting for initial osdmap 2021-01-27T09:44:22.485 INFO:tasks.ceph.osd.2.smithi146.stderr:2021-01-27T09:44:22.485+0000 7f8f1e845700 -1 osd.2 14 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2021-01-27T09:44:22.487 INFO:tasks.ceph.osd.0.smithi146.stderr:2021-01-27T09:44:22.489+0000 7f0fed6c1700 -1 osd.0 14 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2021-01-27T09:44:22.488 INFO:tasks.ceph.osd.1.smithi146.stderr:2021-01-27T09:44:22.489+0000 7fd1265f5700 -1 osd.1 14 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2021-01-27T09:44:22.489 INFO:tasks.ceph.osd.3.smithi146.stderr:2021-01-27T09:44:22.489+0000 7f04c3dc3700 -1 osd.3 14 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2021-01-27T09:44:23.811 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-01-27T09:44:23.964 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.961+0000 7f6354709700 1 Processor -- start 2021-01-27T09:44:23.964 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.961+0000 7f6354709700 1 -- start start 2021-01-27T09:44:23.964 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.965+0000 7f6354709700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f634c0b9a40 0x7f634c0642b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:23.965 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.965+0000 7f6354709700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634c14c9f0 con 0x7f634c14c3a0 2021-01-27T09:44:23.966 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.965+0000 7f6354709700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634c063630 con 0x7f634c0b9e20 2021-01-27T09:44:23.966 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.965+0000 7f6354709700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0682d0 con 0x7f634c0b9a40 2021-01-27T09:44:23.966 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.965+0000 7f63524a5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f634c0b9a40 0x7f634c0642b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:23.966 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.965+0000 7f6352ca6700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f634c14c3a0 0x7f634c148b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:33580/0 (socket says 172.21.15.146:33580) 2021-01-27T09:44:23.967 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.965+0000 7f6352ca6700 1 -- 172.21.15.146:0/1355971658 learned_addr learned my addr 172.21.15.146:0/1355971658 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:23.967 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.965+0000 7f6351ca4700 1 --1- 172.21.15.146:0/1355971658 >> v1:172.21.15.146:6789/0 conn(0x7f634c0b9e20 0x7f634c14bc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45544/0 (socket says 172.21.15.146:45544) 2021-01-27T09:44:23.967 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.965+0000 7f63514a3700 1 -- 172.21.15.146:0/1355971658 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601120161 0 0) 0x7f634c14c9f0 con 0x7f634c14c3a0 2021-01-27T09:44:23.967 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.965+0000 7f63524a5700 1 -- 172.21.15.146:0/1355971658 >> v1:172.21.15.146:6789/0 conn(0x7f634c0b9e20 legacy=0x7f634c14bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:23.967 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.965+0000 7f63524a5700 1 -- 172.21.15.146:0/1355971658 >> v1:172.21.15.78:6789/0 conn(0x7f634c14c3a0 legacy=0x7f634c148b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:23.968 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.965+0000 7f63524a5700 1 -- 172.21.15.146:0/1355971658 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c0638d0 con 0x7f634c0b9a40 2021-01-27T09:44:23.969 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.965+0000 7f63524a5700 1 --2- 172.21.15.146:0/1355971658 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f634c0b9a40 0x7f634c0642b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f634800b9f0 tx=0x7f6348006e20).ready entity=mon.2 client_cookie=76e8bea5f8d7d033 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:23.969 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.965+0000 7f63514a3700 1 -- 172.21.15.146:0/1355971658 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63480097e0 con 0x7f634c0b9a40 2021-01-27T09:44:23.969 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.969+0000 7f63514a3700 1 -- 172.21.15.146:0/1355971658 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6348009940 con 0x7f634c0b9a40 2021-01-27T09:44:23.969 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.969+0000 7f63514a3700 1 -- 172.21.15.146:0/1355971658 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6348009cc0 con 0x7f634c0b9a40 2021-01-27T09:44:23.970 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.969+0000 7f6354709700 1 -- 172.21.15.146:0/1355971658 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f634c0b9a40 msgr2=0x7f634c0642b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:23.970 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.969+0000 7f6354709700 1 --2- 172.21.15.146:0/1355971658 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f634c0b9a40 0x7f634c0642b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f634800b9f0 tx=0x7f6348006e20).stop 2021-01-27T09:44:23.970 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.969+0000 7f6354709700 1 -- 172.21.15.146:0/1355971658 shutdown_connections 2021-01-27T09:44:23.970 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.969+0000 7f6354709700 1 --2- 172.21.15.146:0/1355971658 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f634c0b9a40 0x7f634c0642b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:23.971 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.969+0000 7f6354709700 1 -- 172.21.15.146:0/1355971658 >> 172.21.15.146:0/1355971658 conn(0x7f634c069be0 msgr2=0x7f634c061a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:23.971 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.969+0000 7f6354709700 1 -- 172.21.15.146:0/1355971658 shutdown_connections 2021-01-27T09:44:23.971 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.969+0000 7f6354709700 1 -- 172.21.15.146:0/1355971658 wait complete. 2021-01-27T09:44:23.972 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.973+0000 7f6354709700 1 Processor -- start 2021-01-27T09:44:23.972 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.973+0000 7f6354709700 1 -- start start 2021-01-27T09:44:23.974 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.973+0000 7f6354709700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f634c0b9a40 0x7f634c14bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:23.974 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.973+0000 7f6354709700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f634c0b9e20 0x7f634c15d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:23.974 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.973+0000 7f6354709700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f634c14c3a0 0x7f634c0bd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:23.975 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.973+0000 7f6354709700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c14e000 con 0x7f634c0b9e20 2021-01-27T09:44:23.975 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.973+0000 7f6354709700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c160a20 con 0x7f634c0b9a40 2021-01-27T09:44:23.975 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.973+0000 7f6354709700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c160cc0 con 0x7f634c14c3a0 2021-01-27T09:44:23.976 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.973+0000 7f63524a5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f634c0b9a40 0x7f634c14bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:23.977 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.973+0000 7f6352ca6700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f634c14c3a0 0x7f634c0bd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:23.977 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.973+0000 7f6352ca6700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f634c14c3a0 0x7f634c0bd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:35466/0 (socket says 172.21.15.146:35466) 2021-01-27T09:44:23.977 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.973+0000 7f6352ca6700 1 -- 172.21.15.146:0/2188742743 learned_addr learned my addr 172.21.15.146:0/2188742743 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:23.977 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.977+0000 7f6351ca4700 1 --2- 172.21.15.146:0/2188742743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f634c0b9e20 0x7f634c15d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:23.978 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.977+0000 7f6352ca6700 1 -- 172.21.15.146:0/2188742743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f634c0b9a40 msgr2=0x7f634c14bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:23.978 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.977+0000 7f6352ca6700 1 --2- 172.21.15.146:0/2188742743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f634c0b9a40 0x7f634c14bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:23.978 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.977+0000 7f6352ca6700 1 -- 172.21.15.146:0/2188742743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f634c0b9e20 msgr2=0x7f634c15d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:23.978 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.977+0000 7f6352ca6700 1 --2- 172.21.15.146:0/2188742743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f634c0b9e20 0x7f634c15d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:23.978 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.977+0000 7f6352ca6700 1 -- 172.21.15.146:0/2188742743 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c160f60 con 0x7f634c14c3a0 2021-01-27T09:44:23.979 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.977+0000 7f63524a5700 1 --2- 172.21.15.146:0/2188742743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f634c0b9a40 0x7f634c14bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:44:23.979 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.977+0000 7f6351ca4700 1 --2- 172.21.15.146:0/2188742743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f634c0b9e20 0x7f634c15d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:44:23.979 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.977+0000 7f6352ca6700 1 --2- 172.21.15.146:0/2188742743 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f634c14c3a0 0x7f634c0bd1b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f6344001560 tx=0x7f6344007e10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:23.979 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.977+0000 7f633a7fc700 1 -- 172.21.15.146:0/2188742743 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6344005bb0 con 0x7f634c14c3a0 2021-01-27T09:44:23.979 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.977+0000 7f633a7fc700 1 -- 172.21.15.146:0/2188742743 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6344005d10 con 0x7f634c14c3a0 2021-01-27T09:44:23.980 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.977+0000 7f633a7fc700 1 -- 172.21.15.146:0/2188742743 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6344007340 con 0x7f634c14c3a0 2021-01-27T09:44:23.980 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.977+0000 7f6354709700 1 -- 172.21.15.146:0/2188742743 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634c161200 con 0x7f634c14c3a0 2021-01-27T09:44:23.980 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.977+0000 7f6354709700 1 -- 172.21.15.146:0/2188742743 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634c14e2a0 con 0x7f634c14c3a0 2021-01-27T09:44:23.981 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.977+0000 7f6354709700 1 -- 172.21.15.146:0/2188742743 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634c060850 con 0x7f634c14c3a0 2021-01-27T09:44:23.981 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.981+0000 7f633a7fc700 1 -- 172.21.15.146:0/2188742743 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f6344010030 con 0x7f634c14c3a0 2021-01-27T09:44:23.981 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.981+0000 7f633a7fc700 1 --2- 172.21.15.146:0/2188742743 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f632c0561e0 0x7f632c0586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:23.981 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.981+0000 7f633a7fc700 1 -- 172.21.15.146:0/2188742743 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f634406ede0 con 0x7f634c14c3a0 2021-01-27T09:44:23.982 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.981+0000 7f63524a5700 1 --2- 172.21.15.146:0/2188742743 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f632c0561e0 0x7f632c0586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:23.982 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.981+0000 7f63524a5700 1 --2- 172.21.15.146:0/2188742743 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f632c0561e0 0x7f632c0586a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f634c15e4b0 tx=0x7f6348016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:23.992 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:23.993+0000 7f633a7fc700 1 -- 172.21.15.146:0/2188742743 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f6344044c10 con 0x7f634c14c3a0 2021-01-27T09:44:24.140 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:24.141+0000 7f6354709700 1 -- 172.21.15.146:0/2188742743 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f634c060cc0 con 0x7f634c14c3a0 2021-01-27T09:44:24.143 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:24.141+0000 7f633a7fc700 1 -- 172.21.15.146:0/2188742743 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12073 (secure 0 0 0) 0x7f6344048230 con 0x7f634c14c3a0 2021-01-27T09:44:24.143 INFO:teuthology.misc.health.smithi146.stdout: 2021-01-27T09:44:24.143 INFO:teuthology.misc.health.smithi146.stdout:{"epoch":15,"fsid":"968a1bec-aac5-444e-b70f-7770587be945","created":"2021-01-27T09:44:13.797940+0000","modified":"2021-01-27T09:44:23.479967+0000","last_up_change":"2021-01-27T09:44:23.479967+0000","last_in_change":"2021-01-27T09:44:23.479967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T09:44:18.497521+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"25441909-a40b-4d82-828d-326685513ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":14470},{"type":"v1","addr":"172.21.15.146:6801","nonce":14470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":14470},{"type":"v1","addr":"172.21.15.146:6803","nonce":14470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":14470},{"type":"v1","addr":"172.21.15.146:6810","nonce":14470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":14470},{"type":"v1","addr":"172.21.15.146:6807","nonce":14470}]},"public_addr":"172.21.15.146:6801/14470","cluster_addr":"172.21.15.146:6803/14470","heartbeat_back_addr":"172.21.15.146:6810/14470","heartbeat_front_addr":"172.21.15.146:6807/14470","state":["exists","up"]},{"osd":1,"uuid":"825bbc51-2ffe-4612-a300-00960e48be02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":14472},{"type":"v1","addr":"172.21.15.146:6817","nonce":14472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":14472},{"type":"v1","addr":"172.21.15.146:6819","nonce":14472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":14472},{"type":"v1","addr":"172.21.15.146:6827","nonce":14472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":14472},{"type":"v1","addr":"172.21.15.146:6823","nonce":14472}]},"public_addr":"172.21.15.146:6817/14472","cluster_addr":"172.21.15.146:6819/14472","heartbeat_back_addr":"172.21.15.146:6827/14472","heartbeat_front_addr":"172.21.15.146:6823/14472","state":["exists","up"]},{"osd":2,"uuid":"e568b97a-8e71-4ab9-bd64-056892110b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":14474},{"type":"v1","addr":"172.21.15.146:6822","nonce":14474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":14474},{"type":"v1","addr":"172.21.15.146:6826","nonce":14474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":14474},{"type":"v1","addr":"172.21.15.146:6831","nonce":14474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":14474},{"type":"v1","addr":"172.21.15.146:6829","nonce":14474}]},"public_addr":"172.21.15.146:6822/14474","cluster_addr":"172.21.15.146:6826/14474","heartbeat_back_addr":"172.21.15.146:6831/14474","heartbeat_front_addr":"172.21.15.146:6829/14474","state":["exists","up"]},{"osd":3,"uuid":"f5d50f63-f74a-4aea-a62d-51c38db4d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":14471},{"type":"v1","addr":"172.21.15.146:6806","nonce":14471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":14471},{"type":"v1","addr":"172.21.15.146:6811","nonce":14471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":14471},{"type":"v1","addr":"172.21.15.146:6815","nonce":14471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":14471},{"type":"v1","addr":"172.21.15.146:6813","nonce":14471}]},"public_addr":"172.21.15.146:6806/14471","cluster_addr":"172.21.15.146:6811/14471","heartbeat_back_addr":"172.21.15.146:6815/14471","heartbeat_front_addr":"172.21.15.146:6813/14471","state":["exists","up"]},{"osd":4,"uuid":"782458d7-6f52-48f4-9466-67b61ef27016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":15826},{"type":"v1","addr":"172.21.15.78:6817","nonce":15826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":15826},{"type":"v1","addr":"172.21.15.78:6819","nonce":15826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":15826},{"type":"v1","addr":"172.21.15.78:6823","nonce":15826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":15826},{"type":"v1","addr":"172.21.15.78:6821","nonce":15826}]},"public_addr":"172.21.15.78:6817/15826","cluster_addr":"172.21.15.78:6819/15826","heartbeat_back_addr":"172.21.15.78:6823/15826","heartbeat_front_addr":"172.21.15.78:6821/15826","state":["exists","up"]},{"osd":5,"uuid":"1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":15827},{"type":"v1","addr":"172.21.15.78:6801","nonce":15827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":15827},{"type":"v1","addr":"172.21.15.78:6803","nonce":15827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":15827},{"type":"v1","addr":"172.21.15.78:6807","nonce":15827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":15827},{"type":"v1","addr":"172.21.15.78:6805","nonce":15827}]},"public_addr":"172.21.15.78:6801/15827","cluster_addr":"172.21.15.78:6803/15827","heartbeat_back_addr":"172.21.15.78:6807/15827","heartbeat_front_addr":"172.21.15.78:6805/15827","state":["exists","up"]},{"osd":6,"uuid":"4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":15825},{"type":"v1","addr":"172.21.15.78:6809","nonce":15825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":15825},{"type":"v1","addr":"172.21.15.78:6811","nonce":15825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":15825},{"type":"v1","addr":"172.21.15.78:6815","nonce":15825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":15825},{"type":"v1","addr":"172.21.15.78:6813","nonce":15825}]},"public_addr":"172.21.15.78:6809/15825","cluster_addr":"172.21.15.78:6811/15825","heartbeat_back_addr":"172.21.15.78:6815/15825","heartbeat_front_addr":"172.21.15.78:6813/15825","state":["exists","up"]},{"osd":7,"uuid":"851aeaf3-bcdc-4ac6-b578-c42e1bf87c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":15828},{"type":"v1","addr":"172.21.15.78:6825","nonce":15828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":15828},{"type":"v1","addr":"172.21.15.78:6827","nonce":15828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":15828},{"type":"v1","addr":"172.21.15.78:6831","nonce":15828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":15828},{"type":"v1","addr":"172.21.15.78:6829","nonce":15828}]},"public_addr":"172.21.15.78:6825/15828","cluster_addr":"172.21.15.78:6827/15828","heartbeat_back_addr":"172.21.15.78:6831/15828","heartbeat_front_addr":"172.21.15.78:6829/15828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.374444+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.171108+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.360910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.356020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:44:24.145 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:24.145+0000 7f6354709700 1 -- 172.21.15.146:0/2188742743 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f632c0561e0 msgr2=0x7f632c0586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:24.145 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:24.145+0000 7f6354709700 1 --2- 172.21.15.146:0/2188742743 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f632c0561e0 0x7f632c0586a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f634c15e4b0 tx=0x7f6348016000).stop 2021-01-27T09:44:24.145 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:24.145+0000 7f6354709700 1 -- 172.21.15.146:0/2188742743 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f634c14c3a0 msgr2=0x7f634c0bd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:24.145 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:24.145+0000 7f6354709700 1 --2- 172.21.15.146:0/2188742743 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f634c14c3a0 0x7f634c0bd1b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f6344001560 tx=0x7f6344007e10).stop 2021-01-27T09:44:24.146 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:24.145+0000 7f6354709700 1 -- 172.21.15.146:0/2188742743 shutdown_connections 2021-01-27T09:44:24.146 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:24.145+0000 7f6354709700 1 --2- 172.21.15.146:0/2188742743 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f634c14c3a0 0x7f634c0bd1b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:24.146 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:24.145+0000 7f6354709700 1 --2- 172.21.15.146:0/2188742743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f634c0b9e20 0x7f634c15d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:24.146 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:24.145+0000 7f6354709700 1 --2- 172.21.15.146:0/2188742743 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f632c0561e0 0x7f632c0586a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:24.147 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:24.145+0000 7f6354709700 1 --2- 172.21.15.146:0/2188742743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f634c0b9a40 0x7f634c14bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:24.147 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:24.145+0000 7f6354709700 1 -- 172.21.15.146:0/2188742743 >> 172.21.15.146:0/2188742743 conn(0x7f634c069be0 msgr2=0x7f634c0b6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:24.147 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:24.145+0000 7f6354709700 1 -- 172.21.15.146:0/2188742743 shutdown_connections 2021-01-27T09:44:24.147 INFO:teuthology.misc.health.smithi146.stderr:2021-01-27T09:44:24.145+0000 7f6354709700 1 -- 172.21.15.146:0/2188742743 wait complete. 2021-01-27T09:44:24.165 DEBUG:teuthology.misc:8 of 8 OSDs are up 2021-01-27T09:44:24.165 INFO:tasks.ceph:Creating RBD pool 2021-01-27T09:44:24.166 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd pool create rbd 8 2021-01-27T09:44:24.321 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.321+0000 7f74aa3e3700 1 Processor -- start 2021-01-27T09:44:24.321 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.321+0000 7f74aa3e3700 1 -- start start 2021-01-27T09:44:24.322 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.321+0000 7f74aa3e3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f74a4069a00 0x7f74a414c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:24.322 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.321+0000 7f74aa3e3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a40bc120 con 0x7f74a414c700 2021-01-27T09:44:24.323 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.321+0000 7f74aa3e3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a40bc3c0 con 0x7f74a414be30 2021-01-27T09:44:24.323 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.321+0000 7f74aa3e3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a414cb70 con 0x7f74a4069a00 2021-01-27T09:44:24.324 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.325+0000 7f74a9be2700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f74a414c700 0x7f74a41459b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:33608/0 (socket says 172.21.15.146:33608) 2021-01-27T09:44:24.324 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.325+0000 7f74a9be2700 1 -- 172.21.15.146:0/1926149779 learned_addr learned my addr 172.21.15.146:0/1926149779 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:24.324 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.325+0000 7f74a8be0700 1 --2- 172.21.15.146:0/1926149779 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f74a4069a00 0x7f74a414c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:24.326 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.325+0000 7f749bfff700 1 -- 172.21.15.146:0/1926149779 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273858123 0 0) 0x7f74a40bc120 con 0x7f74a414c700 2021-01-27T09:44:24.326 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.325+0000 7f749bfff700 1 -- 172.21.15.146:0/1926149779 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7488003270 con 0x7f74a414c700 2021-01-27T09:44:24.327 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.325+0000 7f74a8be0700 1 -- 172.21.15.146:0/1926149779 >> v1:172.21.15.146:6789/0 conn(0x7f74a414be30 legacy=0x7f74a40b98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:24.327 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.325+0000 7f749bfff700 1 -- 172.21.15.146:0/1926149779 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3678257290 0 0) 0x7f7488003270 con 0x7f74a414c700 2021-01-27T09:44:24.328 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.329+0000 7f74a8be0700 1 -- 172.21.15.146:0/1926149779 >> v1:172.21.15.78:6789/0 conn(0x7f74a414c700 legacy=0x7f74a41459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:24.328 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.329+0000 7f74a8be0700 1 -- 172.21.15.146:0/1926149779 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a40bc660 con 0x7f74a4069a00 2021-01-27T09:44:24.329 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.329+0000 7f74a8be0700 1 --2- 172.21.15.146:0/1926149779 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f74a4069a00 0x7f74a414c210 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f749400b9f0 tx=0x7f7494006e20).ready entity=mon.2 client_cookie=8af1a8985322de00 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:24.329 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.329+0000 7f749bfff700 1 -- 172.21.15.146:0/1926149779 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c0018a0 con 0x7f74a4069a00 2021-01-27T09:44:24.329 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.329+0000 7f749bfff700 1 -- 172.21.15.146:0/1926149779 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7494009560 con 0x7f74a4069a00 2021-01-27T09:44:24.329 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.329+0000 7f749bfff700 1 -- 172.21.15.146:0/1926149779 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749400bee0 con 0x7f74a4069a00 2021-01-27T09:44:24.330 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.329+0000 7f74aa3e3700 1 -- 172.21.15.146:0/1926149779 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f74a4069a00 msgr2=0x7f74a414c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:24.330 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.329+0000 7f74aa3e3700 1 --2- 172.21.15.146:0/1926149779 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f74a4069a00 0x7f74a414c210 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f749400b9f0 tx=0x7f7494006e20).stop 2021-01-27T09:44:24.331 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.329+0000 7f74aa3e3700 1 -- 172.21.15.146:0/1926149779 shutdown_connections 2021-01-27T09:44:24.331 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.329+0000 7f74aa3e3700 1 --2- 172.21.15.146:0/1926149779 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f74a4069a00 0x7f74a414c210 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:24.331 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.329+0000 7f74aa3e3700 1 -- 172.21.15.146:0/1926149779 >> 172.21.15.146:0/1926149779 conn(0x7f74a4064240 msgr2=0x7f74a4069110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:24.332 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.333+0000 7f74aa3e3700 1 -- 172.21.15.146:0/1926149779 shutdown_connections 2021-01-27T09:44:24.332 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.333+0000 7f74aa3e3700 1 -- 172.21.15.146:0/1926149779 wait complete. 2021-01-27T09:44:24.334 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.333+0000 7f74aa3e3700 1 Processor -- start 2021-01-27T09:44:24.335 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74aa3e3700 1 -- start start 2021-01-27T09:44:24.336 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74aa3e3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f74a4069a00 0x7f74a4146950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:24.336 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74aa3e3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74a414be30 0x7f74a414df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:24.336 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74aa3e3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a414c700 0x7f74a414e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:24.336 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74aa3e3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a4146fe0 con 0x7f74a414c700 2021-01-27T09:44:24.336 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74aa3e3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40bde80 con 0x7f74a414be30 2021-01-27T09:44:24.337 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74aa3e3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40be120 con 0x7f74a4069a00 2021-01-27T09:44:24.338 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74a8be0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74a414be30 0x7f74a414df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:24.338 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74a93e1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f74a4069a00 0x7f74a4146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:24.339 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74a93e1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f74a4069a00 0x7f74a4146950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:35492/0 (socket says 172.21.15.146:35492) 2021-01-27T09:44:24.339 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74a93e1700 1 -- 172.21.15.146:0/1672272445 learned_addr learned my addr 172.21.15.146:0/1672272445 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:24.339 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74a9be2700 1 --2- 172.21.15.146:0/1672272445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a414c700 0x7f74a414e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:24.339 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74a93e1700 1 -- 172.21.15.146:0/1672272445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74a414be30 msgr2=0x7f74a414df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:24.339 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74a93e1700 1 --2- 172.21.15.146:0/1672272445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74a414be30 0x7f74a414df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:24.340 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74a93e1700 1 -- 172.21.15.146:0/1672272445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a414c700 msgr2=0x7f74a414e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:24.340 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74a93e1700 1 --2- 172.21.15.146:0/1672272445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a414c700 0x7f74a414e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:24.340 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74a93e1700 1 -- 172.21.15.146:0/1672272445 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a40be3c0 con 0x7f74a4069a00 2021-01-27T09:44:24.340 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74a8be0700 1 --2- 172.21.15.146:0/1672272445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74a414be30 0x7f74a414df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:24.341 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74a93e1700 1 --2- 172.21.15.146:0/1672272445 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f74a4069a00 0x7f74a4146950 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f74a000c710 tx=0x7f74a0007c40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:24.341 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74997fa700 1 -- 172.21.15.146:0/1672272445 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a000e4a0 con 0x7f74a4069a00 2021-01-27T09:44:24.341 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74997fa700 1 -- 172.21.15.146:0/1672272445 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a000e600 con 0x7f74a4069a00 2021-01-27T09:44:24.341 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74aa3e3700 1 -- 172.21.15.146:0/1672272445 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a40be660 con 0x7f74a4069a00 2021-01-27T09:44:24.342 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74997fa700 1 -- 172.21.15.146:0/1672272445 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a000e9a0 con 0x7f74a4069a00 2021-01-27T09:44:24.342 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.337+0000 7f74aa3e3700 1 -- 172.21.15.146:0/1672272445 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a40bce60 con 0x7f74a4069a00 2021-01-27T09:44:24.343 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.341+0000 7f74aa3e3700 1 -- 172.21.15.146:0/1672272445 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a405c520 con 0x7f74a4069a00 2021-01-27T09:44:24.343 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.341+0000 7f74997fa700 1 -- 172.21.15.146:0/1672272445 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f74a0010030 con 0x7f74a4069a00 2021-01-27T09:44:24.343 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.341+0000 7f74997fa700 1 --2- 172.21.15.146:0/1672272445 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f74840561e0 0x7f74840586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:24.343 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.341+0000 7f74997fa700 1 -- 172.21.15.146:0/1672272445 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f74a006eb30 con 0x7f74a4069a00 2021-01-27T09:44:24.344 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.341+0000 7f74a8be0700 1 --2- 172.21.15.146:0/1672272445 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f74840561e0 0x7f74840586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:24.344 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.341+0000 7f74a8be0700 1 --2- 172.21.15.146:0/1672272445 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f74840561e0 0x7f74840586a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f749400b940 tx=0x7f7494016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:24.348 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.349+0000 7f74997fa700 1 -- 172.21.15.146:0/1672272445 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f74a0044960 con 0x7f74a4069a00 2021-01-27T09:44:24.495 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.493+0000 7f74aa3e3700 1 -- 172.21.15.146:0/1672272445 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f74a40629b0 con 0x7f74a4069a00 2021-01-27T09:44:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.557+0000 7f74997fa700 1 -- 172.21.15.146:0/1672272445 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7f74a0047f80 con 0x7f74a4069a00 2021-01-27T09:44:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.561+0000 7f74aa3e3700 1 -- 172.21.15.146:0/1672272445 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f74840561e0 msgr2=0x7f74840586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.561+0000 7f74aa3e3700 1 --2- 172.21.15.146:0/1672272445 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f74840561e0 0x7f74840586a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f749400b940 tx=0x7f7494016000).stop 2021-01-27T09:44:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.561+0000 7f74aa3e3700 1 -- 172.21.15.146:0/1672272445 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f74a4069a00 msgr2=0x7f74a4146950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.561+0000 7f74aa3e3700 1 --2- 172.21.15.146:0/1672272445 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f74a4069a00 0x7f74a4146950 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f74a000c710 tx=0x7f74a0007c40).stop 2021-01-27T09:44:24.563 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.565+0000 7f74aa3e3700 1 -- 172.21.15.146:0/1672272445 shutdown_connections 2021-01-27T09:44:24.563 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.565+0000 7f74aa3e3700 1 --2- 172.21.15.146:0/1672272445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a414c700 0x7f74a414e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:24.563 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.565+0000 7f74aa3e3700 1 --2- 172.21.15.146:0/1672272445 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f74840561e0 0x7f74840586a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:24.563 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.565+0000 7f74aa3e3700 1 --2- 172.21.15.146:0/1672272445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74a414be30 0x7f74a414df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:24.563 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.565+0000 7f74aa3e3700 1 --2- 172.21.15.146:0/1672272445 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f74a4069a00 0x7f74a4146950 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:24.564 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.565+0000 7f74aa3e3700 1 -- 172.21.15.146:0/1672272445 >> 172.21.15.146:0/1672272445 conn(0x7f74a4064240 msgr2=0x7f74a41428d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:24.564 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.565+0000 7f74aa3e3700 1 -- 172.21.15.146:0/1672272445 shutdown_connections 2021-01-27T09:44:24.564 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.565+0000 7f74aa3e3700 1 -- 172.21.15.146:0/1672272445 wait complete. 2021-01-27T09:44:24.568 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'rbd' created 2021-01-27T09:44:24.586 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2021-01-27T09:44:24.740 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.741+0000 7fcdd595b700 1 Processor -- start 2021-01-27T09:44:24.741 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.741+0000 7fcdd595b700 1 -- start start 2021-01-27T09:44:24.743 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.745+0000 7fcdd595b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcdd014f360 0x7fcdd0069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:24.744 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.745+0000 7fcdd595b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcdd0065d00 0x7fcdd014f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:24.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.745+0000 7fcdd595b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd00bc780 con 0x7fcdd00bc040 2021-01-27T09:44:24.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.745+0000 7fcdd595b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd00bb5a0 con 0x7fcdd0065d00 2021-01-27T09:44:24.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.745+0000 7fcdd595b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd0155840 con 0x7fcdd014f360 2021-01-27T09:44:24.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.745+0000 7fcdcffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcdd00bc040 0x7fcdd0061300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45612/0 (socket says 172.21.15.146:45612) 2021-01-27T09:44:24.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.745+0000 7fcdcffff700 1 -- 172.21.15.146:0/3719805895 learned_addr learned my addr 172.21.15.146:0/3719805895 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:24.746 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.745+0000 7fcdce7fc700 1 --2- 172.21.15.146:0/3719805895 >> v2:172.21.15.146:3300/0 conn(0x7fcdd0065d00 0x7fcdd014f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:24.746 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.745+0000 7fcdceffd700 1 --2- 172.21.15.146:0/3719805895 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcdd014f360 0x7fcdd0069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:24.746 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.745+0000 7fcdcdffb700 1 -- 172.21.15.146:0/3719805895 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009265043 0 0) 0x7fcdd00bc780 con 0x7fcdd00bc040 2021-01-27T09:44:24.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.745+0000 7fcdcdffb700 1 -- 172.21.15.146:0/3719805895 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdbc003270 con 0x7fcdd00bc040 2021-01-27T09:44:24.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.745+0000 7fcdce7fc700 1 -- 172.21.15.146:0/3719805895 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcdd014f360 msgr2=0x7fcdd0069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:24.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.745+0000 7fcdce7fc700 1 --2- 172.21.15.146:0/3719805895 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcdd014f360 0x7fcdd0069fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:24.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.745+0000 7fcdce7fc700 1 -- 172.21.15.146:0/3719805895 >> v1:172.21.15.146:6789/0 conn(0x7fcdd00bc040 legacy=0x7fcdd0061300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:24.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.745+0000 7fcdce7fc700 1 -- 172.21.15.146:0/3719805895 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd0155ae0 con 0x7fcdd0065d00 2021-01-27T09:44:24.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.745+0000 7fcdce7fc700 1 --2- 172.21.15.146:0/3719805895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdd0065d00 0x7fcdd014f740 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fcdc400b9c0 tx=0x7fcdc4006e20).ready entity=mon.1 client_cookie=1a69c26e41111c30 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:24.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.745+0000 7fcdcdffb700 1 -- 172.21.15.146:0/3719805895 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4009690 con 0x7fcdd0065d00 2021-01-27T09:44:24.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.745+0000 7fcdcdffb700 1 -- 172.21.15.146:0/3719805895 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc40097f0 con 0x7fcdd0065d00 2021-01-27T09:44:24.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.745+0000 7fcdcdffb700 1 -- 172.21.15.146:0/3719805895 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4009b70 con 0x7fcdd0065d00 2021-01-27T09:44:24.750 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.749+0000 7fcdd595b700 1 -- 172.21.15.146:0/3719805895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdd0065d00 msgr2=0x7fcdd014f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:24.750 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.749+0000 7fcdd595b700 1 --2- 172.21.15.146:0/3719805895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdd0065d00 0x7fcdd014f740 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fcdc400b9c0 tx=0x7fcdc4006e20).stop 2021-01-27T09:44:24.750 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.749+0000 7fcdd595b700 1 -- 172.21.15.146:0/3719805895 shutdown_connections 2021-01-27T09:44:24.750 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.749+0000 7fcdd595b700 1 --2- 172.21.15.146:0/3719805895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdd0065d00 0x7fcdd014f740 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:24.750 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.749+0000 7fcdd595b700 1 --2- 172.21.15.146:0/3719805895 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcdd014f360 0x7fcdd0069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:24.751 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.749+0000 7fcdd595b700 1 -- 172.21.15.146:0/3719805895 >> 172.21.15.146:0/3719805895 conn(0x7fcdd0063330 msgr2=0x7fcdd0063740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:24.751 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.749+0000 7fcdd595b700 1 -- 172.21.15.146:0/3719805895 shutdown_connections 2021-01-27T09:44:24.751 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.749+0000 7fcdd595b700 1 -- 172.21.15.146:0/3719805895 wait complete. 2021-01-27T09:44:24.753 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.749+0000 7fcdd595b700 1 Processor -- start 2021-01-27T09:44:24.753 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.749+0000 7fcdd595b700 1 -- start start 2021-01-27T09:44:24.754 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.749+0000 7fcdd595b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdd00bc040 0x7fcdd0156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:24.754 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.749+0000 7fcdd595b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdd014f360 0x7fcdd0149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:24.754 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.749+0000 7fcdd595b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcdd01447e0 0x7fcdd0144c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:24.754 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.749+0000 7fcdd595b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd0145180 con 0x7fcdd014f360 2021-01-27T09:44:24.755 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.749+0000 7fcdd595b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd0164b90 con 0x7fcdd00bc040 2021-01-27T09:44:24.755 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.749+0000 7fcdd595b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd0164e30 con 0x7fcdd01447e0 2021-01-27T09:44:24.755 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.753+0000 7fcdceffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdd00bc040 0x7fcdd0156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:24.756 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.753+0000 7fcdcffff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcdd01447e0 0x7fcdd0144c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:24.756 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.753+0000 7fcdceffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdd00bc040 0x7fcdd0156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46042/0 (socket says 172.21.15.146:46042) 2021-01-27T09:44:24.756 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.753+0000 7fcdceffd700 1 -- 172.21.15.146:0/511972384 learned_addr learned my addr 172.21.15.146:0/511972384 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:24.756 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.753+0000 7fcdce7fc700 1 --2- 172.21.15.146:0/511972384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdd014f360 0x7fcdd0149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:24.757 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.753+0000 7fcdceffd700 1 -- 172.21.15.146:0/511972384 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcdd01447e0 msgr2=0x7fcdd0144c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:24.757 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.753+0000 7fcdceffd700 1 --2- 172.21.15.146:0/511972384 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcdd01447e0 0x7fcdd0144c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:24.757 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.753+0000 7fcdceffd700 1 -- 172.21.15.146:0/511972384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdd014f360 msgr2=0x7fcdd0149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:24.757 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.753+0000 7fcdceffd700 1 --2- 172.21.15.146:0/511972384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdd014f360 0x7fcdd0149fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:24.757 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.753+0000 7fcdceffd700 1 -- 172.21.15.146:0/511972384 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd01650d0 con 0x7fcdd00bc040 2021-01-27T09:44:24.758 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.753+0000 7fcdceffd700 1 --2- 172.21.15.146:0/511972384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdd00bc040 0x7fcdd0156680 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fcdc000ec00 tx=0x7fcdc0006e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:24.758 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.753+0000 7fcdb6ffd700 1 -- 172.21.15.146:0/511972384 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc000c8e0 con 0x7fcdd00bc040 2021-01-27T09:44:24.758 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.753+0000 7fcdb6ffd700 1 -- 172.21.15.146:0/511972384 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc000ca40 con 0x7fcdd00bc040 2021-01-27T09:44:24.758 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.753+0000 7fcdd595b700 1 -- 172.21.15.146:0/511972384 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd0165370 con 0x7fcdd00bc040 2021-01-27T09:44:24.758 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.753+0000 7fcdb6ffd700 1 -- 172.21.15.146:0/511972384 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc000cdc0 con 0x7fcdd00bc040 2021-01-27T09:44:24.759 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.753+0000 7fcdd595b700 1 -- 172.21.15.146:0/511972384 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd0161280 con 0x7fcdd00bc040 2021-01-27T09:44:24.759 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.753+0000 7fcdd595b700 1 -- 172.21.15.146:0/511972384 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd0044ee0 con 0x7fcdd00bc040 2021-01-27T09:44:24.760 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.757+0000 7fcdb6ffd700 1 -- 172.21.15.146:0/511972384 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fcdc0012600 con 0x7fcdd00bc040 2021-01-27T09:44:24.760 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.757+0000 7fcdb6ffd700 1 --2- 172.21.15.146:0/511972384 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcdb00561e0 0x7fcdb00586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:24.760 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.757+0000 7fcdb6ffd700 1 -- 172.21.15.146:0/511972384 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5242+0+0 (secure 0 0 0) 0x7fcdc006f2d0 con 0x7fcdd00bc040 2021-01-27T09:44:24.760 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.757+0000 7fcdce7fc700 1 --2- 172.21.15.146:0/511972384 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcdb00561e0 0x7fcdb00586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:24.761 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.757+0000 7fcdce7fc700 1 --2- 172.21.15.146:0/511972384 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcdb00561e0 0x7fcdb00586a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fcdd0066100 tx=0x7fcdc4016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:24.762 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.761+0000 7fcdb6ffd700 1 -- 172.21.15.146:0/511972384 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fcdc0044e40 con 0x7fcdd00bc040 2021-01-27T09:44:24.909 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:24.909+0000 7fcdd595b700 1 -- 172.21.15.146:0/511972384 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcdd0156b70 con 0x7fcdd00bc040 2021-01-27T09:44:25.720 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.720+0000 7fcdb6ffd700 1 -- 172.21.15.146:0/511972384 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7fcdc0048460 con 0x7fcdd00bc040 2021-01-27T09:44:25.726 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.724+0000 7fcdd595b700 1 -- 172.21.15.146:0/511972384 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcdb00561e0 msgr2=0x7fcdb00586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:25.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.724+0000 7fcdd595b700 1 --2- 172.21.15.146:0/511972384 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcdb00561e0 0x7fcdb00586a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fcdd0066100 tx=0x7fcdc4016000).stop 2021-01-27T09:44:25.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.724+0000 7fcdd595b700 1 -- 172.21.15.146:0/511972384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdd00bc040 msgr2=0x7fcdd0156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:25.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.724+0000 7fcdd595b700 1 --2- 172.21.15.146:0/511972384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdd00bc040 0x7fcdd0156680 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fcdc000ec00 tx=0x7fcdc0006e20).stop 2021-01-27T09:44:25.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.724+0000 7fcdd595b700 1 -- 172.21.15.146:0/511972384 shutdown_connections 2021-01-27T09:44:25.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.724+0000 7fcdd595b700 1 --2- 172.21.15.146:0/511972384 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcdd01447e0 0x7fcdd0144c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:25.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.724+0000 7fcdd595b700 1 --2- 172.21.15.146:0/511972384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcdd014f360 0x7fcdd0149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:25.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.724+0000 7fcdd595b700 1 --2- 172.21.15.146:0/511972384 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcdb00561e0 0x7fcdb00586a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:25.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.724+0000 7fcdd595b700 1 --2- 172.21.15.146:0/511972384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdd00bc040 0x7fcdd0156680 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:25.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.724+0000 7fcdd595b700 1 -- 172.21.15.146:0/511972384 >> 172.21.15.146:0/511972384 conn(0x7fcdd0063330 msgr2=0x7fcdd0061300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:25.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.724+0000 7fcdd595b700 1 -- 172.21.15.146:0/511972384 shutdown_connections 2021-01-27T09:44:25.729 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.724+0000 7fcdd595b700 1 -- 172.21.15.146:0/511972384 wait complete. 2021-01-27T09:44:25.729 INFO:teuthology.orchestra.run.smithi146.stderr:enabled application 'rbd' on pool 'rbd' 2021-01-27T09:44:25.752 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2021-01-27T09:44:25.752 INFO:tasks.ceph.mds.a:Restarting daemon 2021-01-27T09:44:25.753 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-01-27T09:44:25.759 INFO:tasks.ceph.mds.a:Started 2021-01-27T09:44:25.759 INFO:tasks.ceph.mds.c:Restarting daemon 2021-01-27T09:44:25.760 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-01-27T09:44:25.765 INFO:tasks.ceph.mds.c:Started 2021-01-27T09:44:25.766 INFO:tasks.ceph.mds.e:Restarting daemon 2021-01-27T09:44:25.766 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2021-01-27T09:44:25.769 INFO:tasks.ceph.mds.e:Started 2021-01-27T09:44:25.770 INFO:tasks.ceph.mds.b:Restarting daemon 2021-01-27T09:44:25.770 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-01-27T09:44:25.772 INFO:tasks.ceph.mds.b:Started 2021-01-27T09:44:25.773 INFO:tasks.ceph.mds.d:Restarting daemon 2021-01-27T09:44:25.773 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2021-01-27T09:44:25.775 INFO:tasks.ceph.mds.d:Started 2021-01-27T09:44:25.775 INFO:tasks.ceph.mds.f:Restarting daemon 2021-01-27T09:44:25.776 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2021-01-27T09:44:25.777 INFO:tasks.ceph.mds.f:Started 2021-01-27T09:44:25.778 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2021-01-27T09:44:25.779 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-01-27T09:44:25.845 INFO:tasks.ceph.mds.f.smithi078.stdout:starting mds.f at 2021-01-27T09:44:25.854 INFO:tasks.ceph.mds.b.smithi078.stdout:starting mds.b at 2021-01-27T09:44:25.857 INFO:tasks.ceph.mds.d.smithi078.stdout:starting mds.d at 2021-01-27T09:44:25.872 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2021-01-27T09:44:25.873 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2021-01-27T09:44:25.875 INFO:tasks.ceph.mds.e.smithi146.stdout:starting mds.e at 2021-01-27T09:44:25.934 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.932+0000 7fef6a892700 1 Processor -- start 2021-01-27T09:44:25.935 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.932+0000 7fef6a892700 1 -- start start 2021-01-27T09:44:25.936 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.936+0000 7fef6a892700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fef640bec70 0x7fef64067ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:25.937 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.936+0000 7fef6a892700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef640ba2a0 con 0x7fef640bf050 2021-01-27T09:44:25.937 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.936+0000 7fef6a892700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef640ba540 con 0x7fef640b7620 2021-01-27T09:44:25.937 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.936+0000 7fef6a892700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef640ba7e0 con 0x7fef640bec70 2021-01-27T09:44:25.938 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.936+0000 7fef6908f700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fef640bf050 0x7fef640baab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:33692/0 (socket says 172.21.15.146:33692) 2021-01-27T09:44:25.938 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.936+0000 7fef6908f700 1 -- 172.21.15.146:0/3972676856 learned_addr learned my addr 172.21.15.146:0/3972676856 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:25.938 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.936+0000 7fef69890700 1 --2- 172.21.15.146:0/3972676856 >> v2:172.21.15.146:3300/0 conn(0x7fef640bec70 0x7fef64067ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:25.939 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.936+0000 7fef6888e700 1 -- 172.21.15.146:0/3972676856 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785095417 0 0) 0x7fef640ba2a0 con 0x7fef640bf050 2021-01-27T09:44:25.939 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.936+0000 7fef6888e700 1 -- 172.21.15.146:0/3972676856 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef4c003270 con 0x7fef640bf050 2021-01-27T09:44:25.940 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.936+0000 7fef6888e700 1 -- 172.21.15.146:0/3972676856 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1045587422 0 0) 0x7fef640ba540 con 0x7fef640b7620 2021-01-27T09:44:25.940 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.936+0000 7fef6888e700 1 -- 172.21.15.146:0/3972676856 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef640ba2a0 con 0x7fef640b7620 2021-01-27T09:44:25.940 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.936+0000 7fef69890700 1 -- 172.21.15.146:0/3972676856 >> v1:172.21.15.146:6789/0 conn(0x7fef640b7620 legacy=0x7fef6414bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:25.940 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.936+0000 7fef69890700 1 -- 172.21.15.146:0/3972676856 >> v1:172.21.15.78:6789/0 conn(0x7fef640bf050 legacy=0x7fef640baab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:25.941 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.936+0000 7fef69890700 1 -- 172.21.15.146:0/3972676856 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef64067500 con 0x7fef640bec70 2021-01-27T09:44:25.941 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.940+0000 7fef69890700 1 --2- 172.21.15.146:0/3972676856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef640bec70 0x7fef64067ee0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fef6000b9c0 tx=0x7fef60006e20).ready entity=mon.1 client_cookie=b52776708f069507 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:25.942 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.940+0000 7fef6888e700 1 -- 172.21.15.146:0/3972676856 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60009690 con 0x7fef640bec70 2021-01-27T09:44:25.942 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.940+0000 7fef6888e700 1 -- 172.21.15.146:0/3972676856 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef600097f0 con 0x7fef640bec70 2021-01-27T09:44:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.940+0000 7fef6888e700 1 -- 172.21.15.146:0/3972676856 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60009b70 con 0x7fef640bec70 2021-01-27T09:44:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.940+0000 7fef6a892700 1 -- 172.21.15.146:0/3972676856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef640bec70 msgr2=0x7fef64067ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.940+0000 7fef6a892700 1 --2- 172.21.15.146:0/3972676856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef640bec70 0x7fef64067ee0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fef6000b9c0 tx=0x7fef60006e20).stop 2021-01-27T09:44:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.940+0000 7fef6a892700 1 -- 172.21.15.146:0/3972676856 shutdown_connections 2021-01-27T09:44:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.940+0000 7fef6a892700 1 --2- 172.21.15.146:0/3972676856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef640bec70 0x7fef64067ee0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.940+0000 7fef6a892700 1 -- 172.21.15.146:0/3972676856 >> 172.21.15.146:0/3972676856 conn(0x7fef64064240 msgr2=0x7fef64064620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.940+0000 7fef6a892700 1 -- 172.21.15.146:0/3972676856 shutdown_connections 2021-01-27T09:44:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.940+0000 7fef6a892700 1 -- 172.21.15.146:0/3972676856 wait complete. 2021-01-27T09:44:25.945 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.944+0000 7fef6a892700 1 Processor -- start 2021-01-27T09:44:25.945 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.944+0000 7fef6a892700 1 -- start start 2021-01-27T09:44:25.946 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.944+0000 7fef6a892700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef640b7620 0x7fef64157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:25.947 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.944+0000 7fef6a892700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef640bec70 0x7fef64155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:25.947 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.944+0000 7fef6a892700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fef640bf050 0x7fef64155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:25.947 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.944+0000 7fef6a892700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef64155b20 con 0x7fef640b7620 2021-01-27T09:44:25.947 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.944+0000 7fef6a892700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef64166060 con 0x7fef640bec70 2021-01-27T09:44:25.948 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.944+0000 7fef6a892700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef64060b30 con 0x7fef640bf050 2021-01-27T09:44:25.948 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.944+0000 7fef6908f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef640bec70 0x7fef64155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:25.948 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.944+0000 7fef69890700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef640b7620 0x7fef64157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:25.948 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.944+0000 7fef6908f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef640bec70 0x7fef64155140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46094/0 (socket says 172.21.15.146:46094) 2021-01-27T09:44:25.948 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.944+0000 7fef6908f700 1 -- 172.21.15.146:0/3195059788 learned_addr learned my addr 172.21.15.146:0/3195059788 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:25.949 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.944+0000 7fef6a091700 1 --2- 172.21.15.146:0/3195059788 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fef640bf050 0x7fef64155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:25.950 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.944+0000 7fef6908f700 1 -- 172.21.15.146:0/3195059788 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fef640bf050 msgr2=0x7fef64155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:25.950 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.944+0000 7fef6908f700 1 --2- 172.21.15.146:0/3195059788 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fef640bf050 0x7fef64155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:25.950 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.944+0000 7fef6908f700 1 -- 172.21.15.146:0/3195059788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef640b7620 msgr2=0x7fef64157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:25.950 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.944+0000 7fef6908f700 1 --2- 172.21.15.146:0/3195059788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef640b7620 0x7fef64157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:25.951 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.948+0000 7fef6908f700 1 -- 172.21.15.146:0/3195059788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef64060dd0 con 0x7fef640bec70 2021-01-27T09:44:25.951 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.948+0000 7fef6908f700 1 --2- 172.21.15.146:0/3195059788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef640bec70 0x7fef64155140 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fef5400c710 tx=0x7fef54007b20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:25.951 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.948+0000 7fef51ffb700 1 -- 172.21.15.146:0/3195059788 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef540072e0 con 0x7fef640bec70 2021-01-27T09:44:25.951 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.948+0000 7fef51ffb700 1 -- 172.21.15.146:0/3195059788 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef54007440 con 0x7fef640bec70 2021-01-27T09:44:25.952 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.948+0000 7fef6a892700 1 -- 172.21.15.146:0/3195059788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef64061070 con 0x7fef640bec70 2021-01-27T09:44:25.952 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.948+0000 7fef51ffb700 1 -- 172.21.15.146:0/3195059788 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54005880 con 0x7fef640bec70 2021-01-27T09:44:25.952 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.948+0000 7fef6a892700 1 -- 172.21.15.146:0/3195059788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef64150120 con 0x7fef640bec70 2021-01-27T09:44:25.952 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.948+0000 7fef6a892700 1 -- 172.21.15.146:0/3195059788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef64063d60 con 0x7fef640bec70 2021-01-27T09:44:25.953 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.952+0000 7fef51ffb700 1 -- 172.21.15.146:0/3195059788 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fef54010070 con 0x7fef640bec70 2021-01-27T09:44:25.953 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.952+0000 7fef51ffb700 1 --2- 172.21.15.146:0/3195059788 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fef440561e0 0x7fef440586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:25.953 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.952+0000 7fef51ffb700 1 -- 172.21.15.146:0/3195059788 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fef5406e630 con 0x7fef640bec70 2021-01-27T09:44:25.954 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.952+0000 7fef69890700 1 --2- 172.21.15.146:0/3195059788 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fef440561e0 0x7fef440586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:25.954 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.952+0000 7fef69890700 1 --2- 172.21.15.146:0/3195059788 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fef440561e0 0x7fef440586a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fef6000b150 tx=0x7fef60016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:25.959 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:25.960+0000 7fef51ffb700 1 -- 172.21.15.146:0/3195059788 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fef540441f0 con 0x7fef640bec70 2021-01-27T09:44:26.097 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.096+0000 7fef6a892700 1 -- 172.21.15.146:0/3195059788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef64044680 con 0x7fef640bec70 2021-01-27T09:44:26.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.100+0000 7fef51ffb700 1 -- 172.21.15.146:0/3195059788 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13685 (secure 0 0 0) 0x7fef54007c60 con 0x7fef640bec70 2021-01-27T09:44:26.100 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:44:26.100 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":17,"fsid":"968a1bec-aac5-444e-b70f-7770587be945","created":"2021-01-27T09:44:13.797940+0000","modified":"2021-01-27T09:44:25.553614+0000","last_up_change":"2021-01-27T09:44:23.479967+0000","last_in_change":"2021-01-27T09:44:23.479967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T09:44:18.497521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-27T09:44:24.550303+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"25441909-a40b-4d82-828d-326685513ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":14470},{"type":"v1","addr":"172.21.15.146:6801","nonce":14470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":14470},{"type":"v1","addr":"172.21.15.146:6803","nonce":14470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":14470},{"type":"v1","addr":"172.21.15.146:6810","nonce":14470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":14470},{"type":"v1","addr":"172.21.15.146:6807","nonce":14470}]},"public_addr":"172.21.15.146:6801/14470","cluster_addr":"172.21.15.146:6803/14470","heartbeat_back_addr":"172.21.15.146:6810/14470","heartbeat_front_addr":"172.21.15.146:6807/14470","state":["exists","up"]},{"osd":1,"uuid":"825bbc51-2ffe-4612-a300-00960e48be02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":14472},{"type":"v1","addr":"172.21.15.146:6817","nonce":14472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":14472},{"type":"v1","addr":"172.21.15.146:6819","nonce":14472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":14472},{"type":"v1","addr":"172.21.15.146:6827","nonce":14472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":14472},{"type":"v1","addr":"172.21.15.146:6823","nonce":14472}]},"public_addr":"172.21.15.146:6817/14472","cluster_addr":"172.21.15.146:6819/14472","heartbeat_back_addr":"172.21.15.146:6827/14472","heartbeat_front_addr":"172.21.15.146:6823/14472","state":["exists","up"]},{"osd":2,"uuid":"e568b97a-8e71-4ab9-bd64-056892110b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":14474},{"type":"v1","addr":"172.21.15.146:6822","nonce":14474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":14474},{"type":"v1","addr":"172.21.15.146:6826","nonce":14474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":14474},{"type":"v1","addr":"172.21.15.146:6831","nonce":14474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":14474},{"type":"v1","addr":"172.21.15.146:6829","nonce":14474}]},"public_addr":"172.21.15.146:6822/14474","cluster_addr":"172.21.15.146:6826/14474","heartbeat_back_addr":"172.21.15.146:6831/14474","heartbeat_front_addr":"172.21.15.146:6829/14474","state":["exists","up"]},{"osd":3,"uuid":"f5d50f63-f74a-4aea-a62d-51c38db4d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":14471},{"type":"v1","addr":"172.21.15.146:6806","nonce":14471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":14471},{"type":"v1","addr":"172.21.15.146:6811","nonce":14471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":14471},{"type":"v1","addr":"172.21.15.146:6815","nonce":14471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":14471},{"type":"v1","addr":"172.21.15.146:6813","nonce":14471}]},"public_addr":"172.21.15.146:6806/14471","cluster_addr":"172.21.15.146:6811/14471","heartbeat_back_addr":"172.21.15.146:6815/14471","heartbeat_front_addr":"172.21.15.146:6813/14471","state":["exists","up"]},{"osd":4,"uuid":"782458d7-6f52-48f4-9466-67b61ef27016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":15826},{"type":"v1","addr":"172.21.15.78:6817","nonce":15826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":15826},{"type":"v1","addr":"172.21.15.78:6819","nonce":15826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":15826},{"type":"v1","addr":"172.21.15.78:6823","nonce":15826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":15826},{"type":"v1","addr":"172.21.15.78:6821","nonce":15826}]},"public_addr":"172.21.15.78:6817/15826","cluster_addr":"172.21.15.78:6819/15826","heartbeat_back_addr":"172.21.15.78:6823/15826","heartbeat_front_addr":"172.21.15.78:6821/15826","state":["exists","up"]},{"osd":5,"uuid":"1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":15827},{"type":"v1","addr":"172.21.15.78:6801","nonce":15827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":15827},{"type":"v1","addr":"172.21.15.78:6803","nonce":15827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":15827},{"type":"v1","addr":"172.21.15.78:6807","nonce":15827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":15827},{"type":"v1","addr":"172.21.15.78:6805","nonce":15827}]},"public_addr":"172.21.15.78:6801/15827","cluster_addr":"172.21.15.78:6803/15827","heartbeat_back_addr":"172.21.15.78:6807/15827","heartbeat_front_addr":"172.21.15.78:6805/15827","state":["exists","up"]},{"osd":6,"uuid":"4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":15825},{"type":"v1","addr":"172.21.15.78:6809","nonce":15825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":15825},{"type":"v1","addr":"172.21.15.78:6811","nonce":15825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":15825},{"type":"v1","addr":"172.21.15.78:6815","nonce":15825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":15825},{"type":"v1","addr":"172.21.15.78:6813","nonce":15825}]},"public_addr":"172.21.15.78:6809/15825","cluster_addr":"172.21.15.78:6811/15825","heartbeat_back_addr":"172.21.15.78:6815/15825","heartbeat_front_addr":"172.21.15.78:6813/15825","state":["exists","up"]},{"osd":7,"uuid":"851aeaf3-bcdc-4ac6-b578-c42e1bf87c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":15828},{"type":"v1","addr":"172.21.15.78:6825","nonce":15828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":15828},{"type":"v1","addr":"172.21.15.78:6827","nonce":15828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":15828},{"type":"v1","addr":"172.21.15.78:6831","nonce":15828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":15828},{"type":"v1","addr":"172.21.15.78:6829","nonce":15828}]},"public_addr":"172.21.15.78:6825/15828","cluster_addr":"172.21.15.78:6827/15828","heartbeat_back_addr":"172.21.15.78:6831/15828","heartbeat_front_addr":"172.21.15.78:6829/15828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.573930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.718144+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.641838+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.551598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.374444+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.171108+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.360910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.356020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:44:26.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.100+0000 7fef6a892700 1 -- 172.21.15.146:0/3195059788 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fef440561e0 msgr2=0x7fef440586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:26.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.100+0000 7fef6a892700 1 --2- 172.21.15.146:0/3195059788 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fef440561e0 0x7fef440586a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fef6000b150 tx=0x7fef60016000).stop 2021-01-27T09:44:26.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.100+0000 7fef6a892700 1 -- 172.21.15.146:0/3195059788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef640bec70 msgr2=0x7fef64155140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:26.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.100+0000 7fef6a892700 1 --2- 172.21.15.146:0/3195059788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef640bec70 0x7fef64155140 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fef5400c710 tx=0x7fef54007b20).stop 2021-01-27T09:44:26.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.100+0000 7fef6a892700 1 -- 172.21.15.146:0/3195059788 shutdown_connections 2021-01-27T09:44:26.104 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.100+0000 7fef6a892700 1 --2- 172.21.15.146:0/3195059788 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fef640bf050 0x7fef64155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:26.104 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.100+0000 7fef6a892700 1 --2- 172.21.15.146:0/3195059788 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fef440561e0 0x7fef440586a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:26.104 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.100+0000 7fef6a892700 1 --2- 172.21.15.146:0/3195059788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef640bec70 0x7fef64155140 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:26.104 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.100+0000 7fef6a892700 1 --2- 172.21.15.146:0/3195059788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef640b7620 0x7fef64157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:26.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.100+0000 7fef6a892700 1 -- 172.21.15.146:0/3195059788 >> 172.21.15.146:0/3195059788 conn(0x7fef64064240 msgr2=0x7fef64149ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:26.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.104+0000 7fef6a892700 1 -- 172.21.15.146:0/3195059788 shutdown_connections 2021-01-27T09:44:26.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.104+0000 7fef6a892700 1 -- 172.21.15.146:0/3195059788 wait complete. 2021-01-27T09:44:26.126 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-27T09:44:18.497521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-27T09:44:24.550303+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-01-27T09:44:26.127 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-01-27T09:44:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.292+0000 7f0b5a6b0700 1 Processor -- start 2021-01-27T09:44:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.292+0000 7f0b5a6b0700 1 -- start start 2021-01-27T09:44:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.292+0000 7f0b5a6b0700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b54147f10 0x7f0b54060f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.292+0000 7f0b5a6b0700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b54151c40 con 0x7f0b5414e830 2021-01-27T09:44:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.292+0000 7f0b5a6b0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b54151ee0 con 0x7f0b54064240 2021-01-27T09:44:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.292+0000 7f0b5a6b0700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b541482f0 con 0x7f0b54147f10 2021-01-27T09:44:26.298 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.292+0000 7f0b537fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0b54064240 0x7f0b541513b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45672/0 (socket says 172.21.15.146:45672) 2021-01-27T09:44:26.298 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.292+0000 7f0b537fe700 1 -- 172.21.15.146:0/1234670323 learned_addr learned my addr 172.21.15.146:0/1234670323 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:26.299 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.292+0000 7f0b53fff700 1 --2- 172.21.15.146:0/1234670323 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b54147f10 0x7f0b54060f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:26.299 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b52ffd700 1 -- 172.21.15.146:0/1234670323 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210757605 0 0) 0x7f0b54151ee0 con 0x7f0b54064240 2021-01-27T09:44:26.299 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b52ffd700 1 -- 172.21.15.146:0/1234670323 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b40003270 con 0x7f0b54064240 2021-01-27T09:44:26.299 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b52ffd700 1 -- 172.21.15.146:0/1234670323 <== mon.1 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3640006283 0 0) 0x7f0b40003270 con 0x7f0b54064240 2021-01-27T09:44:26.300 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b52ffd700 1 -- 172.21.15.146:0/1234670323 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b54147f10 msgr2=0x7f0b54060f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:26.300 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b52ffd700 1 --2- 172.21.15.146:0/1234670323 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b54147f10 0x7f0b54060f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:26.300 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b52ffd700 1 -- 172.21.15.146:0/1234670323 >> v1:172.21.15.78:6789/0 conn(0x7f0b5414e830 legacy=0x7f0b540bbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:26.300 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b52ffd700 1 -- 172.21.15.146:0/1234670323 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b54152180 con 0x7f0b54064240 2021-01-27T09:44:26.301 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b52ffd700 1 -- 172.21.15.146:0/1234670323 <== mon.1 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3890990827 0 0) 0x7f0b48001570 con 0x7f0b54064240 2021-01-27T09:44:26.301 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b52ffd700 1 -- 172.21.15.146:0/1234670323 >> v1:172.21.15.146:6789/0 conn(0x7f0b54064240 legacy=0x7f0b541513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:26.301 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b52ffd700 1 --2- 172.21.15.146:0/1234670323 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b54147f10 0x7f0b40003760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:26.301 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b52ffd700 1 --2- 172.21.15.146:0/1234670323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b40003cc0 0x7f0b40004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:26.301 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b52ffd700 1 --2- 172.21.15.146:0/1234670323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b40004a00 0x7f0b40004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:26.302 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b52ffd700 1 -- 172.21.15.146:0/1234670323 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b541482f0 con 0x7f0b40003cc0 2021-01-27T09:44:26.302 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b52ffd700 1 -- 172.21.15.146:0/1234670323 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b40004250 con 0x7f0b40004a00 2021-01-27T09:44:26.302 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b52ffd700 1 -- 172.21.15.146:0/1234670323 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4000b760 con 0x7f0b54147f10 2021-01-27T09:44:26.302 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b537fe700 1 --2- 172.21.15.146:0/1234670323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b40003cc0 0x7f0b40004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:26.303 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b53fff700 1 --2- 172.21.15.146:0/1234670323 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b54147f10 0x7f0b40003760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:26.303 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b58c4d700 1 --2- 172.21.15.146:0/1234670323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b40004a00 0x7f0b40004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:26.303 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b537fe700 1 -- 172.21.15.146:0/1234670323 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b54147f10 msgr2=0x7f0b40003760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:26.303 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b537fe700 1 --2- 172.21.15.146:0/1234670323 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b54147f10 0x7f0b40003760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:26.303 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b537fe700 1 -- 172.21.15.146:0/1234670323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b40004a00 msgr2=0x7f0b40004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:26.304 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b537fe700 1 --2- 172.21.15.146:0/1234670323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b40004a00 0x7f0b40004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:26.304 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b537fe700 1 -- 172.21.15.146:0/1234670323 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b40003270 con 0x7f0b40003cc0 2021-01-27T09:44:26.304 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b53fff700 1 --2- 172.21.15.146:0/1234670323 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b54147f10 0x7f0b40003760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:26.304 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b537fe700 1 --2- 172.21.15.146:0/1234670323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b40003cc0 0x7f0b40004510 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f0b4800c410 tx=0x7f0b540bea90).ready entity=mon.0 client_cookie=e52d3dc4e5b32583 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:26.305 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b52ffd700 1 -- 172.21.15.146:0/1234670323 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b480070d0 con 0x7f0b40003cc0 2021-01-27T09:44:26.305 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b52ffd700 1 -- 172.21.15.146:0/1234670323 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b48007230 con 0x7f0b40003cc0 2021-01-27T09:44:26.305 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b52ffd700 1 -- 172.21.15.146:0/1234670323 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b48005620 con 0x7f0b40003cc0 2021-01-27T09:44:26.308 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b5a6b0700 1 -- 172.21.15.146:0/1234670323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b40003cc0 msgr2=0x7f0b40004510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:26.308 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.296+0000 7f0b5a6b0700 1 --2- 172.21.15.146:0/1234670323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b40003cc0 0x7f0b40004510 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f0b4800c410 tx=0x7f0b540bea90).stop 2021-01-27T09:44:26.308 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.300+0000 7f0b58c4d700 1 -- 172.21.15.146:0/1234670323 reap_dead start 2021-01-27T09:44:26.308 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.300+0000 7f0b5a6b0700 1 -- 172.21.15.146:0/1234670323 shutdown_connections 2021-01-27T09:44:26.309 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.300+0000 7f0b5a6b0700 1 -- 172.21.15.146:0/1234670323 >> 172.21.15.146:0/1234670323 conn(0x7f0b54067230 msgr2=0x7f0b54069110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:26.309 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.300+0000 7f0b5a6b0700 1 -- 172.21.15.146:0/1234670323 shutdown_connections 2021-01-27T09:44:26.309 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.300+0000 7f0b5a6b0700 1 -- 172.21.15.146:0/1234670323 wait complete. 2021-01-27T09:44:26.310 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.300+0000 7f0b5a6b0700 1 Processor -- start 2021-01-27T09:44:26.310 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.300+0000 7f0b5a6b0700 1 -- start start 2021-01-27T09:44:26.310 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.304+0000 7f0b5a6b0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b40003cc0 0x7f0b540b8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:26.310 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.304+0000 7f0b5a6b0700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b540b81c0 0x7f0b541441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:26.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.304+0000 7f0b5a6b0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b5414f560 0x7f0b5414f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:26.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.304+0000 7f0b5a6b0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5414aa30 con 0x7f0b40003cc0 2021-01-27T09:44:26.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.304+0000 7f0b5a6b0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5414a290 con 0x7f0b5414f560 2021-01-27T09:44:26.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.304+0000 7f0b5a6b0700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b54151310 con 0x7f0b540b81c0 2021-01-27T09:44:26.312 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.304+0000 7f0b53fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b40003cc0 0x7f0b540b8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:26.312 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.304+0000 7f0b58c4d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b5414f560 0x7f0b5414f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:26.312 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.304+0000 7f0b53fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b40003cc0 0x7f0b540b8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:48986/0 (socket says 172.21.15.146:48986) 2021-01-27T09:44:26.312 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.304+0000 7f0b53fff700 1 -- 172.21.15.146:0/986673011 learned_addr learned my addr 172.21.15.146:0/986673011 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:26.312 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.304+0000 7f0b537fe700 1 --2- 172.21.15.146:0/986673011 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b540b81c0 0x7f0b541441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:26.313 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.304+0000 7f0b58c4d700 1 -- 172.21.15.146:0/986673011 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b540b81c0 msgr2=0x7f0b541441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:26.313 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.304+0000 7f0b58c4d700 1 --2- 172.21.15.146:0/986673011 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b540b81c0 0x7f0b541441e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:26.313 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.304+0000 7f0b58c4d700 1 -- 172.21.15.146:0/986673011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b40003cc0 msgr2=0x7f0b540b8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:26.313 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.304+0000 7f0b58c4d700 1 --2- 172.21.15.146:0/986673011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b40003cc0 0x7f0b540b8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:26.313 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.304+0000 7f0b58c4d700 1 -- 172.21.15.146:0/986673011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b54151070 con 0x7f0b5414f560 2021-01-27T09:44:26.314 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.304+0000 7f0b58c4d700 1 --2- 172.21.15.146:0/986673011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b5414f560 0x7f0b5414f9b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f0b540671e0 tx=0x7f0b4c007f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:26.314 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.304+0000 7f0b3bfff700 1 -- 172.21.15.146:0/986673011 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c006ab0 con 0x7f0b5414f560 2021-01-27T09:44:26.314 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.304+0000 7f0b3bfff700 1 -- 172.21.15.146:0/986673011 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c006c10 con 0x7f0b5414f560 2021-01-27T09:44:26.314 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.304+0000 7f0b5a6b0700 1 -- 172.21.15.146:0/986673011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5414a4f0 con 0x7f0b5414f560 2021-01-27T09:44:26.315 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.304+0000 7f0b3bfff700 1 -- 172.21.15.146:0/986673011 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c007030 con 0x7f0b5414f560 2021-01-27T09:44:26.315 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.304+0000 7f0b5a6b0700 1 -- 172.21.15.146:0/986673011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5414fea0 con 0x7f0b5414f560 2021-01-27T09:44:26.315 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.304+0000 7f0b5a6b0700 1 -- 172.21.15.146:0/986673011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b54044ee0 con 0x7f0b5414f560 2021-01-27T09:44:26.315 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.308+0000 7f0b3bfff700 1 -- 172.21.15.146:0/986673011 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f0b4c01c060 con 0x7f0b5414f560 2021-01-27T09:44:26.316 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.308+0000 7f0b3bfff700 1 --2- 172.21.15.146:0/986673011 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0b34056210 0x7f0b340586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:26.316 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.308+0000 7f0b3bfff700 1 -- 172.21.15.146:0/986673011 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f0b4c06e8b0 con 0x7f0b5414f560 2021-01-27T09:44:26.317 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.308+0000 7f0b53fff700 1 --2- 172.21.15.146:0/986673011 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0b34056210 0x7f0b340586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:26.317 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.308+0000 7f0b53fff700 1 --2- 172.21.15.146:0/986673011 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0b34056210 0x7f0b340586d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f0b44006ac0 tx=0x7f0b44018040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:26.317 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.312+0000 7f0b3bfff700 1 -- 172.21.15.146:0/986673011 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f0b4c044470 con 0x7f0b5414f560 2021-01-27T09:44:26.460 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.460+0000 7f0b5a6b0700 1 -- 172.21.15.146:0/986673011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0b540bb760 con 0x7f0b5414f560 2021-01-27T09:44:26.460 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.460+0000 7f0b3bfff700 1 -- 172.21.15.146:0/986673011 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0b4c01a070 con 0x7f0b5414f560 2021-01-27T09:44:26.461 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2021-01-27T09:44:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.460+0000 7f0b5a6b0700 1 -- 172.21.15.146:0/986673011 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0b34056210 msgr2=0x7f0b340586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.460+0000 7f0b5a6b0700 1 --2- 172.21.15.146:0/986673011 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0b34056210 0x7f0b340586d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f0b44006ac0 tx=0x7f0b44018040).stop 2021-01-27T09:44:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.460+0000 7f0b5a6b0700 1 -- 172.21.15.146:0/986673011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b5414f560 msgr2=0x7f0b5414f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.460+0000 7f0b5a6b0700 1 --2- 172.21.15.146:0/986673011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b5414f560 0x7f0b5414f9b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f0b540671e0 tx=0x7f0b4c007f40).stop 2021-01-27T09:44:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.460+0000 7f0b5a6b0700 1 -- 172.21.15.146:0/986673011 shutdown_connections 2021-01-27T09:44:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.460+0000 7f0b5a6b0700 1 --2- 172.21.15.146:0/986673011 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0b34056210 0x7f0b340586d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.460+0000 7f0b5a6b0700 1 --2- 172.21.15.146:0/986673011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b5414f560 0x7f0b5414f9b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.460+0000 7f0b5a6b0700 1 --2- 172.21.15.146:0/986673011 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b540b81c0 0x7f0b541441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.460+0000 7f0b5a6b0700 1 --2- 172.21.15.146:0/986673011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b40003cc0 0x7f0b540b8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.460+0000 7f0b5a6b0700 1 -- 172.21.15.146:0/986673011 >> 172.21.15.146:0/986673011 conn(0x7f0b54067230 msgr2=0x7f0b541475c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:26.466 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.464+0000 7f0b5a6b0700 1 -- 172.21.15.146:0/986673011 shutdown_connections 2021-01-27T09:44:26.466 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.464+0000 7f0b5a6b0700 1 -- 172.21.15.146:0/986673011 wait complete. 2021-01-27T09:44:26.490 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-01-27T09:44:26.660 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.660+0000 7f4601cd6700 1 Processor -- start 2021-01-27T09:44:26.661 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.660+0000 7f4601cd6700 1 -- start start 2021-01-27T09:44:26.662 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.660+0000 7f4601cd6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f45fc065260 0x7f45fc0bf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:26.663 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.660+0000 7f4601cd6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f45fc0bbb20 0x7f45fc0bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:26.663 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.660+0000 7f4601cd6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45fc0bf5c0 con 0x7f45fc065640 2021-01-27T09:44:26.663 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.660+0000 7f4601cd6700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45fc063830 con 0x7f45fc065260 2021-01-27T09:44:26.663 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.660+0000 7f4601cd6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45fc0bfda0 con 0x7f45fc0bbb20 2021-01-27T09:44:26.664 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.660+0000 7f45fb7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f45fc065260 0x7f45fc0bf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:26.664 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.660+0000 7f45fbfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f45fc0bbb20 0x7f45fc0bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:26.665 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.660+0000 7f45fb7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f45fc065260 0x7f45fc0bf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:48996/0 (socket says 172.21.15.146:48996) 2021-01-27T09:44:26.665 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.660+0000 7f45fb7fe700 1 -- 172.21.15.146:0/1791712638 learned_addr learned my addr 172.21.15.146:0/1791712638 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:26.665 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.660+0000 7f45faffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f45fc065640 0x7f45fc151d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45698/0 (socket says 172.21.15.146:45698) 2021-01-27T09:44:26.665 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.664+0000 7f45fb7fe700 1 -- 172.21.15.146:0/1791712638 >> v2:172.21.15.146:3300/0 conn(0x7f45fc0bbb20 msgr2=0x7f45fc0bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:26.666 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.664+0000 7f45fb7fe700 1 --2- 172.21.15.146:0/1791712638 >> v2:172.21.15.146:3300/0 conn(0x7f45fc0bbb20 0x7f45fc0bbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:26.666 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.664+0000 7f45fb7fe700 1 -- 172.21.15.146:0/1791712638 >> v1:172.21.15.146:6789/0 conn(0x7f45fc065640 legacy=0x7f45fc151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:26.666 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.664+0000 7f45fb7fe700 1 -- 172.21.15.146:0/1791712638 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc0bf860 con 0x7f45fc065260 2021-01-27T09:44:26.667 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.664+0000 7f45fa7fc700 1 -- 172.21.15.146:0/1791712638 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042336609 0 0) 0x7f45fc0bf5c0 con 0x7f45fc065640 2021-01-27T09:44:26.671 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.664+0000 7f45fb7fe700 1 --2- 172.21.15.146:0/1791712638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45fc065260 0x7f45fc0bf010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f45fc06a530 tx=0x7f45ec006ee0).ready entity=mon.0 client_cookie=7937e2f6234d8357 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:26.671 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.664+0000 7f45fa7fc700 1 -- 172.21.15.146:0/1791712638 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec009800 con 0x7f45fc065260 2021-01-27T09:44:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.664+0000 7f45fa7fc700 1 -- 172.21.15.146:0/1791712638 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec009960 con 0x7f45fc065260 2021-01-27T09:44:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.664+0000 7f45fa7fc700 1 -- 172.21.15.146:0/1791712638 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec009ce0 con 0x7f45fc065260 2021-01-27T09:44:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.664+0000 7f4601cd6700 1 -- 172.21.15.146:0/1791712638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45fc065260 msgr2=0x7f45fc0bf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.664+0000 7f4601cd6700 1 --2- 172.21.15.146:0/1791712638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45fc065260 0x7f45fc0bf010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f45fc06a530 tx=0x7f45ec006ee0).stop 2021-01-27T09:44:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.664+0000 7f4601cd6700 1 -- 172.21.15.146:0/1791712638 shutdown_connections 2021-01-27T09:44:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.664+0000 7f4601cd6700 1 --2- 172.21.15.146:0/1791712638 >> v2:172.21.15.146:3300/0 conn(0x7f45fc0bbb20 0x7f45fc0bbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.664+0000 7f4601cd6700 1 --2- 172.21.15.146:0/1791712638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45fc065260 0x7f45fc0bf010 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.664+0000 7f4601cd6700 1 -- 172.21.15.146:0/1791712638 >> 172.21.15.146:0/1791712638 conn(0x7f45fc069110 msgr2=0x7f45fc067e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:26.674 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.664+0000 7f4601cd6700 1 -- 172.21.15.146:0/1791712638 shutdown_connections 2021-01-27T09:44:26.674 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.664+0000 7f4601cd6700 1 -- 172.21.15.146:0/1791712638 wait complete. 2021-01-27T09:44:26.674 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.668+0000 7f4601cd6700 1 Processor -- start 2021-01-27T09:44:26.674 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.668+0000 7f4601cd6700 1 -- start start 2021-01-27T09:44:26.675 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.668+0000 7f4601cd6700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45fc065260 0x7f45fc0b2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:26.675 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.668+0000 7f4601cd6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45fc065640 0x7f45fc148d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:26.675 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.668+0000 7f4601cd6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45fc0bbb20 0x7f45fc149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:26.675 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.668+0000 7f4601cd6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0b8240 con 0x7f45fc0bbb20 2021-01-27T09:44:26.675 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.668+0000 7f4601cd6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc15e1e0 con 0x7f45fc065640 2021-01-27T09:44:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.668+0000 7f4601cd6700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc15e480 con 0x7f45fc065260 2021-01-27T09:44:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.668+0000 7f45fbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45fc0bbb20 0x7f45fc149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.668+0000 7f45fbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45fc0bbb20 0x7f45fc149230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:49002/0 (socket says 172.21.15.146:49002) 2021-01-27T09:44:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.668+0000 7f45fbfff700 1 -- 172.21.15.146:0/3828583459 learned_addr learned my addr 172.21.15.146:0/3828583459 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:26.677 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.668+0000 7f45fb7fe700 1 --2- 172.21.15.146:0/3828583459 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45fc065260 0x7f45fc0b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:26.677 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.668+0000 7f45faffd700 1 --2- 172.21.15.146:0/3828583459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45fc065640 0x7f45fc148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:26.677 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.668+0000 7f45fbfff700 1 -- 172.21.15.146:0/3828583459 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45fc065260 msgr2=0x7f45fc0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:26.677 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.668+0000 7f45fbfff700 1 --2- 172.21.15.146:0/3828583459 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45fc065260 0x7f45fc0b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:26.677 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.668+0000 7f45fbfff700 1 -- 172.21.15.146:0/3828583459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45fc065640 msgr2=0x7f45fc148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.668+0000 7f45fbfff700 1 --2- 172.21.15.146:0/3828583459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45fc065640 0x7f45fc148d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.668+0000 7f45fbfff700 1 -- 172.21.15.146:0/3828583459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc0b8480 con 0x7f45fc0bbb20 2021-01-27T09:44:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.672+0000 7f45fbfff700 1 --2- 172.21.15.146:0/3828583459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45fc0bbb20 0x7f45fc149230 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f45f400ed20 tx=0x7f45f4009220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.672+0000 7f45e37fe700 1 -- 172.21.15.146:0/3828583459 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f400ee80 con 0x7f45fc0bbb20 2021-01-27T09:44:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.672+0000 7f45e37fe700 1 -- 172.21.15.146:0/3828583459 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f400cad0 con 0x7f45fc0bbb20 2021-01-27T09:44:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.672+0000 7f4601cd6700 1 -- 172.21.15.146:0/3828583459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45fc0b8720 con 0x7f45fc0bbb20 2021-01-27T09:44:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.672+0000 7f45e37fe700 1 -- 172.21.15.146:0/3828583459 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f400ce70 con 0x7f45fc0bbb20 2021-01-27T09:44:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.672+0000 7f4601cd6700 1 -- 172.21.15.146:0/3828583459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45fc0b89c0 con 0x7f45fc0bbb20 2021-01-27T09:44:26.681 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.672+0000 7f4601cd6700 1 -- 172.21.15.146:0/3828583459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45fc044ee0 con 0x7f45fc0bbb20 2021-01-27T09:44:26.681 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.672+0000 7f45e37fe700 1 -- 172.21.15.146:0/3828583459 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f45f4022070 con 0x7f45fc0bbb20 2021-01-27T09:44:26.681 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.676+0000 7f45e37fe700 1 --2- 172.21.15.146:0/3828583459 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f45dc0561b0 0x7f45dc058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:26.681 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.676+0000 7f45e37fe700 1 -- 172.21.15.146:0/3828583459 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f45f406f800 con 0x7f45fc0bbb20 2021-01-27T09:44:26.681 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.676+0000 7f45fb7fe700 1 --2- 172.21.15.146:0/3828583459 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f45dc0561b0 0x7f45dc058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:26.682 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.676+0000 7f45fb7fe700 1 --2- 172.21.15.146:0/3828583459 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f45dc0561b0 0x7f45dc058670 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f45ec006f20 tx=0x7f45ec016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:26.687 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.684+0000 7f45e37fe700 1 -- 172.21.15.146:0/3828583459 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f45f4045440 con 0x7f45fc0bbb20 2021-01-27T09:44:26.831 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.832+0000 7f4601cd6700 1 -- 172.21.15.146:0/3828583459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f45fc05c6b0 con 0x7f45fc0bbb20 2021-01-27T09:44:26.833 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.832+0000 7f45e37fe700 1 -- 172.21.15.146:0/3828583459 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f45fc05c6b0 con 0x7f45fc0bbb20 2021-01-27T09:44:26.833 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:44:26.835 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.832+0000 7f4601cd6700 1 -- 172.21.15.146:0/3828583459 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f45dc0561b0 msgr2=0x7f45dc058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:26.835 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.832+0000 7f4601cd6700 1 --2- 172.21.15.146:0/3828583459 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f45dc0561b0 0x7f45dc058670 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f45ec006f20 tx=0x7f45ec016000).stop 2021-01-27T09:44:26.836 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.832+0000 7f4601cd6700 1 -- 172.21.15.146:0/3828583459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45fc0bbb20 msgr2=0x7f45fc149230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:26.836 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.832+0000 7f4601cd6700 1 --2- 172.21.15.146:0/3828583459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45fc0bbb20 0x7f45fc149230 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f45f400ed20 tx=0x7f45f4009220).stop 2021-01-27T09:44:26.836 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.832+0000 7f4601cd6700 1 -- 172.21.15.146:0/3828583459 shutdown_connections 2021-01-27T09:44:26.836 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.832+0000 7f4601cd6700 1 --2- 172.21.15.146:0/3828583459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45fc0bbb20 0x7f45fc149230 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:26.837 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.832+0000 7f4601cd6700 1 --2- 172.21.15.146:0/3828583459 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f45dc0561b0 0x7f45dc058670 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:26.837 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.832+0000 7f4601cd6700 1 --2- 172.21.15.146:0/3828583459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45fc065640 0x7f45fc148d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:26.837 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.832+0000 7f4601cd6700 1 --2- 172.21.15.146:0/3828583459 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45fc065260 0x7f45fc0b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:26.837 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.832+0000 7f4601cd6700 1 -- 172.21.15.146:0/3828583459 >> 172.21.15.146:0/3828583459 conn(0x7f45fc069110 msgr2=0x7f45fc0be640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:26.838 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.836+0000 7f4601cd6700 1 -- 172.21.15.146:0/3828583459 shutdown_connections 2021-01-27T09:44:26.838 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:26.836+0000 7f4601cd6700 1 -- 172.21.15.146:0/3828583459 wait complete. 2021-01-27T09:44:26.864 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-01-27T09:44:27.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.016+0000 7f06e54dc700 1 Processor -- start 2021-01-27T09:44:27.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.016+0000 7f06e54dc700 1 -- start start 2021-01-27T09:44:27.019 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.016+0000 7f06e54dc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f06e00bf050 0x7f06e00bf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:27.019 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.016+0000 7f06e54dc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06e014dc70 0x7f06e0151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:27.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.016+0000 7f06e54dc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f06e00c4d60 0x7f06e00c1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:27.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.016+0000 7f06e54dc700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e00c4b50 con 0x7f06e00c4d60 2021-01-27T09:44:27.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.016+0000 7f06e54dc700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e0065e10 con 0x7f06e00bf050 2021-01-27T09:44:27.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.016+0000 7f06e54dc700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e0066580 con 0x7f06e014dc70 2021-01-27T09:44:27.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06dffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f06e00bf050 0x7f06e00bf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:27.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06dffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f06e00bf050 0x7f06e00bf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46138/0 (socket says 172.21.15.146:46138) 2021-01-27T09:44:27.023 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06dffff700 1 -- 172.21.15.146:0/887136452 learned_addr learned my addr 172.21.15.146:0/887136452 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:27.023 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06e4cdb700 1 --2- 172.21.15.146:0/887136452 >> v2:172.21.15.78:3300/0 conn(0x7f06e00c4d60 0x7f06e00c1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:27.023 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06df7fe700 1 --2- 172.21.15.146:0/887136452 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06e014dc70 0x7f06e0151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:27.023 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06dffff700 1 -- 172.21.15.146:0/887136452 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06e014dc70 msgr2=0x7f06e0151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:27.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06dffff700 1 --2- 172.21.15.146:0/887136452 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06e014dc70 0x7f06e0151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:27.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06dffff700 1 -- 172.21.15.146:0/887136452 >> v2:172.21.15.78:3300/0 conn(0x7f06e00c4d60 msgr2=0x7f06e00c1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:27.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06dffff700 1 --2- 172.21.15.146:0/887136452 >> v2:172.21.15.78:3300/0 conn(0x7f06e00c4d60 0x7f06e00c1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:27.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06dffff700 1 -- 172.21.15.146:0/887136452 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e0066040 con 0x7f06e00bf050 2021-01-27T09:44:27.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06df7fe700 1 --2- 172.21.15.146:0/887136452 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06e014dc70 0x7f06e0151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:44:27.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06dffff700 1 --2- 172.21.15.146:0/887136452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e00bf050 0x7f06e00bf430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f06e0061810 tx=0x7f06d0006ee0).ready entity=mon.1 client_cookie=6d7729f39eec7a1 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:27.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06deffd700 1 -- 172.21.15.146:0/887136452 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d00098d0 con 0x7f06e00bf050 2021-01-27T09:44:27.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06deffd700 1 -- 172.21.15.146:0/887136452 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d0009a30 con 0x7f06e00bf050 2021-01-27T09:44:27.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06deffd700 1 -- 172.21.15.146:0/887136452 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0009db0 con 0x7f06e00bf050 2021-01-27T09:44:27.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06e54dc700 1 -- 172.21.15.146:0/887136452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e00bf050 msgr2=0x7f06e00bf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:27.026 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06e54dc700 1 --2- 172.21.15.146:0/887136452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e00bf050 0x7f06e00bf430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f06e0061810 tx=0x7f06d0006ee0).stop 2021-01-27T09:44:27.026 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06e54dc700 1 -- 172.21.15.146:0/887136452 shutdown_connections 2021-01-27T09:44:27.026 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06e54dc700 1 --2- 172.21.15.146:0/887136452 >> v2:172.21.15.78:3300/0 conn(0x7f06e00c4d60 0x7f06e00c1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:27.026 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06e54dc700 1 --2- 172.21.15.146:0/887136452 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06e014dc70 0x7f06e0151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:27.027 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06e54dc700 1 --2- 172.21.15.146:0/887136452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e00bf050 0x7f06e00bf430 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:27.027 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06e54dc700 1 -- 172.21.15.146:0/887136452 >> 172.21.15.146:0/887136452 conn(0x7f06e0064f30 msgr2=0x7f06e0065340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:27.027 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06e54dc700 1 -- 172.21.15.146:0/887136452 shutdown_connections 2021-01-27T09:44:27.027 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.020+0000 7f06e54dc700 1 -- 172.21.15.146:0/887136452 wait complete. 2021-01-27T09:44:27.030 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.024+0000 7f06e54dc700 1 Processor -- start 2021-01-27T09:44:27.031 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.024+0000 7f06e54dc700 1 -- start start 2021-01-27T09:44:27.031 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.024+0000 7f06e54dc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00bf050 0x7f06e00bd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:27.031 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.024+0000 7f06e54dc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e00c4d60 0x7f06e00be7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:27.031 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.024+0000 7f06e54dc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06e014dc70 0x7f06e00bdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:27.032 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.024+0000 7f06e54dc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e01489c0 con 0x7f06e00bf050 2021-01-27T09:44:27.032 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.024+0000 7f06e54dc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e014add0 con 0x7f06e00c4d60 2021-01-27T09:44:27.032 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.024+0000 7f06e54dc700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e00c2ff0 con 0x7f06e014dc70 2021-01-27T09:44:27.032 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.024+0000 7f06df7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e00c4d60 0x7f06e00be7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:27.033 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.024+0000 7f06dffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00bf050 0x7f06e00bd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:27.033 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.024+0000 7f06df7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e00c4d60 0x7f06e00be7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46146/0 (socket says 172.21.15.146:46146) 2021-01-27T09:44:27.033 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.024+0000 7f06df7fe700 1 -- 172.21.15.146:0/1908712045 learned_addr learned my addr 172.21.15.146:0/1908712045 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:27.033 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.024+0000 7f06e4cdb700 1 --2- 172.21.15.146:0/1908712045 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06e014dc70 0x7f06e00bdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:27.033 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.024+0000 7f06df7fe700 1 -- 172.21.15.146:0/1908712045 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06e014dc70 msgr2=0x7f06e00bdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:27.034 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.024+0000 7f06df7fe700 1 --2- 172.21.15.146:0/1908712045 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06e014dc70 0x7f06e00bdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:27.034 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.024+0000 7f06df7fe700 1 -- 172.21.15.146:0/1908712045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00bf050 msgr2=0x7f06e00bd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:27.034 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.024+0000 7f06df7fe700 1 --2- 172.21.15.146:0/1908712045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00bf050 0x7f06e00bd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:27.034 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.024+0000 7f06df7fe700 1 -- 172.21.15.146:0/1908712045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e00c3220 con 0x7f06e00c4d60 2021-01-27T09:44:27.034 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.024+0000 7f06df7fe700 1 --2- 172.21.15.146:0/1908712045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e00c4d60 0x7f06e00be7a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f06d400db90 tx=0x7f06d4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:27.035 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.024+0000 7f06c7fff700 1 -- 172.21.15.146:0/1908712045 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d400be20 con 0x7f06e00c4d60 2021-01-27T09:44:27.035 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.024+0000 7f06c7fff700 1 -- 172.21.15.146:0/1908712045 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d40097c0 con 0x7f06e00c4d60 2021-01-27T09:44:27.035 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.028+0000 7f06c7fff700 1 -- 172.21.15.146:0/1908712045 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d4009b40 con 0x7f06e00c4d60 2021-01-27T09:44:27.035 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.028+0000 7f06e54dc700 1 -- 172.21.15.146:0/1908712045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e0148bb0 con 0x7f06e00c4d60 2021-01-27T09:44:27.035 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.028+0000 7f06e54dc700 1 -- 172.21.15.146:0/1908712045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e01490f0 con 0x7f06e00c4d60 2021-01-27T09:44:27.036 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.028+0000 7f06e54dc700 1 -- 172.21.15.146:0/1908712045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e0044ee0 con 0x7f06e00c4d60 2021-01-27T09:44:27.036 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.028+0000 7f06c7fff700 1 -- 172.21.15.146:0/1908712045 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f06d4013480 con 0x7f06e00c4d60 2021-01-27T09:44:27.037 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.028+0000 7f06c7fff700 1 --2- 172.21.15.146:0/1908712045 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f06c00561b0 0x7f06c0058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:27.037 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.028+0000 7f06c7fff700 1 -- 172.21.15.146:0/1908712045 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f06d406f110 con 0x7f06e00c4d60 2021-01-27T09:44:27.037 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.032+0000 7f06dffff700 1 --2- 172.21.15.146:0/1908712045 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f06c00561b0 0x7f06c0058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:27.037 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.032+0000 7f06dffff700 1 --2- 172.21.15.146:0/1908712045 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f06c00561b0 0x7f06c0058670 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f06d0006f20 tx=0x7f06d0016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:27.038 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.036+0000 7f06c7fff700 1 -- 172.21.15.146:0/1908712045 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f06d4044d80 con 0x7f06e00c4d60 2021-01-27T09:44:27.182 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.180+0000 7f06e54dc700 1 -- 172.21.15.146:0/1908712045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f06e014b4f0 con 0x7f06e00c4d60 2021-01-27T09:44:27.183 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.180+0000 7f06c7fff700 1 -- 172.21.15.146:0/1908712045 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7f06d40483a0 con 0x7f06e00c4d60 2021-01-27T09:44:27.184 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:44:27.184 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2021-01-27T09:44:27.184 INFO:teuthology.orchestra.run.smithi146.stdout: { 2021-01-27T09:44:27.185 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2021-01-27T09:44:27.185 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": "device_health_metrics" 2021-01-27T09:44:27.185 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2021-01-27T09:44:27.185 INFO:teuthology.orchestra.run.smithi146.stdout: { 2021-01-27T09:44:27.185 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 2, 2021-01-27T09:44:27.186 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": "rbd" 2021-01-27T09:44:27.186 INFO:teuthology.orchestra.run.smithi146.stdout: } 2021-01-27T09:44:27.186 INFO:teuthology.orchestra.run.smithi146.stdout:] 2021-01-27T09:44:27.187 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.184+0000 7f06e54dc700 1 -- 172.21.15.146:0/1908712045 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f06c00561b0 msgr2=0x7f06c0058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:27.188 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.184+0000 7f06e54dc700 1 --2- 172.21.15.146:0/1908712045 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f06c00561b0 0x7f06c0058670 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f06d0006f20 tx=0x7f06d0016000).stop 2021-01-27T09:44:27.188 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.184+0000 7f06e54dc700 1 -- 172.21.15.146:0/1908712045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e00c4d60 msgr2=0x7f06e00be7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:27.188 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.184+0000 7f06e54dc700 1 --2- 172.21.15.146:0/1908712045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e00c4d60 0x7f06e00be7a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f06d400db90 tx=0x7f06d4008040).stop 2021-01-27T09:44:27.188 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.184+0000 7f06e54dc700 1 -- 172.21.15.146:0/1908712045 shutdown_connections 2021-01-27T09:44:27.188 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.184+0000 7f06e54dc700 1 --2- 172.21.15.146:0/1908712045 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06e014dc70 0x7f06e00bdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:27.189 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.184+0000 7f06e54dc700 1 --2- 172.21.15.146:0/1908712045 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f06c00561b0 0x7f06c0058670 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:27.189 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.184+0000 7f06e54dc700 1 --2- 172.21.15.146:0/1908712045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e00c4d60 0x7f06e00be7a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:27.189 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.184+0000 7f06e54dc700 1 --2- 172.21.15.146:0/1908712045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00bf050 0x7f06e00bd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:27.189 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.184+0000 7f06e54dc700 1 -- 172.21.15.146:0/1908712045 >> 172.21.15.146:0/1908712045 conn(0x7f06e0064f30 msgr2=0x7f06e00c3880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:27.190 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.188+0000 7f06e54dc700 1 -- 172.21.15.146:0/1908712045 shutdown_connections 2021-01-27T09:44:27.190 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.188+0000 7f06e54dc700 1 -- 172.21.15.146:0/1908712045 wait complete. 2021-01-27T09:44:27.211 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-01-27T09:44:27.212 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-01-27T09:44:27.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.379+0000 7f5ff0add700 1 Processor -- start 2021-01-27T09:44:27.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.379+0000 7f5ff0add700 1 -- start start 2021-01-27T09:44:27.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.383+0000 7f5ff0add700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5fec0c1600 0x7f5fec069310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:27.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.383+0000 7f5ff0add700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec0c1a90 con 0x7f5fec0bc3c0 2021-01-27T09:44:27.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.383+0000 7f5ff0add700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec14bf20 con 0x7f5fec0c1220 2021-01-27T09:44:27.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.383+0000 7f5ff0add700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fec069800 con 0x7f5fec0c1600 2021-01-27T09:44:27.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.383+0000 7f5fead9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5fec0bc3c0 0x7f5fec060370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:33760/0 (socket says 172.21.15.146:33760) 2021-01-27T09:44:27.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.383+0000 7f5fead9d700 1 -- 172.21.15.146:0/1699633655 learned_addr learned my addr 172.21.15.146:0/1699633655 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:27.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.383+0000 7f5fea59c700 1 --1- 172.21.15.146:0/1699633655 >> v1:172.21.15.146:6789/0 conn(0x7f5fec0c1220 0x7f5fec148fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45724/0 (socket says 172.21.15.146:45724) 2021-01-27T09:44:27.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.383+0000 7f5fe9d9b700 1 --2- 172.21.15.146:0/1699633655 >> v2:172.21.15.78:3300/0 conn(0x7f5fec0c1600 0x7f5fec069310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:27.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.383+0000 7f5fe959a700 1 -- 172.21.15.146:0/1699633655 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289112885 0 0) 0x7f5fec0c1a90 con 0x7f5fec0bc3c0 2021-01-27T09:44:27.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.383+0000 7f5fe959a700 1 -- 172.21.15.146:0/1699633655 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fd0003270 con 0x7f5fec0bc3c0 2021-01-27T09:44:27.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.383+0000 7f5fe959a700 1 -- 172.21.15.146:0/1699633655 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1613230980 0 0) 0x7f5fec14bf20 con 0x7f5fec0c1220 2021-01-27T09:44:27.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.383+0000 7f5fe959a700 1 -- 172.21.15.146:0/1699633655 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fec0c1a90 con 0x7f5fec0c1220 2021-01-27T09:44:27.384 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.383+0000 7f5fe9d9b700 1 -- 172.21.15.146:0/1699633655 >> v1:172.21.15.146:6789/0 conn(0x7f5fec0c1220 legacy=0x7f5fec148fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:27.384 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.383+0000 7f5fe9d9b700 1 -- 172.21.15.146:0/1699633655 >> v1:172.21.15.78:6789/0 conn(0x7f5fec0bc3c0 legacy=0x7f5fec060370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:27.384 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.383+0000 7f5fe9d9b700 1 -- 172.21.15.146:0/1699633655 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec14c1c0 con 0x7f5fec0c1600 2021-01-27T09:44:27.384 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.383+0000 7f5fe9d9b700 1 --2- 172.21.15.146:0/1699633655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fec0c1600 0x7f5fec069310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f5fe000b9c0 tx=0x7f5fe0006e20).ready entity=mon.0 client_cookie=d4433766c0cb22fe server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:27.385 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.383+0000 7f5fe959a700 1 -- 172.21.15.146:0/1699633655 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0009690 con 0x7f5fec0c1600 2021-01-27T09:44:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.383+0000 7f5fe959a700 1 -- 172.21.15.146:0/1699633655 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe00097f0 con 0x7f5fec0c1600 2021-01-27T09:44:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.383+0000 7f5fe959a700 1 -- 172.21.15.146:0/1699633655 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0009b70 con 0x7f5fec0c1600 2021-01-27T09:44:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.383+0000 7f5ff0add700 1 -- 172.21.15.146:0/1699633655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fec0c1600 msgr2=0x7f5fec069310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.383+0000 7f5ff0add700 1 --2- 172.21.15.146:0/1699633655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fec0c1600 0x7f5fec069310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f5fe000b9c0 tx=0x7f5fe0006e20).stop 2021-01-27T09:44:27.387 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.387+0000 7f5ff0add700 1 -- 172.21.15.146:0/1699633655 shutdown_connections 2021-01-27T09:44:27.387 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.387+0000 7f5ff0add700 1 --2- 172.21.15.146:0/1699633655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fec0c1600 0x7f5fec069310 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:27.387 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.387+0000 7f5ff0add700 1 -- 172.21.15.146:0/1699633655 >> 172.21.15.146:0/1699633655 conn(0x7f5fec0632e0 msgr2=0x7f5fec0c0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:27.387 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.387+0000 7f5ff0add700 1 -- 172.21.15.146:0/1699633655 shutdown_connections 2021-01-27T09:44:27.388 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.387+0000 7f5ff0add700 1 -- 172.21.15.146:0/1699633655 wait complete. 2021-01-27T09:44:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.387+0000 7f5ff0add700 1 Processor -- start 2021-01-27T09:44:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.387+0000 7f5ff0add700 1 -- start start 2021-01-27T09:44:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.391+0000 7f5ff0add700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5fec0bc3c0 0x7f5fec15df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:27.390 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.391+0000 7f5ff0add700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fec0c1220 0x7f5fec14add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:27.390 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.391+0000 7f5ff0add700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fec0c1600 0x7f5fec15ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:27.390 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.391+0000 7f5ff0add700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec15e440 con 0x7f5fec0c1220 2021-01-27T09:44:27.390 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.391+0000 7f5ff0add700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0bf700 con 0x7f5fec0c1600 2021-01-27T09:44:27.391 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.391+0000 7f5ff0add700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec150a90 con 0x7f5fec0bc3c0 2021-01-27T09:44:27.391 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.391+0000 7f5fead9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fec0c1600 0x7f5fec15ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:27.391 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.391+0000 7f5fea59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5fec0bc3c0 0x7f5fec15df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:27.391 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.391+0000 7f5fe9d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fec0c1220 0x7f5fec14add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:27.392 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.391+0000 7f5fea59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5fec0bc3c0 0x7f5fec15df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:35644/0 (socket says 172.21.15.146:35644) 2021-01-27T09:44:27.392 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.391+0000 7f5fea59c700 1 -- 172.21.15.146:0/4270456576 learned_addr learned my addr 172.21.15.146:0/4270456576 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:27.393 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.391+0000 7f5fead9d700 1 -- 172.21.15.146:0/4270456576 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5fec0bc3c0 msgr2=0x7f5fec15df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:27.393 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.391+0000 7f5fead9d700 1 --2- 172.21.15.146:0/4270456576 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5fec0bc3c0 0x7f5fec15df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:27.394 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.391+0000 7f5fead9d700 1 -- 172.21.15.146:0/4270456576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fec0c1220 msgr2=0x7f5fec14add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:27.394 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.391+0000 7f5fead9d700 1 --2- 172.21.15.146:0/4270456576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fec0c1220 0x7f5fec14add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:27.394 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.391+0000 7f5fead9d700 1 -- 172.21.15.146:0/4270456576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec150d30 con 0x7f5fec0c1600 2021-01-27T09:44:27.394 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.391+0000 7f5fead9d700 1 --2- 172.21.15.146:0/4270456576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fec0c1600 0x7f5fec15ee80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f5fe4005950 tx=0x7f5fe4007db0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:27.394 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.391+0000 7f5fda7fc700 1 -- 172.21.15.146:0/4270456576 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe400ce10 con 0x7f5fec0c1600 2021-01-27T09:44:27.395 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.391+0000 7f5fda7fc700 1 -- 172.21.15.146:0/4270456576 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe4005bb0 con 0x7f5fec0c1600 2021-01-27T09:44:27.395 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.391+0000 7f5ff0add700 1 -- 172.21.15.146:0/4270456576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fec150fd0 con 0x7f5fec0c1600 2021-01-27T09:44:27.395 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.391+0000 7f5fda7fc700 1 -- 172.21.15.146:0/4270456576 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4007110 con 0x7f5fec0c1600 2021-01-27T09:44:27.395 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.391+0000 7f5ff0add700 1 -- 172.21.15.146:0/4270456576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fec14b2c0 con 0x7f5fec0c1600 2021-01-27T09:44:27.395 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.395+0000 7f5ff0add700 1 -- 172.21.15.146:0/4270456576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fec044ee0 con 0x7f5fec0c1600 2021-01-27T09:44:27.396 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.395+0000 7f5fda7fc700 1 -- 172.21.15.146:0/4270456576 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f5fe4010030 con 0x7f5fec0c1600 2021-01-27T09:44:27.396 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.395+0000 7f5fda7fc700 1 --2- 172.21.15.146:0/4270456576 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f5fc80561b0 0x7f5fc8058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.395+0000 7f5fda7fc700 1 -- 172.21.15.146:0/4270456576 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5fe406eef0 con 0x7f5fec0c1600 2021-01-27T09:44:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.395+0000 7f5fea59c700 1 --2- 172.21.15.146:0/4270456576 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f5fc80561b0 0x7f5fc8058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.399+0000 7f5fea59c700 1 --2- 172.21.15.146:0/4270456576 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f5fc80561b0 0x7f5fc8058670 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f5fdc004600 tx=0x7f5fdc000bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:27.402 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.403+0000 7f5fda7fc700 1 -- 172.21.15.146:0/4270456576 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f5fe4044ab0 con 0x7f5fec0c1600 2021-01-27T09:44:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.547+0000 7f5ff0add700 1 -- 172.21.15.146:0/4270456576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f5fec14b510 con 0x7f5fec0c1600 2021-01-27T09:44:27.903 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.903+0000 7f5fda7fc700 1 -- 172.21.15.146:0/4270456576 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v19) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5fe40480d0 con 0x7f5fec0c1600 2021-01-27T09:44:27.907 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.907+0000 7f5ff0add700 1 -- 172.21.15.146:0/4270456576 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f5fc80561b0 msgr2=0x7f5fc8058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:27.907 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.907+0000 7f5ff0add700 1 --2- 172.21.15.146:0/4270456576 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f5fc80561b0 0x7f5fc8058670 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f5fdc004600 tx=0x7f5fdc000bc0).stop 2021-01-27T09:44:27.907 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.907+0000 7f5ff0add700 1 -- 172.21.15.146:0/4270456576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fec0c1600 msgr2=0x7f5fec15ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:27.907 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.907+0000 7f5ff0add700 1 --2- 172.21.15.146:0/4270456576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fec0c1600 0x7f5fec15ee80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f5fe4005950 tx=0x7f5fe4007db0).stop 2021-01-27T09:44:27.908 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.907+0000 7f5ff0add700 1 -- 172.21.15.146:0/4270456576 shutdown_connections 2021-01-27T09:44:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.907+0000 7f5ff0add700 1 --2- 172.21.15.146:0/4270456576 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f5fc80561b0 0x7f5fc8058670 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.907+0000 7f5ff0add700 1 --2- 172.21.15.146:0/4270456576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fec0c1600 0x7f5fec15ee80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.907+0000 7f5ff0add700 1 --2- 172.21.15.146:0/4270456576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fec0c1220 0x7f5fec14add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.907+0000 7f5ff0add700 1 --2- 172.21.15.146:0/4270456576 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5fec0bc3c0 0x7f5fec15df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.907+0000 7f5ff0add700 1 -- 172.21.15.146:0/4270456576 >> 172.21.15.146:0/4270456576 conn(0x7f5fec0632e0 msgr2=0x7f5fec0c0010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.907+0000 7f5ff0add700 1 -- 172.21.15.146:0/4270456576 shutdown_connections 2021-01-27T09:44:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:27.911+0000 7f5ff0add700 1 -- 172.21.15.146:0/4270456576 wait complete. 2021-01-27T09:44:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2021-01-27T09:44:27.934 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-01-27T09:44:28.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.107+0000 7f4271c14700 1 Processor -- start 2021-01-27T09:44:28.106 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.107+0000 7f4271c14700 1 -- start start 2021-01-27T09:44:28.108 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.111+0000 7f4271c14700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f426c065260 0x7f426c0bf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:28.108 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.111+0000 7f4271c14700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f426c065640 0x7f426c151d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.111+0000 7f4271c14700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f426c0bbb20 0x7f426c14af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.111+0000 7f4271c14700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f426c063830 con 0x7f426c0bbb20 2021-01-27T09:44:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.111+0000 7f4271c14700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f426c0bfda0 con 0x7f426c065640 2021-01-27T09:44:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.111+0000 7f4271c14700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426c0bf5c0 con 0x7f426c065260 2021-01-27T09:44:28.110 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.111+0000 7f426affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f426c065640 0x7f426c151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.111+0000 7f426affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f426c065640 0x7f426c151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46168/0 (socket says 172.21.15.146:46168) 2021-01-27T09:44:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.111+0000 7f426affd700 1 -- 172.21.15.146:0/2784784730 learned_addr learned my addr 172.21.15.146:0/2784784730 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.111+0000 7f426bfff700 1 --2- 172.21.15.146:0/2784784730 >> v2:172.21.15.78:3300/0 conn(0x7f426c0bbb20 0x7f426c14af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.111+0000 7f426b7fe700 1 --2- 172.21.15.146:0/2784784730 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f426c065260 0x7f426c0bf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.111+0000 7f426affd700 1 -- 172.21.15.146:0/2784784730 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f426c065260 msgr2=0x7f426c0bf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.111+0000 7f426affd700 1 --2- 172.21.15.146:0/2784784730 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f426c065260 0x7f426c0bf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.111+0000 7f426affd700 1 -- 172.21.15.146:0/2784784730 >> v2:172.21.15.78:3300/0 conn(0x7f426c0bbb20 msgr2=0x7f426c14af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:28.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.111+0000 7f426affd700 1 --2- 172.21.15.146:0/2784784730 >> v2:172.21.15.78:3300/0 conn(0x7f426c0bbb20 0x7f426c14af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:28.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.111+0000 7f426affd700 1 -- 172.21.15.146:0/2784784730 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c0bf860 con 0x7f426c065640 2021-01-27T09:44:28.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.111+0000 7f426b7fe700 1 --2- 172.21.15.146:0/2784784730 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f426c065260 0x7f426c0bf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:44:28.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.111+0000 7f426affd700 1 --2- 172.21.15.146:0/2784784730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f426c065640 0x7f426c151d50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f426c0c21a0 tx=0x7f4260006ee0).ready entity=mon.1 client_cookie=daef08311a4d23df server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:28.115 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.111+0000 7f426a7fc700 1 -- 172.21.15.146:0/2784784730 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4260009840 con 0x7f426c065640 2021-01-27T09:44:28.116 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.111+0000 7f426a7fc700 1 -- 172.21.15.146:0/2784784730 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42600099a0 con 0x7f426c065640 2021-01-27T09:44:28.116 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.111+0000 7f426a7fc700 1 -- 172.21.15.146:0/2784784730 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4260009d20 con 0x7f426c065640 2021-01-27T09:44:28.116 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.115+0000 7f4271c14700 1 -- 172.21.15.146:0/2784784730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f426c065640 msgr2=0x7f426c151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:28.117 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.115+0000 7f4271c14700 1 --2- 172.21.15.146:0/2784784730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f426c065640 0x7f426c151d50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f426c0c21a0 tx=0x7f4260006ee0).stop 2021-01-27T09:44:28.117 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.115+0000 7f4271c14700 1 -- 172.21.15.146:0/2784784730 shutdown_connections 2021-01-27T09:44:28.118 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.115+0000 7f4271c14700 1 --2- 172.21.15.146:0/2784784730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f426c065640 0x7f426c151d50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:28.118 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.115+0000 7f4271c14700 1 --2- 172.21.15.146:0/2784784730 >> v2:172.21.15.78:3300/0 conn(0x7f426c0bbb20 0x7f426c14af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:28.118 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.115+0000 7f4271c14700 1 --2- 172.21.15.146:0/2784784730 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f426c065260 0x7f426c0bf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:28.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.115+0000 7f4271c14700 1 -- 172.21.15.146:0/2784784730 >> 172.21.15.146:0/2784784730 conn(0x7f426c069110 msgr2=0x7f426c067e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:28.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.115+0000 7f4271c14700 1 -- 172.21.15.146:0/2784784730 shutdown_connections 2021-01-27T09:44:28.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.115+0000 7f4271c14700 1 -- 172.21.15.146:0/2784784730 wait complete. 2021-01-27T09:44:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.119+0000 7f4271c14700 1 Processor -- start 2021-01-27T09:44:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.119+0000 7f4271c14700 1 -- start start 2021-01-27T09:44:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.119+0000 7f4271c14700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f426c065260 0x7f426c0b8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:28.123 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.119+0000 7f4271c14700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f426c0bbb20 0x7f426c0bdb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:28.123 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.119+0000 7f4271c14700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f426c14a6a0 0x7f426c15d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:28.123 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.119+0000 7f4271c14700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c0bb5d0 con 0x7f426c0bbb20 2021-01-27T09:44:28.123 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.119+0000 7f4271c14700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c14b900 con 0x7f426c14a6a0 2021-01-27T09:44:28.124 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.119+0000 7f4271c14700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426c0bb330 con 0x7f426c065260 2021-01-27T09:44:28.124 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.119+0000 7f426bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f426c14a6a0 0x7f426c15d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:28.124 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.119+0000 7f426affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f426c0bbb20 0x7f426c0bdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:28.124 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.119+0000 7f426b7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f426c065260 0x7f426c0b8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.119+0000 7f426bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f426c14a6a0 0x7f426c15d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46176/0 (socket says 172.21.15.146:46176) 2021-01-27T09:44:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.119+0000 7f426bfff700 1 -- 172.21.15.146:0/1763897509 learned_addr learned my addr 172.21.15.146:0/1763897509 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.119+0000 7f426bfff700 1 -- 172.21.15.146:0/1763897509 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f426c065260 msgr2=0x7f426c0b8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.119+0000 7f426bfff700 1 --2- 172.21.15.146:0/1763897509 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f426c065260 0x7f426c0b8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.119+0000 7f426bfff700 1 -- 172.21.15.146:0/1763897509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f426c0bbb20 msgr2=0x7f426c0bdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.119+0000 7f426bfff700 1 --2- 172.21.15.146:0/1763897509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f426c0bbb20 0x7f426c0bdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.119+0000 7f426bfff700 1 -- 172.21.15.146:0/1763897509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c0ba7b0 con 0x7f426c14a6a0 2021-01-27T09:44:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.119+0000 7f426bfff700 1 --2- 172.21.15.146:0/1763897509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f426c14a6a0 0x7f426c15d820 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f426400ed20 tx=0x7f4264009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.123+0000 7f42537fe700 1 -- 172.21.15.146:0/1763897509 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426400ee80 con 0x7f426c14a6a0 2021-01-27T09:44:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.123+0000 7f42537fe700 1 -- 172.21.15.146:0/1763897509 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426400cb60 con 0x7f426c14a6a0 2021-01-27T09:44:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.123+0000 7f42537fe700 1 -- 172.21.15.146:0/1763897509 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42640123f0 con 0x7f426c14a6a0 2021-01-27T09:44:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.123+0000 7f4271c14700 1 -- 172.21.15.146:0/1763897509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f426c0baa50 con 0x7f426c14a6a0 2021-01-27T09:44:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.123+0000 7f4271c14700 1 -- 172.21.15.146:0/1763897509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426c0bb070 con 0x7f426c14a6a0 2021-01-27T09:44:28.128 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.123+0000 7f4271c14700 1 -- 172.21.15.146:0/1763897509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f426c044ee0 con 0x7f426c14a6a0 2021-01-27T09:44:28.128 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.123+0000 7f42537fe700 1 -- 172.21.15.146:0/1763897509 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f4264022070 con 0x7f426c14a6a0 2021-01-27T09:44:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.127+0000 7f42537fe700 1 --2- 172.21.15.146:0/1763897509 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f424c056210 0x7f424c0586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.127+0000 7f42537fe700 1 -- 172.21.15.146:0/1763897509 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f426406f5f0 con 0x7f426c14a6a0 2021-01-27T09:44:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.127+0000 7f426b7fe700 1 --2- 172.21.15.146:0/1763897509 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f424c056210 0x7f424c0586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.127+0000 7f426b7fe700 1 --2- 172.21.15.146:0/1763897509 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f424c056210 0x7f424c0586d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f425c00bab0 tx=0x7f425c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:28.130 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.131+0000 7f42537fe700 1 -- 172.21.15.146:0/1763897509 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f4264045160 con 0x7f426c14a6a0 2021-01-27T09:44:28.269 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.271+0000 7f4271c14700 1 -- 172.21.15.146:0/1763897509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f426c063a20 con 0x7f426c14a6a0 2021-01-27T09:44:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.915+0000 7f42537fe700 1 -- 172.21.15.146:0/1763897509 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v20) v1 ==== 125+0+0 (secure 0 0 0) 0x7f4264016020 con 0x7f426c14a6a0 2021-01-27T09:44:28.917 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.919+0000 7f4271c14700 1 -- 172.21.15.146:0/1763897509 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f424c056210 msgr2=0x7f424c0586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:28.917 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.919+0000 7f4271c14700 1 --2- 172.21.15.146:0/1763897509 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f424c056210 0x7f424c0586d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f425c00bab0 tx=0x7f425c008040).stop 2021-01-27T09:44:28.918 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.919+0000 7f4271c14700 1 -- 172.21.15.146:0/1763897509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f426c14a6a0 msgr2=0x7f426c15d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:28.918 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.919+0000 7f4271c14700 1 --2- 172.21.15.146:0/1763897509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f426c14a6a0 0x7f426c15d820 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f426400ed20 tx=0x7f4264009220).stop 2021-01-27T09:44:28.919 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.919+0000 7f4271c14700 1 -- 172.21.15.146:0/1763897509 shutdown_connections 2021-01-27T09:44:28.920 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.919+0000 7f4271c14700 1 --2- 172.21.15.146:0/1763897509 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f424c056210 0x7f424c0586d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:28.921 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.919+0000 7f4271c14700 1 --2- 172.21.15.146:0/1763897509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f426c14a6a0 0x7f426c15d820 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:28.921 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.919+0000 7f4271c14700 1 --2- 172.21.15.146:0/1763897509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f426c0bbb20 0x7f426c0bdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:28.922 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.919+0000 7f4271c14700 1 --2- 172.21.15.146:0/1763897509 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f426c065260 0x7f426c0b8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:28.922 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.919+0000 7f4271c14700 1 -- 172.21.15.146:0/1763897509 >> 172.21.15.146:0/1763897509 conn(0x7f426c069110 msgr2=0x7f426c0c4600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:28.922 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.919+0000 7f4271c14700 1 -- 172.21.15.146:0/1763897509 shutdown_connections 2021-01-27T09:44:28.923 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:28.919+0000 7f4271c14700 1 -- 172.21.15.146:0/1763897509 wait complete. 2021-01-27T09:44:28.924 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2021-01-27T09:44:28.945 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2021-01-27T09:44:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.115+0000 7f11238e4700 1 Processor -- start 2021-01-27T09:44:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.115+0000 7f11238e4700 1 -- start start 2021-01-27T09:44:29.115 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.115+0000 7f11238e4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f111c14f570 0x7f111c14f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:29.115 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.115+0000 7f11238e4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f111c064240 0x7f111c064680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:29.116 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.115+0000 7f11238e4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f111c1526c0 con 0x7f111c0bf540 2021-01-27T09:44:29.116 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.115+0000 7f11238e4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111c152960 con 0x7f111c064240 2021-01-27T09:44:29.117 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.115+0000 7f11238e4700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111c152c00 con 0x7f111c14f570 2021-01-27T09:44:29.117 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.115+0000 7f1121680700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f111c14f570 0x7f111c14f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:29.117 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.115+0000 7f1120e7f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f111c064240 0x7f111c064680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:29.117 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.115+0000 7f1121680700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f111c14f570 0x7f111c14f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:35666/0 (socket says 172.21.15.146:35666) 2021-01-27T09:44:29.118 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.115+0000 7f1121680700 1 -- 172.21.15.146:0/250091397 learned_addr learned my addr 172.21.15.146:0/250091397 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:29.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.119+0000 7f1121680700 1 -- 172.21.15.146:0/250091397 >> v2:172.21.15.146:3300/0 conn(0x7f111c064240 msgr2=0x7f111c064680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:29.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.119+0000 7f1121680700 1 --2- 172.21.15.146:0/250091397 >> v2:172.21.15.146:3300/0 conn(0x7f111c064240 0x7f111c064680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:29.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.119+0000 7f1121680700 1 -- 172.21.15.146:0/250091397 >> v1:172.21.15.78:6789/0 conn(0x7f111c0bf540 legacy=0x7f111c155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:29.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.119+0000 7f1121680700 1 -- 172.21.15.146:0/250091397 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111c152ea0 con 0x7f111c14f570 2021-01-27T09:44:29.120 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.119+0000 7f1121680700 1 --2- 172.21.15.146:0/250091397 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f111c14f570 0x7f111c14f950 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f111800ba20 tx=0x7f1118006ee0).ready entity=mon.2 client_cookie=d613f45317ce8512 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:29.120 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.119+0000 7f110bfff700 1 -- 172.21.15.146:0/250091397 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11180098d0 con 0x7f111c14f570 2021-01-27T09:44:29.120 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.119+0000 7f110bfff700 1 -- 172.21.15.146:0/250091397 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1118009a30 con 0x7f111c14f570 2021-01-27T09:44:29.120 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.119+0000 7f110bfff700 1 -- 172.21.15.146:0/250091397 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1118009db0 con 0x7f111c14f570 2021-01-27T09:44:29.121 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.119+0000 7f11238e4700 1 -- 172.21.15.146:0/250091397 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f111c14f570 msgr2=0x7f111c14f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:29.121 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.119+0000 7f11238e4700 1 --2- 172.21.15.146:0/250091397 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f111c14f570 0x7f111c14f950 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f111800ba20 tx=0x7f1118006ee0).stop 2021-01-27T09:44:29.121 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.119+0000 7f11238e4700 1 -- 172.21.15.146:0/250091397 shutdown_connections 2021-01-27T09:44:29.122 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.119+0000 7f11238e4700 1 --2- 172.21.15.146:0/250091397 >> v2:172.21.15.146:3300/0 conn(0x7f111c064240 0x7f111c064680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:29.122 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.119+0000 7f11238e4700 1 --2- 172.21.15.146:0/250091397 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f111c14f570 0x7f111c14f950 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:29.122 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.119+0000 7f11238e4700 1 -- 172.21.15.146:0/250091397 >> 172.21.15.146:0/250091397 conn(0x7f111c067e60 msgr2=0x7f111c063550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:29.122 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.119+0000 7f11238e4700 1 -- 172.21.15.146:0/250091397 shutdown_connections 2021-01-27T09:44:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.119+0000 7f11238e4700 1 -- 172.21.15.146:0/250091397 wait complete. 2021-01-27T09:44:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.123+0000 7f11238e4700 1 Processor -- start 2021-01-27T09:44:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.123+0000 7f11238e4700 1 -- start start 2021-01-27T09:44:29.125 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.127+0000 7f11238e4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f111c064240 0x7f111c165030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:29.125 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.127+0000 7f11238e4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f111c0bf540 0x7f111c1625d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.127+0000 7f11238e4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f111c14f570 0x7f111c149480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.127+0000 7f11238e4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c165f50 con 0x7f111c064240 2021-01-27T09:44:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.127+0000 7f11238e4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c0badb0 con 0x7f111c14f570 2021-01-27T09:44:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.127+0000 7f11238e4700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111c0bb050 con 0x7f111c0bf540 2021-01-27T09:44:29.128 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.127+0000 7f1121e81700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f111c14f570 0x7f111c149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:29.128 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.127+0000 7f1121e81700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f111c14f570 0x7f111c149480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46186/0 (socket says 172.21.15.146:46186) 2021-01-27T09:44:29.128 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.127+0000 7f1121e81700 1 -- 172.21.15.146:0/2182710713 learned_addr learned my addr 172.21.15.146:0/2182710713 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:29.129 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.127+0000 7f1121680700 1 --2- 172.21.15.146:0/2182710713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f111c064240 0x7f111c165030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:29.129 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.127+0000 7f1120e7f700 1 --2- 172.21.15.146:0/2182710713 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f111c0bf540 0x7f111c1625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:29.129 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.127+0000 7f1121e81700 1 -- 172.21.15.146:0/2182710713 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f111c0bf540 msgr2=0x7f111c1625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:29.129 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.127+0000 7f1121e81700 1 --2- 172.21.15.146:0/2182710713 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f111c0bf540 0x7f111c1625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:29.129 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.127+0000 7f1121e81700 1 -- 172.21.15.146:0/2182710713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f111c064240 msgr2=0x7f111c165030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:29.130 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.127+0000 7f1121e81700 1 --2- 172.21.15.146:0/2182710713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f111c064240 0x7f111c165030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:29.130 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.127+0000 7f1121e81700 1 -- 172.21.15.146:0/2182710713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111c0bb2f0 con 0x7f111c14f570 2021-01-27T09:44:29.130 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.127+0000 7f1120e7f700 1 --2- 172.21.15.146:0/2182710713 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f111c0bf540 0x7f111c1625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:44:29.130 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.127+0000 7f1121e81700 1 --2- 172.21.15.146:0/2182710713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f111c14f570 0x7f111c149480 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f111400cac0 tx=0x7f1114007f70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.127+0000 7f11097fa700 1 -- 172.21.15.146:0/2182710713 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111400a7f0 con 0x7f111c14f570 2021-01-27T09:44:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.127+0000 7f11097fa700 1 -- 172.21.15.146:0/2182710713 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111400a950 con 0x7f111c14f570 2021-01-27T09:44:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.127+0000 7f11238e4700 1 -- 172.21.15.146:0/2182710713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111c161bf0 con 0x7f111c14f570 2021-01-27T09:44:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.127+0000 7f11097fa700 1 -- 172.21.15.146:0/2182710713 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111400acd0 con 0x7f111c14f570 2021-01-27T09:44:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.127+0000 7f11238e4700 1 -- 172.21.15.146:0/2182710713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f111c162130 con 0x7f111c14f570 2021-01-27T09:44:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.131+0000 7f1102ffd700 1 -- 172.21.15.146:0/2182710713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f8004fa0 con 0x7f111c14f570 2021-01-27T09:44:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.131+0000 7f11097fa700 1 -- 172.21.15.146:0/2182710713 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f1114019030 con 0x7f111c14f570 2021-01-27T09:44:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.131+0000 7f11097fa700 1 --2- 172.21.15.146:0/2182710713 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f10fc0561e0 0x7f10fc0586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.131+0000 7f11097fa700 1 -- 172.21.15.146:0/2182710713 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f111406ea20 con 0x7f111c14f570 2021-01-27T09:44:29.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.131+0000 7f1121680700 1 --2- 172.21.15.146:0/2182710713 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f10fc0561e0 0x7f10fc0586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:29.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.131+0000 7f1121680700 1 --2- 172.21.15.146:0/2182710713 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f10fc0561e0 0x7f10fc0586a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1118006f20 tx=0x7f1118016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:29.138 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.139+0000 7f11097fa700 1 -- 172.21.15.146:0/2182710713 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f1114044480 con 0x7f111c14f570 2021-01-27T09:44:29.309 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.310+0000 7f1102ffd700 1 -- 172.21.15.146:0/2182710713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f10f8005250 con 0x7f111c14f570 2021-01-27T09:44:29.326 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.326+0000 7f11097fa700 1 -- 172.21.15.146:0/2182710713 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1114047aa0 con 0x7f111c14f570 2021-01-27T09:44:29.334 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.334+0000 7f1102ffd700 1 -- 172.21.15.146:0/2182710713 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f10fc0561e0 msgr2=0x7f10fc0586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:29.335 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.334+0000 7f1102ffd700 1 --2- 172.21.15.146:0/2182710713 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f10fc0561e0 0x7f10fc0586a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1118006f20 tx=0x7f1118016000).stop 2021-01-27T09:44:29.335 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.334+0000 7f1102ffd700 1 -- 172.21.15.146:0/2182710713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f111c14f570 msgr2=0x7f111c149480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:29.335 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.334+0000 7f1102ffd700 1 --2- 172.21.15.146:0/2182710713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f111c14f570 0x7f111c149480 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f111400cac0 tx=0x7f1114007f70).stop 2021-01-27T09:44:29.336 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.334+0000 7f1102ffd700 1 -- 172.21.15.146:0/2182710713 shutdown_connections 2021-01-27T09:44:29.337 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.334+0000 7f1102ffd700 1 --2- 172.21.15.146:0/2182710713 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f10fc0561e0 0x7f10fc0586a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:29.337 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.334+0000 7f1102ffd700 1 --2- 172.21.15.146:0/2182710713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f111c14f570 0x7f111c149480 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:29.337 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.334+0000 7f1102ffd700 1 --2- 172.21.15.146:0/2182710713 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f111c0bf540 0x7f111c1625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:29.337 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.334+0000 7f1102ffd700 1 --2- 172.21.15.146:0/2182710713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f111c064240 0x7f111c165030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:29.337 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.334+0000 7f1102ffd700 1 -- 172.21.15.146:0/2182710713 >> 172.21.15.146:0/2182710713 conn(0x7f111c067e60 msgr2=0x7f111c14e920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:29.338 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.338+0000 7f1102ffd700 1 -- 172.21.15.146:0/2182710713 shutdown_connections 2021-01-27T09:44:29.338 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.338+0000 7f1102ffd700 1 -- 172.21.15.146:0/2182710713 wait complete. 2021-01-27T09:44:29.340 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 3 and data pool 4 2021-01-27T09:44:29.361 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2021-01-27T09:44:29.361 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2021-01-27T09:44:29.529 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.530+0000 7fbc3d2c1700 1 Processor -- start 2021-01-27T09:44:29.530 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.530+0000 7fbc3d2c1700 1 -- start start 2021-01-27T09:44:29.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.530+0000 7fbc3d2c1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbc3814bb50 0x7fbc3814f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:29.533 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.534+0000 7fbc3d2c1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbc380badd0 0x7fbc380be3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:29.533 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.534+0000 7fbc3d2c1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3814f610 con 0x7fbc380ba9f0 2021-01-27T09:44:29.534 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.534+0000 7fbc3d2c1700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3814f860 con 0x7fbc3814bb50 2021-01-27T09:44:29.534 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.534+0000 7fbc3d2c1700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3814fb00 con 0x7fbc380badd0 2021-01-27T09:44:29.534 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.534+0000 7fbc2ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbc3814bb50 0x7fbc3814f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:29.534 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.534+0000 7fbc37fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbc380ba9f0 0x7fbc380bd1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45766/0 (socket says 172.21.15.146:45766) 2021-01-27T09:44:29.535 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.534+0000 7fbc37fff700 1 -- 172.21.15.146:0/3027918745 learned_addr learned my addr 172.21.15.146:0/3027918745 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:29.535 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.534+0000 7fbc3cac0700 1 --2- 172.21.15.146:0/3027918745 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbc380badd0 0x7fbc380be3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:29.536 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.534+0000 7fbc377fe700 1 -- 172.21.15.146:0/3027918745 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428282001 0 0) 0x7fbc3814f610 con 0x7fbc380ba9f0 2021-01-27T09:44:29.536 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.534+0000 7fbc377fe700 1 -- 172.21.15.146:0/3027918745 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc18003270 con 0x7fbc380ba9f0 2021-01-27T09:44:29.536 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.534+0000 7fbc2ffff700 1 -- 172.21.15.146:0/3027918745 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbc380badd0 msgr2=0x7fbc380be3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:29.536 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.534+0000 7fbc2ffff700 1 --2- 172.21.15.146:0/3027918745 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbc380badd0 0x7fbc380be3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:29.537 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.534+0000 7fbc2ffff700 1 -- 172.21.15.146:0/3027918745 >> v1:172.21.15.146:6789/0 conn(0x7fbc380ba9f0 legacy=0x7fbc380bd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:29.537 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.534+0000 7fbc2ffff700 1 -- 172.21.15.146:0/3027918745 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3814fda0 con 0x7fbc3814bb50 2021-01-27T09:44:29.537 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.534+0000 7fbc2ffff700 1 --2- 172.21.15.146:0/3027918745 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc3814bb50 0x7fbc3814f120 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fbc2000b9c0 tx=0x7fbc20006e20).ready entity=mon.0 client_cookie=b9f86b5060bc02b8 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:29.539 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.534+0000 7fbc377fe700 1 -- 172.21.15.146:0/3027918745 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc20009690 con 0x7fbc3814bb50 2021-01-27T09:44:29.539 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.534+0000 7fbc377fe700 1 -- 172.21.15.146:0/3027918745 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc200097f0 con 0x7fbc3814bb50 2021-01-27T09:44:29.540 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.534+0000 7fbc377fe700 1 -- 172.21.15.146:0/3027918745 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc20009b70 con 0x7fbc3814bb50 2021-01-27T09:44:29.540 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.538+0000 7fbc3d2c1700 1 -- 172.21.15.146:0/3027918745 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc3814bb50 msgr2=0x7fbc3814f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:29.540 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.538+0000 7fbc3d2c1700 1 --2- 172.21.15.146:0/3027918745 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc3814bb50 0x7fbc3814f120 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fbc2000b9c0 tx=0x7fbc20006e20).stop 2021-01-27T09:44:29.540 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.538+0000 7fbc3d2c1700 1 -- 172.21.15.146:0/3027918745 shutdown_connections 2021-01-27T09:44:29.541 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.538+0000 7fbc3d2c1700 1 --2- 172.21.15.146:0/3027918745 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbc380badd0 0x7fbc380be3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:29.541 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.538+0000 7fbc3d2c1700 1 --2- 172.21.15.146:0/3027918745 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc3814bb50 0x7fbc3814f120 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:29.541 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.538+0000 7fbc3d2c1700 1 -- 172.21.15.146:0/3027918745 >> 172.21.15.146:0/3027918745 conn(0x7fbc380c1cd0 msgr2=0x7fbc380bdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:29.541 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.538+0000 7fbc3d2c1700 1 -- 172.21.15.146:0/3027918745 shutdown_connections 2021-01-27T09:44:29.542 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.538+0000 7fbc3d2c1700 1 -- 172.21.15.146:0/3027918745 wait complete. 2021-01-27T09:44:29.542 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.538+0000 7fbc3d2c1700 1 Processor -- start 2021-01-27T09:44:29.542 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.538+0000 7fbc3d2c1700 1 -- start start 2021-01-27T09:44:29.545 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.538+0000 7fbc3d2c1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc380ba9f0 0x7fbc3815e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:29.545 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.538+0000 7fbc3d2c1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbc380badd0 0x7fbc380b9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:29.546 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.538+0000 7fbc3d2c1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc381609b0 0x7fbc38160e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:29.546 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.538+0000 7fbc3d2c1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380b17c0 con 0x7fbc381609b0 2021-01-27T09:44:29.547 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.538+0000 7fbc3d2c1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380b19f0 con 0x7fbc380ba9f0 2021-01-27T09:44:29.547 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.538+0000 7fbc3d2c1700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380b1c90 con 0x7fbc380badd0 2021-01-27T09:44:29.547 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.542+0000 7fbc37fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc380ba9f0 0x7fbc3815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:29.548 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.542+0000 7fbc3cac0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc381609b0 0x7fbc38160e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:29.548 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.542+0000 7fbc37fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc380ba9f0 0x7fbc3815e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46200/0 (socket says 172.21.15.146:46200) 2021-01-27T09:44:29.549 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.542+0000 7fbc37fff700 1 -- 172.21.15.146:0/3498872976 learned_addr learned my addr 172.21.15.146:0/3498872976 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:29.549 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.542+0000 7fbc2ffff700 1 --2- 172.21.15.146:0/3498872976 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbc380badd0 0x7fbc380b9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:29.549 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.542+0000 7fbc37fff700 1 -- 172.21.15.146:0/3498872976 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbc380badd0 msgr2=0x7fbc380b9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:29.550 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.542+0000 7fbc37fff700 1 --2- 172.21.15.146:0/3498872976 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbc380badd0 0x7fbc380b9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:29.550 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.542+0000 7fbc37fff700 1 -- 172.21.15.146:0/3498872976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc381609b0 msgr2=0x7fbc38160e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:29.551 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.542+0000 7fbc37fff700 1 --2- 172.21.15.146:0/3498872976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc381609b0 0x7fbc38160e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:29.551 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.542+0000 7fbc37fff700 1 -- 172.21.15.146:0/3498872976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc380b1f30 con 0x7fbc380ba9f0 2021-01-27T09:44:29.551 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.542+0000 7fbc3cac0700 1 --2- 172.21.15.146:0/3498872976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc381609b0 0x7fbc38160e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:29.552 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.542+0000 7fbc37fff700 1 --2- 172.21.15.146:0/3498872976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc380ba9f0 0x7fbc3815e750 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fbc2800c740 tx=0x7fbc28007af0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:29.552 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.542+0000 7fbc34ff9700 1 -- 172.21.15.146:0/3498872976 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc280072e0 con 0x7fbc380ba9f0 2021-01-27T09:44:29.552 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.542+0000 7fbc34ff9700 1 -- 172.21.15.146:0/3498872976 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc28007440 con 0x7fbc380ba9f0 2021-01-27T09:44:29.553 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.542+0000 7fbc34ff9700 1 -- 172.21.15.146:0/3498872976 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc28005850 con 0x7fbc380ba9f0 2021-01-27T09:44:29.553 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.542+0000 7fbc3d2c1700 1 -- 172.21.15.146:0/3498872976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc380b21d0 con 0x7fbc380ba9f0 2021-01-27T09:44:29.553 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.542+0000 7fbc3d2c1700 1 -- 172.21.15.146:0/3498872976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc38061f10 con 0x7fbc380ba9f0 2021-01-27T09:44:29.554 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.542+0000 7fbc3d2c1700 1 -- 172.21.15.146:0/3498872976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc380b8340 con 0x7fbc380ba9f0 2021-01-27T09:44:29.554 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.546+0000 7fbc34ff9700 1 -- 172.21.15.146:0/3498872976 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fbc28010070 con 0x7fbc380ba9f0 2021-01-27T09:44:29.555 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.546+0000 7fbc34ff9700 1 --2- 172.21.15.146:0/3498872976 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbc1c0561b0 0x7fbc1c058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:29.555 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.546+0000 7fbc34ff9700 1 -- 172.21.15.146:0/3498872976 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbc2806e900 con 0x7fbc380ba9f0 2021-01-27T09:44:29.555 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.546+0000 7fbc2ffff700 1 --2- 172.21.15.146:0/3498872976 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbc1c0561b0 0x7fbc1c058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:29.556 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.546+0000 7fbc2ffff700 1 --2- 172.21.15.146:0/3498872976 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbc1c0561b0 0x7fbc1c058670 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fbc2000b000 tx=0x7fbc20016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:29.556 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.550+0000 7fbc34ff9700 1 -- 172.21.15.146:0/3498872976 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fbc28044190 con 0x7fbc380ba9f0 2021-01-27T09:44:29.701 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:29.702+0000 7fbc3d2c1700 1 -- 172.21.15.146:0/3498872976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fbc38044680 con 0x7fbc380ba9f0 2021-01-27T09:44:30.333 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.334+0000 7fbc34ff9700 1 -- 172.21.15.146:0/3498872976 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) v1 ==== 157+0+0 (secure 0 0 0) 0x7fbc28018070 con 0x7fbc380ba9f0 2021-01-27T09:44:30.336 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.334+0000 7fbc3d2c1700 1 -- 172.21.15.146:0/3498872976 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbc1c0561b0 msgr2=0x7fbc1c058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:30.337 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.334+0000 7fbc3d2c1700 1 --2- 172.21.15.146:0/3498872976 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbc1c0561b0 0x7fbc1c058670 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fbc2000b000 tx=0x7fbc20016000).stop 2021-01-27T09:44:30.337 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.334+0000 7fbc3d2c1700 1 -- 172.21.15.146:0/3498872976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc380ba9f0 msgr2=0x7fbc3815e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:30.337 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.334+0000 7fbc3d2c1700 1 --2- 172.21.15.146:0/3498872976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc380ba9f0 0x7fbc3815e750 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fbc2800c740 tx=0x7fbc28007af0).stop 2021-01-27T09:44:30.337 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.334+0000 7fbc3d2c1700 1 -- 172.21.15.146:0/3498872976 shutdown_connections 2021-01-27T09:44:30.338 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.334+0000 7fbc3d2c1700 1 --2- 172.21.15.146:0/3498872976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc381609b0 0x7fbc38160e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:30.338 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.334+0000 7fbc3d2c1700 1 --2- 172.21.15.146:0/3498872976 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbc380badd0 0x7fbc380b9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:30.338 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.334+0000 7fbc3d2c1700 1 --2- 172.21.15.146:0/3498872976 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbc1c0561b0 0x7fbc1c058670 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:30.338 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.334+0000 7fbc3d2c1700 1 --2- 172.21.15.146:0/3498872976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc380ba9f0 0x7fbc3815e750 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:30.338 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.334+0000 7fbc3d2c1700 1 -- 172.21.15.146:0/3498872976 >> 172.21.15.146:0/3498872976 conn(0x7fbc380c1cd0 msgr2=0x7fbc380b7890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:30.339 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.334+0000 7fbc3d2c1700 1 -- 172.21.15.146:0/3498872976 shutdown_connections 2021-01-27T09:44:30.339 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.334+0000 7fbc3d2c1700 1 -- 172.21.15.146:0/3498872976 wait complete. 2021-01-27T09:44:30.363 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec 8 erasure cephfs_data_ec 2021-01-27T09:44:30.534 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.534+0000 7fc918398700 1 Processor -- start 2021-01-27T09:44:30.534 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.534+0000 7fc918398700 1 -- start start 2021-01-27T09:44:30.536 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.534+0000 7fc918398700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc910066fa0 0x7fc9100bbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:30.536 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.534+0000 7fc918398700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9100bbfa0 con 0x7fc9100bf1b0 2021-01-27T09:44:30.537 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.534+0000 7fc918398700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91014dfc0 con 0x7fc9100bf590 2021-01-27T09:44:30.537 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.534+0000 7fc918398700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91014e260 con 0x7fc910066fa0 2021-01-27T09:44:30.537 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.534+0000 7fc915933700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc910066fa0 0x7fc9100bbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:30.538 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.534+0000 7fc916134700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc9100bf1b0 0x7fc910066880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:33818/0 (socket says 172.21.15.146:33818) 2021-01-27T09:44:30.538 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.534+0000 7fc916134700 1 -- 172.21.15.146:0/3226559920 learned_addr learned my addr 172.21.15.146:0/3226559920 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.538+0000 7fc915132700 1 -- 172.21.15.146:0/3226559920 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549557243 0 0) 0x7fc9100bbfa0 con 0x7fc9100bf1b0 2021-01-27T09:44:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.538+0000 7fc915132700 1 -- 172.21.15.146:0/3226559920 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8f8003270 con 0x7fc9100bf1b0 2021-01-27T09:44:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.538+0000 7fc915132700 1 -- 172.21.15.146:0/3226559920 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648450994 0 0) 0x7fc91014dfc0 con 0x7fc9100bf590 2021-01-27T09:44:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.538+0000 7fc915132700 1 -- 172.21.15.146:0/3226559920 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9100bbfa0 con 0x7fc9100bf590 2021-01-27T09:44:30.540 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.538+0000 7fc915933700 1 -- 172.21.15.146:0/3226559920 >> v1:172.21.15.146:6789/0 conn(0x7fc9100bf590 legacy=0x7fc91014ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:30.540 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.538+0000 7fc915933700 1 -- 172.21.15.146:0/3226559920 >> v1:172.21.15.78:6789/0 conn(0x7fc9100bf1b0 legacy=0x7fc910066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:30.540 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.538+0000 7fc915933700 1 -- 172.21.15.146:0/3226559920 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91014e500 con 0x7fc910066fa0 2021-01-27T09:44:30.540 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.538+0000 7fc915933700 1 --2- 172.21.15.146:0/3226559920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc910066fa0 0x7fc9100bbab0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc90000b9f0 tx=0x7fc900006e20).ready entity=mon.2 client_cookie=8300578c0ae84463 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:30.541 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.538+0000 7fc915132700 1 -- 172.21.15.146:0/3226559920 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9000096c0 con 0x7fc910066fa0 2021-01-27T09:44:30.542 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.538+0000 7fc915132700 1 -- 172.21.15.146:0/3226559920 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc900009820 con 0x7fc910066fa0 2021-01-27T09:44:30.542 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.538+0000 7fc915132700 1 -- 172.21.15.146:0/3226559920 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc900009ba0 con 0x7fc910066fa0 2021-01-27T09:44:30.543 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.538+0000 7fc918398700 1 -- 172.21.15.146:0/3226559920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc910066fa0 msgr2=0x7fc9100bbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:30.544 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.538+0000 7fc918398700 1 --2- 172.21.15.146:0/3226559920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc910066fa0 0x7fc9100bbab0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc90000b9f0 tx=0x7fc900006e20).stop 2021-01-27T09:44:30.544 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.538+0000 7fc918398700 1 -- 172.21.15.146:0/3226559920 shutdown_connections 2021-01-27T09:44:30.544 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.538+0000 7fc918398700 1 --2- 172.21.15.146:0/3226559920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc910066fa0 0x7fc9100bbab0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:30.544 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.538+0000 7fc918398700 1 -- 172.21.15.146:0/3226559920 >> 172.21.15.146:0/3226559920 conn(0x7fc910060910 msgr2=0x7fc910062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:30.544 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.542+0000 7fc918398700 1 -- 172.21.15.146:0/3226559920 shutdown_connections 2021-01-27T09:44:30.545 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.542+0000 7fc918398700 1 -- 172.21.15.146:0/3226559920 wait complete. 2021-01-27T09:44:30.548 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.542+0000 7fc918398700 1 Processor -- start 2021-01-27T09:44:30.549 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.542+0000 7fc918398700 1 -- start start 2021-01-27T09:44:30.549 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.542+0000 7fc918398700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc910066fa0 0x7fc9101488d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:30.549 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.542+0000 7fc918398700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc9100bf1b0 0x7fc91014bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:30.549 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.542+0000 7fc918398700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9100bf590 0x7fc910141180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:30.549 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.542+0000 7fc918398700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc910149200 con 0x7fc910066fa0 2021-01-27T09:44:30.550 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.542+0000 7fc918398700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc910148f60 con 0x7fc9100bf590 2021-01-27T09:44:30.550 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.542+0000 7fc918398700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc910142ec0 con 0x7fc9100bf1b0 2021-01-27T09:44:30.550 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.542+0000 7fc916134700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc910066fa0 0x7fc9101488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:30.550 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.542+0000 7fc916134700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc910066fa0 0x7fc9101488d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:49092/0 (socket says 172.21.15.146:49092) 2021-01-27T09:44:30.551 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.542+0000 7fc916134700 1 -- 172.21.15.146:0/3053657306 learned_addr learned my addr 172.21.15.146:0/3053657306 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:30.551 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.542+0000 7fc916935700 1 --2- 172.21.15.146:0/3053657306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9100bf590 0x7fc910141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:30.551 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.542+0000 7fc915933700 1 --2- 172.21.15.146:0/3053657306 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc9100bf1b0 0x7fc91014bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:30.551 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.546+0000 7fc916134700 1 -- 172.21.15.146:0/3053657306 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc9100bf1b0 msgr2=0x7fc91014bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:30.551 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.546+0000 7fc916134700 1 --2- 172.21.15.146:0/3053657306 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc9100bf1b0 0x7fc91014bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:30.552 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.546+0000 7fc916134700 1 -- 172.21.15.146:0/3053657306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9100bf590 msgr2=0x7fc910141180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:30.552 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.546+0000 7fc916134700 1 --2- 172.21.15.146:0/3053657306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9100bf590 0x7fc910141180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:30.552 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.546+0000 7fc916134700 1 -- 172.21.15.146:0/3053657306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc910143160 con 0x7fc910066fa0 2021-01-27T09:44:30.552 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.546+0000 7fc916134700 1 --2- 172.21.15.146:0/3053657306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc910066fa0 0x7fc9101488d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fc90c00c760 tx=0x7fc90c007ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:30.552 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.546+0000 7fc8fe7fc700 1 -- 172.21.15.146:0/3053657306 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c0072e0 con 0x7fc910066fa0 2021-01-27T09:44:30.553 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.546+0000 7fc8fe7fc700 1 -- 172.21.15.146:0/3053657306 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c007440 con 0x7fc910066fa0 2021-01-27T09:44:30.553 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.546+0000 7fc918398700 1 -- 172.21.15.146:0/3053657306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc910143400 con 0x7fc910066fa0 2021-01-27T09:44:30.553 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.546+0000 7fc8fe7fc700 1 -- 172.21.15.146:0/3053657306 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c005830 con 0x7fc910066fa0 2021-01-27T09:44:30.554 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.546+0000 7fc918398700 1 -- 172.21.15.146:0/3053657306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc910062b80 con 0x7fc910066fa0 2021-01-27T09:44:30.554 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.546+0000 7fc918398700 1 -- 172.21.15.146:0/3053657306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc910044ee0 con 0x7fc910066fa0 2021-01-27T09:44:30.555 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.550+0000 7fc8fe7fc700 1 -- 172.21.15.146:0/3053657306 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fc90c010070 con 0x7fc910066fa0 2021-01-27T09:44:30.555 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.550+0000 7fc8fe7fc700 1 --2- 172.21.15.146:0/3053657306 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc8f00561e0 0x7fc8f00586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:30.555 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.550+0000 7fc8fe7fc700 1 -- 172.21.15.146:0/3053657306 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6332+0+0 (secure 0 0 0) 0x7fc90c06eaf0 con 0x7fc910066fa0 2021-01-27T09:44:30.555 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.550+0000 7fc915933700 1 --2- 172.21.15.146:0/3053657306 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc8f00561e0 0x7fc8f00586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:30.556 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.550+0000 7fc915933700 1 --2- 172.21.15.146:0/3053657306 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc8f00561e0 0x7fc8f00586a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc9100673b0 tx=0x7fc900016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:30.559 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.558+0000 7fc8fe7fc700 1 -- 172.21.15.146:0/3053657306 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fc90c044410 con 0x7fc910066fa0 2021-01-27T09:44:30.702 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:30.702+0000 7fc918398700 1 -- 172.21.15.146:0/3053657306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec"} v 0) v1 -- 0x7fc910061170 con 0x7fc910066fa0 2021-01-27T09:44:31.883 INFO:tasks.ceph.mds.b.smithi078.stderr:2021-01-27T09:44:31.883+0000 7f4c50272700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-01-27T09:44:32.351 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.349+0000 7fc8fe7fc700 1 -- 172.21.15.146:0/3053657306 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec"}]=0 pool 'cephfs_data_ec' created v24) v1 ==== 197+0+0 (secure 0 0 0) 0x7fc90c0330e0 con 0x7fc910066fa0 2021-01-27T09:44:32.353 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.349+0000 7fc918398700 1 -- 172.21.15.146:0/3053657306 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc8f00561e0 msgr2=0x7fc8f00586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:32.354 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.349+0000 7fc918398700 1 --2- 172.21.15.146:0/3053657306 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc8f00561e0 0x7fc8f00586a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc9100673b0 tx=0x7fc900016000).stop 2021-01-27T09:44:32.355 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.349+0000 7fc918398700 1 -- 172.21.15.146:0/3053657306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc910066fa0 msgr2=0x7fc9101488d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:32.355 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.349+0000 7fc918398700 1 --2- 172.21.15.146:0/3053657306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc910066fa0 0x7fc9101488d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fc90c00c760 tx=0x7fc90c007ba0).stop 2021-01-27T09:44:32.355 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.353+0000 7fc918398700 1 -- 172.21.15.146:0/3053657306 shutdown_connections 2021-01-27T09:44:32.355 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.353+0000 7fc918398700 1 --2- 172.21.15.146:0/3053657306 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc8f00561e0 0x7fc8f00586a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:32.356 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.353+0000 7fc918398700 1 --2- 172.21.15.146:0/3053657306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9100bf590 0x7fc910141180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:32.356 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.353+0000 7fc918398700 1 --2- 172.21.15.146:0/3053657306 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc9100bf1b0 0x7fc91014bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:32.356 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.353+0000 7fc918398700 1 --2- 172.21.15.146:0/3053657306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc910066fa0 0x7fc9101488d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:32.356 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.353+0000 7fc918398700 1 -- 172.21.15.146:0/3053657306 >> 172.21.15.146:0/3053657306 conn(0x7fc910060910 msgr2=0x7fc91005bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:32.356 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.353+0000 7fc918398700 1 -- 172.21.15.146:0/3053657306 shutdown_connections 2021-01-27T09:44:32.357 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.353+0000 7fc918398700 1 -- 172.21.15.146:0/3053657306 wait complete. 2021-01-27T09:44:32.363 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data_ec' created 2021-01-27T09:44:32.387 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2021-01-27T09:44:32.566 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.561+0000 7fcb8db07700 1 Processor -- start 2021-01-27T09:44:32.566 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.565+0000 7fcb8db07700 1 -- start start 2021-01-27T09:44:32.567 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.565+0000 7fcb8db07700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcb8814dea0 0x7fcb880b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:32.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.565+0000 7fcb8db07700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb880c1e70 con 0x7fcb88060c60 2021-01-27T09:44:32.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.565+0000 7fcb8db07700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb880c12c0 con 0x7fcb88060880 2021-01-27T09:44:32.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.565+0000 7fcb8db07700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb88065e80 con 0x7fcb8814dea0 2021-01-27T09:44:32.569 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.565+0000 7fcb87fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fcb88060c60 0x7fcb880c4b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:33836/0 (socket says 172.21.15.146:33836) 2021-01-27T09:44:32.569 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.565+0000 7fcb87fff700 1 -- 172.21.15.146:0/1338899194 learned_addr learned my addr 172.21.15.146:0/1338899194 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:32.569 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.565+0000 7fcb8d306700 1 --2- 172.21.15.146:0/1338899194 >> v2:172.21.15.78:3300/0 conn(0x7fcb8814dea0 0x7fcb880b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:32.570 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.565+0000 7fcb877fe700 1 -- 172.21.15.146:0/1338899194 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1991633529 0 0) 0x7fcb880c1e70 con 0x7fcb88060c60 2021-01-27T09:44:32.570 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.565+0000 7fcb877fe700 1 -- 172.21.15.146:0/1338899194 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb6c003270 con 0x7fcb88060c60 2021-01-27T09:44:32.571 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.565+0000 7fcb877fe700 1 -- 172.21.15.146:0/1338899194 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1924846413 0 0) 0x7fcb880c12c0 con 0x7fcb88060880 2021-01-27T09:44:32.571 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.565+0000 7fcb877fe700 1 -- 172.21.15.146:0/1338899194 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb880c1e70 con 0x7fcb88060880 2021-01-27T09:44:32.572 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.565+0000 7fcb8d306700 1 -- 172.21.15.146:0/1338899194 >> v1:172.21.15.146:6789/0 conn(0x7fcb88060880 legacy=0x7fcb880c1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:32.572 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.565+0000 7fcb8d306700 1 -- 172.21.15.146:0/1338899194 >> v1:172.21.15.78:6789/0 conn(0x7fcb88060c60 legacy=0x7fcb880c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:32.572 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.565+0000 7fcb8d306700 1 -- 172.21.15.146:0/1338899194 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8814e4f0 con 0x7fcb8814dea0 2021-01-27T09:44:32.572 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.569+0000 7fcb8d306700 1 --2- 172.21.15.146:0/1338899194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb8814dea0 0x7fcb880b75b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fcb80009cc0 tx=0x7fcb80009220).ready entity=mon.0 client_cookie=4f6ae06c25bd7b47 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:32.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.569+0000 7fcb877fe700 1 -- 172.21.15.146:0/1338899194 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8000b9f0 con 0x7fcb8814dea0 2021-01-27T09:44:32.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.569+0000 7fcb877fe700 1 -- 172.21.15.146:0/1338899194 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8000bb50 con 0x7fcb8814dea0 2021-01-27T09:44:32.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.569+0000 7fcb877fe700 1 -- 172.21.15.146:0/1338899194 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb80011400 con 0x7fcb8814dea0 2021-01-27T09:44:32.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.569+0000 7fcb8db07700 1 -- 172.21.15.146:0/1338899194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb8814dea0 msgr2=0x7fcb880b75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:32.574 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.569+0000 7fcb8db07700 1 --2- 172.21.15.146:0/1338899194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb8814dea0 0x7fcb880b75b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fcb80009cc0 tx=0x7fcb80009220).stop 2021-01-27T09:44:32.574 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.569+0000 7fcb8db07700 1 -- 172.21.15.146:0/1338899194 shutdown_connections 2021-01-27T09:44:32.574 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.569+0000 7fcb8db07700 1 --2- 172.21.15.146:0/1338899194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb8814dea0 0x7fcb880b75b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:32.575 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.569+0000 7fcb8db07700 1 -- 172.21.15.146:0/1338899194 >> 172.21.15.146:0/1338899194 conn(0x7fcb88067d80 msgr2=0x7fcb88068190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:32.575 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.569+0000 7fcb8db07700 1 -- 172.21.15.146:0/1338899194 shutdown_connections 2021-01-27T09:44:32.575 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.569+0000 7fcb8db07700 1 -- 172.21.15.146:0/1338899194 wait complete. 2021-01-27T09:44:32.576 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.573+0000 7fcb8db07700 1 Processor -- start 2021-01-27T09:44:32.576 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.573+0000 7fcb8db07700 1 -- start start 2021-01-27T09:44:32.577 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.573+0000 7fcb8db07700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb88060880 0x7fcb881657d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:32.578 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.573+0000 7fcb8db07700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb88060c60 0x7fcb880bd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:32.578 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.573+0000 7fcb8db07700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb8814dea0 0x7fcb880b93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:32.578 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.573+0000 7fcb8db07700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb88165cc0 con 0x7fcb88060880 2021-01-27T09:44:32.578 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.573+0000 7fcb8db07700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb880bcf60 con 0x7fcb8814dea0 2021-01-27T09:44:32.579 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.573+0000 7fcb8db07700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb880bd200 con 0x7fcb88060c60 2021-01-27T09:44:32.579 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.573+0000 7fcb8d306700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb8814dea0 0x7fcb880b93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:32.579 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.573+0000 7fcb87fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb88060c60 0x7fcb880bd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:32.579 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.573+0000 7fcb8d306700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb8814dea0 0x7fcb880b93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46240/0 (socket says 172.21.15.146:46240) 2021-01-27T09:44:32.579 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.573+0000 7fcb8d306700 1 -- 172.21.15.146:0/3392601215 learned_addr learned my addr 172.21.15.146:0/3392601215 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:32.580 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.573+0000 7fcb8cb05700 1 --2- 172.21.15.146:0/3392601215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb88060880 0x7fcb881657d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:32.580 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.573+0000 7fcb8d306700 1 -- 172.21.15.146:0/3392601215 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb88060c60 msgr2=0x7fcb880bd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:32.580 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.573+0000 7fcb8d306700 1 --2- 172.21.15.146:0/3392601215 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb88060c60 0x7fcb880bd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:32.580 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.573+0000 7fcb8d306700 1 -- 172.21.15.146:0/3392601215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb88060880 msgr2=0x7fcb881657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:32.581 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.573+0000 7fcb8d306700 1 --2- 172.21.15.146:0/3392601215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb88060880 0x7fcb881657d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:32.581 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.573+0000 7fcb8d306700 1 -- 172.21.15.146:0/3392601215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb88161bb0 con 0x7fcb8814dea0 2021-01-27T09:44:32.581 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.573+0000 7fcb8d306700 1 --2- 172.21.15.146:0/3392601215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb8814dea0 0x7fcb880b93f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fcb800090b0 tx=0x7fcb80017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:32.582 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.573+0000 7fcb84ff9700 1 -- 172.21.15.146:0/3392601215 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8001b650 con 0x7fcb8814dea0 2021-01-27T09:44:32.583 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.577+0000 7fcb8db07700 1 -- 172.21.15.146:0/3392601215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb88161e50 con 0x7fcb8814dea0 2021-01-27T09:44:32.583 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.577+0000 7fcb84ff9700 1 -- 172.21.15.146:0/3392601215 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8001b7b0 con 0x7fcb8814dea0 2021-01-27T09:44:32.583 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.577+0000 7fcb84ff9700 1 -- 172.21.15.146:0/3392601215 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8001bb70 con 0x7fcb8814dea0 2021-01-27T09:44:32.583 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.577+0000 7fcb8db07700 1 -- 172.21.15.146:0/3392601215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb881618a0 con 0x7fcb8814dea0 2021-01-27T09:44:32.584 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.577+0000 7fcb8db07700 1 -- 172.21.15.146:0/3392601215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb88044680 con 0x7fcb8814dea0 2021-01-27T09:44:32.584 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.577+0000 7fcb84ff9700 1 -- 172.21.15.146:0/3392601215 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fcb8000f070 con 0x7fcb8814dea0 2021-01-27T09:44:32.584 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.577+0000 7fcb84ff9700 1 --2- 172.21.15.146:0/3392601215 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcb680561b0 0x7fcb68058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:32.584 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.577+0000 7fcb84ff9700 1 -- 172.21.15.146:0/3392601215 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fcb80071370 con 0x7fcb8814dea0 2021-01-27T09:44:32.584 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.581+0000 7fcb8cb05700 1 --2- 172.21.15.146:0/3392601215 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcb680561b0 0x7fcb68058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:32.585 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.581+0000 7fcb8cb05700 1 --2- 172.21.15.146:0/3392601215 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcb680561b0 0x7fcb68058670 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fcb7c0037a0 tx=0x7fcb7c007a50).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:32.589 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.585+0000 7fcb84ff9700 1 -- 172.21.15.146:0/3392601215 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fcb80046a40 con 0x7fcb8814dea0 2021-01-27T09:44:32.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:32.729+0000 7fcb8db07700 1 -- 172.21.15.146:0/3392601215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fcb880bd9b0 con 0x7fcb8814dea0 2021-01-27T09:44:33.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.361+0000 7fcb84ff9700 1 -- 172.21.15.146:0/3392601215 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcb8004a060 con 0x7fcb8814dea0 2021-01-27T09:44:33.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.373+0000 7fcb8db07700 1 -- 172.21.15.146:0/3392601215 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcb680561b0 msgr2=0x7fcb68058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:33.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.373+0000 7fcb8db07700 1 --2- 172.21.15.146:0/3392601215 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcb680561b0 0x7fcb68058670 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fcb7c0037a0 tx=0x7fcb7c007a50).stop 2021-01-27T09:44:33.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.373+0000 7fcb8db07700 1 -- 172.21.15.146:0/3392601215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb8814dea0 msgr2=0x7fcb880b93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:33.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.373+0000 7fcb8db07700 1 --2- 172.21.15.146:0/3392601215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb8814dea0 0x7fcb880b93f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fcb800090b0 tx=0x7fcb80017000).stop 2021-01-27T09:44:33.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.373+0000 7fcb8db07700 1 -- 172.21.15.146:0/3392601215 shutdown_connections 2021-01-27T09:44:33.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.373+0000 7fcb8db07700 1 --2- 172.21.15.146:0/3392601215 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcb680561b0 0x7fcb68058670 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:33.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.373+0000 7fcb8db07700 1 --2- 172.21.15.146:0/3392601215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb8814dea0 0x7fcb880b93f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:33.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.373+0000 7fcb8db07700 1 --2- 172.21.15.146:0/3392601215 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb88060c60 0x7fcb880bd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:33.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.373+0000 7fcb8db07700 1 --2- 172.21.15.146:0/3392601215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb88060880 0x7fcb881657d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:33.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.373+0000 7fcb8db07700 1 -- 172.21.15.146:0/3392601215 >> 172.21.15.146:0/3392601215 conn(0x7fcb88067d80 msgr2=0x7fcb8814c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:33.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.377+0000 7fcb8db07700 1 -- 172.21.15.146:0/3392601215 shutdown_connections 2021-01-27T09:44:33.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.377+0000 7fcb8db07700 1 -- 172.21.15.146:0/3392601215 wait complete. 2021-01-27T09:44:33.381 INFO:teuthology.orchestra.run.smithi146.stderr:set pool 5 allow_ec_overwrites to true 2021-01-27T09:44:33.401 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2021-01-27T09:44:33.560 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.557+0000 7fc5e3e46700 1 Processor -- start 2021-01-27T09:44:33.561 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.557+0000 7fc5e3e46700 1 -- start start 2021-01-27T09:44:33.561 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.557+0000 7fc5e3e46700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc5dc14bf40 0x7fc5dc14c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:33.562 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.557+0000 7fc5e3e46700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5dc152640 con 0x7fc5dc1521d0 2021-01-27T09:44:33.562 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.557+0000 7fc5e3e46700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5dc1528d0 con 0x7fc5dc063130 2021-01-27T09:44:33.562 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.557+0000 7fc5e3e46700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5dc152b70 con 0x7fc5dc14bf40 2021-01-27T09:44:33.563 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.561+0000 7fc5e13e1700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc5dc1521d0 0x7fc5dc0bccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:33850/0 (socket says 172.21.15.146:33850) 2021-01-27T09:44:33.563 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.561+0000 7fc5e1be2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc5dc14bf40 0x7fc5dc14c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:33.564 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.561+0000 7fc5e13e1700 1 -- 172.21.15.146:0/4045543023 learned_addr learned my addr 172.21.15.146:0/4045543023 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:33.564 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.561+0000 7fc5e23e3700 1 --1- 172.21.15.146:0/4045543023 >> v1:172.21.15.146:6789/0 conn(0x7fc5dc063130 0x7fc5dc064a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45820/0 (socket says 172.21.15.146:45820) 2021-01-27T09:44:33.564 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.561+0000 7fc5e0be0700 1 -- 172.21.15.146:0/4045543023 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722617323 0 0) 0x7fc5dc152640 con 0x7fc5dc1521d0 2021-01-27T09:44:33.564 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.561+0000 7fc5e0be0700 1 -- 172.21.15.146:0/4045543023 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5c4003270 con 0x7fc5dc1521d0 2021-01-27T09:44:33.564 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.561+0000 7fc5e1be2700 1 -- 172.21.15.146:0/4045543023 >> v1:172.21.15.146:6789/0 conn(0x7fc5dc063130 legacy=0x7fc5dc064a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:33.565 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.561+0000 7fc5e0be0700 1 -- 172.21.15.146:0/4045543023 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1041181206 0 0) 0x7fc5dc1528d0 con 0x7fc5dc063130 2021-01-27T09:44:33.565 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.561+0000 7fc5e1be2700 1 -- 172.21.15.146:0/4045543023 >> v1:172.21.15.78:6789/0 conn(0x7fc5dc1521d0 legacy=0x7fc5dc0bccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:33.565 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.561+0000 7fc5e1be2700 1 -- 172.21.15.146:0/4045543023 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc152e10 con 0x7fc5dc14bf40 2021-01-27T09:44:33.566 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.561+0000 7fc5e1be2700 1 --2- 172.21.15.146:0/4045543023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5dc14bf40 0x7fc5dc14c320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc5d800b9c0 tx=0x7fc5d8006e20).ready entity=mon.1 client_cookie=85475a1a89bdef6a server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:33.567 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.561+0000 7fc5e0be0700 1 -- 172.21.15.146:0/4045543023 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d800beb0 con 0x7fc5dc14bf40 2021-01-27T09:44:33.567 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.561+0000 7fc5e0be0700 1 -- 172.21.15.146:0/4045543023 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d80097e0 con 0x7fc5dc14bf40 2021-01-27T09:44:33.567 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.561+0000 7fc5e0be0700 1 -- 172.21.15.146:0/4045543023 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8009b60 con 0x7fc5dc14bf40 2021-01-27T09:44:33.567 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.561+0000 7fc5e3e46700 1 -- 172.21.15.146:0/4045543023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5dc14bf40 msgr2=0x7fc5dc14c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:33.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.561+0000 7fc5e3e46700 1 --2- 172.21.15.146:0/4045543023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5dc14bf40 0x7fc5dc14c320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc5d800b9c0 tx=0x7fc5d8006e20).stop 2021-01-27T09:44:33.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.561+0000 7fc5e3e46700 1 -- 172.21.15.146:0/4045543023 shutdown_connections 2021-01-27T09:44:33.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.561+0000 7fc5e3e46700 1 --2- 172.21.15.146:0/4045543023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5dc14bf40 0x7fc5dc14c320 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:33.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.561+0000 7fc5e3e46700 1 -- 172.21.15.146:0/4045543023 >> 172.21.15.146:0/4045543023 conn(0x7fc5dc060910 msgr2=0x7fc5dc062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:33.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.561+0000 7fc5e3e46700 1 -- 172.21.15.146:0/4045543023 shutdown_connections 2021-01-27T09:44:33.569 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.561+0000 7fc5e3e46700 1 -- 172.21.15.146:0/4045543023 wait complete. 2021-01-27T09:44:33.570 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.565+0000 7fc5e3e46700 1 Processor -- start 2021-01-27T09:44:33.570 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.565+0000 7fc5e3e46700 1 -- start start 2021-01-27T09:44:33.570 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.565+0000 7fc5e3e46700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc5dc063130 0x7fc5dc153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:33.570 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.565+0000 7fc5e3e46700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5dc14bf40 0x7fc5dc158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:33.571 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.565+0000 7fc5e3e46700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5dc1521d0 0x7fc5dc164a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:33.571 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.565+0000 7fc5e3e46700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc156610 con 0x7fc5dc14bf40 2021-01-27T09:44:33.571 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.565+0000 7fc5e3e46700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc066080 con 0x7fc5dc1521d0 2021-01-27T09:44:33.571 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.565+0000 7fc5e3e46700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc1511c0 con 0x7fc5dc063130 2021-01-27T09:44:33.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.569+0000 7fc5e23e3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5dc1521d0 0x7fc5dc164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:33.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.569+0000 7fc5e1be2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc5dc063130 0x7fc5dc153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:33.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.569+0000 7fc5e23e3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5dc1521d0 0x7fc5dc164a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46252/0 (socket says 172.21.15.146:46252) 2021-01-27T09:44:33.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.569+0000 7fc5e23e3700 1 -- 172.21.15.146:0/2225061869 learned_addr learned my addr 172.21.15.146:0/2225061869 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:33.574 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.569+0000 7fc5e13e1700 1 --2- 172.21.15.146:0/2225061869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5dc14bf40 0x7fc5dc158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:33.574 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.569+0000 7fc5e23e3700 1 -- 172.21.15.146:0/2225061869 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc5dc063130 msgr2=0x7fc5dc153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:33.574 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.569+0000 7fc5e23e3700 1 --2- 172.21.15.146:0/2225061869 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc5dc063130 0x7fc5dc153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:33.574 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.569+0000 7fc5e23e3700 1 -- 172.21.15.146:0/2225061869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5dc14bf40 msgr2=0x7fc5dc158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:33.574 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.569+0000 7fc5e23e3700 1 --2- 172.21.15.146:0/2225061869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5dc14bf40 0x7fc5dc158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:33.575 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.569+0000 7fc5e23e3700 1 -- 172.21.15.146:0/2225061869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc156370 con 0x7fc5dc1521d0 2021-01-27T09:44:33.575 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.569+0000 7fc5e23e3700 1 --2- 172.21.15.146:0/2225061869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5dc1521d0 0x7fc5dc164a20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fc5d400cae0 tx=0x7fc5d4007de0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:33.575 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.569+0000 7fc5c9ffb700 1 -- 172.21.15.146:0/2225061869 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d4005af0 con 0x7fc5dc1521d0 2021-01-27T09:44:33.575 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.569+0000 7fc5c9ffb700 1 -- 172.21.15.146:0/2225061869 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d4005c50 con 0x7fc5dc1521d0 2021-01-27T09:44:33.576 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.569+0000 7fc5e3e46700 1 -- 172.21.15.146:0/2225061869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5dc165390 con 0x7fc5dc1521d0 2021-01-27T09:44:33.576 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.569+0000 7fc5c9ffb700 1 -- 172.21.15.146:0/2225061869 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d4007110 con 0x7fc5dc1521d0 2021-01-27T09:44:33.577 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.569+0000 7fc5e3e46700 1 -- 172.21.15.146:0/2225061869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5dc0b70d0 con 0x7fc5dc1521d0 2021-01-27T09:44:33.578 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.573+0000 7fc5e3e46700 1 -- 172.21.15.146:0/2225061869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5dc044ee0 con 0x7fc5dc1521d0 2021-01-27T09:44:33.578 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.573+0000 7fc5c9ffb700 1 -- 172.21.15.146:0/2225061869 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fc5d4010030 con 0x7fc5dc1521d0 2021-01-27T09:44:33.578 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.573+0000 7fc5c9ffb700 1 --2- 172.21.15.146:0/2225061869 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc5bc0561e0 0x7fc5bc0586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:33.578 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.573+0000 7fc5c9ffb700 1 -- 172.21.15.146:0/2225061869 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fc5d406f450 con 0x7fc5dc1521d0 2021-01-27T09:44:33.579 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.573+0000 7fc5e1be2700 1 --2- 172.21.15.146:0/2225061869 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc5bc0561e0 0x7fc5bc0586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:33.579 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.573+0000 7fc5e1be2700 1 --2- 172.21.15.146:0/2225061869 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc5bc0561e0 0x7fc5bc0586a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fc5d8006b90 tx=0x7fc5d8016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:33.584 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.581+0000 7fc5c9ffb700 1 -- 172.21.15.146:0/2225061869 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fc5d4044b20 con 0x7fc5dc1521d0 2021-01-27T09:44:33.757 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.753+0000 7fc5e3e46700 1 -- 172.21.15.146:0/2225061869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fc5dc063c20 con 0x7fc5dc1521d0 2021-01-27T09:44:33.771 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.769+0000 7fc5c9ffb700 1 -- 172.21.15.146:0/2225061869 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fc5d4048140 con 0x7fc5dc1521d0 2021-01-27T09:44:33.775 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.773+0000 7fc5e3e46700 1 -- 172.21.15.146:0/2225061869 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc5bc0561e0 msgr2=0x7fc5bc0586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:33.775 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.773+0000 7fc5e3e46700 1 --2- 172.21.15.146:0/2225061869 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc5bc0561e0 0x7fc5bc0586a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fc5d8006b90 tx=0x7fc5d8016000).stop 2021-01-27T09:44:33.776 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.773+0000 7fc5e3e46700 1 -- 172.21.15.146:0/2225061869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5dc1521d0 msgr2=0x7fc5dc164a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:33.776 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.773+0000 7fc5e3e46700 1 --2- 172.21.15.146:0/2225061869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5dc1521d0 0x7fc5dc164a20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fc5d400cae0 tx=0x7fc5d4007de0).stop 2021-01-27T09:44:33.776 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.773+0000 7fc5e3e46700 1 -- 172.21.15.146:0/2225061869 shutdown_connections 2021-01-27T09:44:33.776 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.773+0000 7fc5e3e46700 1 --2- 172.21.15.146:0/2225061869 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc5bc0561e0 0x7fc5bc0586a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:33.777 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.773+0000 7fc5e3e46700 1 --2- 172.21.15.146:0/2225061869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5dc1521d0 0x7fc5dc164a20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:33.777 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.773+0000 7fc5e3e46700 1 --2- 172.21.15.146:0/2225061869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5dc14bf40 0x7fc5dc158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:33.777 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.773+0000 7fc5e3e46700 1 --2- 172.21.15.146:0/2225061869 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc5dc063130 0x7fc5dc153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:33.777 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.773+0000 7fc5e3e46700 1 -- 172.21.15.146:0/2225061869 >> 172.21.15.146:0/2225061869 conn(0x7fc5dc060910 msgr2=0x7fc5dc14a910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:33.777 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.773+0000 7fc5e3e46700 1 -- 172.21.15.146:0/2225061869 shutdown_connections 2021-01-27T09:44:33.778 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.773+0000 7fc5e3e46700 1 -- 172.21.15.146:0/2225061869 wait complete. 2021-01-27T09:44:33.778 INFO:teuthology.orchestra.run.smithi146.stderr:added data pool 5 to fsmap 2021-01-27T09:44:33.801 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:44:33.974 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.973+0000 7fbf9a4ca700 1 Processor -- start 2021-01-27T09:44:33.975 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.973+0000 7fbf9a4ca700 1 -- start start 2021-01-27T09:44:33.976 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.973+0000 7fbf9a4ca700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbf94060020 0x7fbf94159960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:33.976 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.973+0000 7fbf9a4ca700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9414eb00 con 0x7fbf94069110 2021-01-27T09:44:33.976 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.973+0000 7fbf9a4ca700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf940bc060 con 0x7fbf940bb770 2021-01-27T09:44:33.977 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.973+0000 7fbf9a4ca700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf940bac80 con 0x7fbf94060020 2021-01-27T09:44:33.977 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.973+0000 7fbf937fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbf94069110 0x7fbf94067870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:33864/0 (socket says 172.21.15.146:33864) 2021-01-27T09:44:33.978 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.973+0000 7fbf937fe700 1 -- 172.21.15.146:0/2798702271 learned_addr learned my addr 172.21.15.146:0/2798702271 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:33.978 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.973+0000 7fbf98a67700 1 --2- 172.21.15.146:0/2798702271 >> v2:172.21.15.78:3300/0 conn(0x7fbf94060020 0x7fbf94159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:33.978 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.973+0000 7fbf92ffd700 1 -- 172.21.15.146:0/2798702271 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835420736 0 0) 0x7fbf9414eb00 con 0x7fbf94069110 2021-01-27T09:44:33.978 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.973+0000 7fbf92ffd700 1 -- 172.21.15.146:0/2798702271 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf80003270 con 0x7fbf94069110 2021-01-27T09:44:33.979 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.973+0000 7fbf92ffd700 1 -- 172.21.15.146:0/2798702271 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657674345 0 0) 0x7fbf84001110 con 0x7fbf940bb770 2021-01-27T09:44:33.979 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.973+0000 7fbf92ffd700 1 -- 172.21.15.146:0/2798702271 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf9414eb00 con 0x7fbf940bb770 2021-01-27T09:44:33.980 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.973+0000 7fbf98a67700 1 -- 172.21.15.146:0/2798702271 >> v1:172.21.15.146:6789/0 conn(0x7fbf940bb770 legacy=0x7fbf940bdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:33.980 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.973+0000 7fbf98a67700 1 -- 172.21.15.146:0/2798702271 >> v1:172.21.15.78:6789/0 conn(0x7fbf94069110 legacy=0x7fbf94067870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:33.980 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.977+0000 7fbf98a67700 1 -- 172.21.15.146:0/2798702271 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9414ed30 con 0x7fbf94060020 2021-01-27T09:44:33.980 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.977+0000 7fbf98a67700 1 --2- 172.21.15.146:0/2798702271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf94060020 0x7fbf94159960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fbf9414e020 tx=0x7fbf8c009220).ready entity=mon.0 client_cookie=b92e53d53c4d475b server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:33.981 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.977+0000 7fbf92ffd700 1 -- 172.21.15.146:0/2798702271 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c00b9c0 con 0x7fbf94060020 2021-01-27T09:44:33.981 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.977+0000 7fbf92ffd700 1 -- 172.21.15.146:0/2798702271 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8c00bb20 con 0x7fbf94060020 2021-01-27T09:44:33.981 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.977+0000 7fbf92ffd700 1 -- 172.21.15.146:0/2798702271 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c00bea0 con 0x7fbf94060020 2021-01-27T09:44:33.982 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.977+0000 7fbf9a4ca700 1 -- 172.21.15.146:0/2798702271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf94060020 msgr2=0x7fbf94159960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:33.982 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.977+0000 7fbf9a4ca700 1 --2- 172.21.15.146:0/2798702271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf94060020 0x7fbf94159960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fbf9414e020 tx=0x7fbf8c009220).stop 2021-01-27T09:44:33.982 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.977+0000 7fbf9a4ca700 1 -- 172.21.15.146:0/2798702271 shutdown_connections 2021-01-27T09:44:33.982 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.977+0000 7fbf9a4ca700 1 --2- 172.21.15.146:0/2798702271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf94060020 0x7fbf94159960 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:33.983 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.977+0000 7fbf9a4ca700 1 -- 172.21.15.146:0/2798702271 >> 172.21.15.146:0/2798702271 conn(0x7fbf94062810 msgr2=0x7fbf94062c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:33.983 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.977+0000 7fbf9a4ca700 1 -- 172.21.15.146:0/2798702271 shutdown_connections 2021-01-27T09:44:33.983 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.977+0000 7fbf9a4ca700 1 -- 172.21.15.146:0/2798702271 wait complete. 2021-01-27T09:44:33.984 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.981+0000 7fbf9a4ca700 1 Processor -- start 2021-01-27T09:44:33.984 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.981+0000 7fbf9a4ca700 1 -- start start 2021-01-27T09:44:33.984 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.981+0000 7fbf9a4ca700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf94060020 0x7fbf9414a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:33.985 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.981+0000 7fbf9a4ca700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf94069110 0x7fbf94060710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:33.985 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.981+0000 7fbf9a4ca700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf940bb770 0x7fbf940b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:33.985 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.981+0000 7fbf9a4ca700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9414b8c0 con 0x7fbf94069110 2021-01-27T09:44:33.985 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.981+0000 7fbf9a4ca700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9415e450 con 0x7fbf940bb770 2021-01-27T09:44:33.985 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.981+0000 7fbf9a4ca700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9415e680 con 0x7fbf94060020 2021-01-27T09:44:33.987 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.981+0000 7fbf937fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf94069110 0x7fbf94060710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:33.987 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.981+0000 7fbf93fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf94060020 0x7fbf9414a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:33.987 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.981+0000 7fbf98a67700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf940bb770 0x7fbf940b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:33.987 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.981+0000 7fbf93fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf94060020 0x7fbf9414a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:35750/0 (socket says 172.21.15.146:35750) 2021-01-27T09:44:33.988 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.981+0000 7fbf93fff700 1 -- 172.21.15.146:0/1970722004 learned_addr learned my addr 172.21.15.146:0/1970722004 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:33.988 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.981+0000 7fbf937fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf94069110 0x7fbf94060710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:49140/0 (socket says 172.21.15.146:49140) 2021-01-27T09:44:33.988 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.981+0000 7fbf98a67700 1 -- 172.21.15.146:0/1970722004 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf94060020 msgr2=0x7fbf9414a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:33.988 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.981+0000 7fbf98a67700 1 --2- 172.21.15.146:0/1970722004 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf94060020 0x7fbf9414a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:33.989 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.981+0000 7fbf98a67700 1 -- 172.21.15.146:0/1970722004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf94069110 msgr2=0x7fbf94060710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:33.989 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.981+0000 7fbf98a67700 1 --2- 172.21.15.146:0/1970722004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf94069110 0x7fbf94060710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:33.989 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.981+0000 7fbf98a67700 1 -- 172.21.15.146:0/1970722004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf940b25f0 con 0x7fbf940bb770 2021-01-27T09:44:33.989 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.981+0000 7fbf93fff700 1 --2- 172.21.15.146:0/1970722004 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf94060020 0x7fbf9414a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:33.990 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.981+0000 7fbf98a67700 1 --2- 172.21.15.146:0/1970722004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf940bb770 0x7fbf940b2fd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fbf8c014000 tx=0x7fbf8c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:33.990 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.985+0000 7fbf7bfff700 1 -- 172.21.15.146:0/1970722004 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c01a4d0 con 0x7fbf940bb770 2021-01-27T09:44:33.991 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.985+0000 7fbf7bfff700 1 -- 172.21.15.146:0/1970722004 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8c01e070 con 0x7fbf940bb770 2021-01-27T09:44:33.992 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.985+0000 7fbf7bfff700 1 -- 172.21.15.146:0/1970722004 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c01a840 con 0x7fbf940bb770 2021-01-27T09:44:33.992 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.985+0000 7fbf9a4ca700 1 -- 172.21.15.146:0/1970722004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf940b2890 con 0x7fbf940bb770 2021-01-27T09:44:33.992 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.985+0000 7fbf9a4ca700 1 -- 172.21.15.146:0/1970722004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf940be490 con 0x7fbf940bb770 2021-01-27T09:44:33.993 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.985+0000 7fbf9a4ca700 1 -- 172.21.15.146:0/1970722004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf94044ee0 con 0x7fbf940bb770 2021-01-27T09:44:33.993 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.985+0000 7fbf7bfff700 1 -- 172.21.15.146:0/1970722004 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fbf8c00f070 con 0x7fbf940bb770 2021-01-27T09:44:33.994 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.989+0000 7fbf7bfff700 1 --2- 172.21.15.146:0/1970722004 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbf740561b0 0x7fbf74058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:33.994 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.989+0000 7fbf7bfff700 1 -- 172.21.15.146:0/1970722004 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fbf8c071310 con 0x7fbf940bb770 2021-01-27T09:44:33.994 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.989+0000 7fbf93fff700 1 --2- 172.21.15.146:0/1970722004 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbf740561b0 0x7fbf74058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:33.994 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.989+0000 7fbf93fff700 1 --2- 172.21.15.146:0/1970722004 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbf740561b0 0x7fbf74058670 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fbf84007fd0 tx=0x7fbf84007940).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:33.995 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:33.993+0000 7fbf7bfff700 1 -- 172.21.15.146:0/1970722004 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fbf8c046930 con 0x7fbf940bb770 2021-01-27T09:44:34.165 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.161+0000 7fbf9a4ca700 1 -- 172.21.15.146:0/1970722004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf94149590 con 0x7fbf940bb770 2021-01-27T09:44:34.166 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.161+0000 7fbf7bfff700 1 -- 172.21.15.146:0/1970722004 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3541 (secure 0 0 0) 0x7fbf8c049f50 con 0x7fbf940bb770 2021-01-27T09:44:34.167 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:44:34.167 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":5},{"gid":4241,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/745099427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":745099427},{"type":"v1","addr":"172.21.15.146:6837","nonce":745099427}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:44:33.763837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2021-01-27T09:44:34.169 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.165+0000 7fbf9a4ca700 1 -- 172.21.15.146:0/1970722004 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbf740561b0 msgr2=0x7fbf74058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:34.169 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.165+0000 7fbf9a4ca700 1 --2- 172.21.15.146:0/1970722004 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbf740561b0 0x7fbf74058670 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fbf84007fd0 tx=0x7fbf84007940).stop 2021-01-27T09:44:34.170 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.165+0000 7fbf9a4ca700 1 -- 172.21.15.146:0/1970722004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf940bb770 msgr2=0x7fbf940b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:34.170 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.165+0000 7fbf9a4ca700 1 --2- 172.21.15.146:0/1970722004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf940bb770 0x7fbf940b2fd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fbf8c014000 tx=0x7fbf8c017000).stop 2021-01-27T09:44:34.170 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.165+0000 7fbf9a4ca700 1 -- 172.21.15.146:0/1970722004 shutdown_connections 2021-01-27T09:44:34.171 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.165+0000 7fbf9a4ca700 1 --2- 172.21.15.146:0/1970722004 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbf740561b0 0x7fbf74058670 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:34.171 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.165+0000 7fbf9a4ca700 1 --2- 172.21.15.146:0/1970722004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf940bb770 0x7fbf940b2fd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:34.171 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.165+0000 7fbf9a4ca700 1 --2- 172.21.15.146:0/1970722004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf94069110 0x7fbf94060710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:34.172 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.165+0000 7fbf9a4ca700 1 --2- 172.21.15.146:0/1970722004 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf94060020 0x7fbf9414a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:34.172 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.165+0000 7fbf9a4ca700 1 -- 172.21.15.146:0/1970722004 >> 172.21.15.146:0/1970722004 conn(0x7fbf94062810 msgr2=0x7fbf940c0990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:34.173 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.165+0000 7fbf9a4ca700 1 -- 172.21.15.146:0/1970722004 shutdown_connections 2021-01-27T09:44:34.173 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.165+0000 7fbf9a4ca700 1 -- 172.21.15.146:0/1970722004 wait complete. 2021-01-27T09:44:34.174 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 7 2021-01-27T09:44:34.193 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-01-27T09:44:34.352 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.349+0000 7fa0dd788700 1 Processor -- start 2021-01-27T09:44:34.352 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.349+0000 7fa0dd788700 1 -- start start 2021-01-27T09:44:34.353 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.349+0000 7fa0dd788700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa0d8069690 0x7fa0d8066cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:34.354 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.349+0000 7fa0dd788700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d8067340 con 0x7fa0d80be110 2021-01-27T09:44:34.354 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.349+0000 7fa0dd788700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d80675e0 con 0x7fa0d80692b0 2021-01-27T09:44:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.349+0000 7fa0dd788700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d8067880 con 0x7fa0d8069690 2021-01-27T09:44:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.353+0000 7fa0d7fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa0d80692b0 0x7fa0d814e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45844/0 (socket says 172.21.15.146:45844) 2021-01-27T09:44:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.353+0000 7fa0d7fff700 1 -- 172.21.15.146:0/2765401400 learned_addr learned my addr 172.21.15.146:0/2765401400 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.353+0000 7fa0dcf87700 1 --2- 172.21.15.146:0/2765401400 >> v2:172.21.15.78:3300/0 conn(0x7fa0d8069690 0x7fa0d8066cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:34.356 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.353+0000 7fa0d6ffd700 1 -- 172.21.15.146:0/2765401400 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2796166241 0 0) 0x7fa0d80675e0 con 0x7fa0d80692b0 2021-01-27T09:44:34.356 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.353+0000 7fa0d6ffd700 1 -- 172.21.15.146:0/2765401400 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0c4003270 con 0x7fa0d80692b0 2021-01-27T09:44:34.357 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.353+0000 7fa0dcf87700 1 -- 172.21.15.146:0/2765401400 >> v1:172.21.15.146:6789/0 conn(0x7fa0d80692b0 legacy=0x7fa0d814e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:34.357 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.353+0000 7fa0d6ffd700 1 -- 172.21.15.146:0/2765401400 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617317884 0 0) 0x7fa0d8067340 con 0x7fa0d80be110 2021-01-27T09:44:34.357 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.353+0000 7fa0dcf87700 1 -- 172.21.15.146:0/2765401400 >> v1:172.21.15.78:6789/0 conn(0x7fa0d80be110 legacy=0x7fa0d8065ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:34.357 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.353+0000 7fa0dcf87700 1 -- 172.21.15.146:0/2765401400 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d814dbe0 con 0x7fa0d8069690 2021-01-27T09:44:34.358 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.353+0000 7fa0dcf87700 1 --2- 172.21.15.146:0/2765401400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0d8069690 0x7fa0d8066cb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fa0d0009cc0 tx=0x7fa0d0009220).ready entity=mon.0 client_cookie=d56eced0e5e026d5 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:34.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.353+0000 7fa0d6ffd700 1 -- 172.21.15.146:0/2765401400 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d000baa0 con 0x7fa0d8069690 2021-01-27T09:44:34.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.353+0000 7fa0d6ffd700 1 -- 172.21.15.146:0/2765401400 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d000bc00 con 0x7fa0d8069690 2021-01-27T09:44:34.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.353+0000 7fa0d6ffd700 1 -- 172.21.15.146:0/2765401400 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0011400 con 0x7fa0d8069690 2021-01-27T09:44:34.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.353+0000 7fa0dd788700 1 -- 172.21.15.146:0/2765401400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0d8069690 msgr2=0x7fa0d8066cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:34.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.353+0000 7fa0dd788700 1 --2- 172.21.15.146:0/2765401400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0d8069690 0x7fa0d8066cb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fa0d0009cc0 tx=0x7fa0d0009220).stop 2021-01-27T09:44:34.360 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.353+0000 7fa0dd788700 1 -- 172.21.15.146:0/2765401400 shutdown_connections 2021-01-27T09:44:34.360 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.353+0000 7fa0dd788700 1 --2- 172.21.15.146:0/2765401400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0d8069690 0x7fa0d8066cb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:34.360 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.353+0000 7fa0dd788700 1 -- 172.21.15.146:0/2765401400 >> 172.21.15.146:0/2765401400 conn(0x7fa0d8064240 msgr2=0x7fa0d80601f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:34.360 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.353+0000 7fa0dd788700 1 -- 172.21.15.146:0/2765401400 shutdown_connections 2021-01-27T09:44:34.361 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.353+0000 7fa0dd788700 1 -- 172.21.15.146:0/2765401400 wait complete. 2021-01-27T09:44:34.361 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.357+0000 7fa0dd788700 1 Processor -- start 2021-01-27T09:44:34.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.357+0000 7fa0dd788700 1 -- start start 2021-01-27T09:44:34.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.357+0000 7fa0dd788700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0d80692b0 0x7fa0d8161090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:34.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.357+0000 7fa0dd788700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0d8069690 0x7fa0d80ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:34.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.357+0000 7fa0dd788700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0d80be110 0x7fa0d8146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:34.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.357+0000 7fa0dd788700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d815d0e0 con 0x7fa0d80be110 2021-01-27T09:44:34.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.357+0000 7fa0dd788700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d8161580 con 0x7fa0d80692b0 2021-01-27T09:44:34.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.357+0000 7fa0dd788700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d815d2d0 con 0x7fa0d8069690 2021-01-27T09:44:34.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.357+0000 7fa0d7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0d80692b0 0x7fa0d8161090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:34.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.357+0000 7fa0d7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0d80692b0 0x7fa0d8161090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46278/0 (socket says 172.21.15.146:46278) 2021-01-27T09:44:34.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.357+0000 7fa0d7fff700 1 -- 172.21.15.146:0/3294105525 learned_addr learned my addr 172.21.15.146:0/3294105525 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:34.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.357+0000 7fa0d77fe700 1 --2- 172.21.15.146:0/3294105525 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0d8069690 0x7fa0d80ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:34.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.357+0000 7fa0dcf87700 1 --2- 172.21.15.146:0/3294105525 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0d80be110 0x7fa0d8146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:34.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.361+0000 7fa0d7fff700 1 -- 172.21.15.146:0/3294105525 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0d8069690 msgr2=0x7fa0d80ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:34.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.361+0000 7fa0d7fff700 1 --2- 172.21.15.146:0/3294105525 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0d8069690 0x7fa0d80ae5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:34.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.361+0000 7fa0d7fff700 1 -- 172.21.15.146:0/3294105525 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0d80be110 msgr2=0x7fa0d8146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.361+0000 7fa0d7fff700 1 --2- 172.21.15.146:0/3294105525 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0d80be110 0x7fa0d8146700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.361+0000 7fa0d7fff700 1 -- 172.21.15.146:0/3294105525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d815d570 con 0x7fa0d80692b0 2021-01-27T09:44:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.361+0000 7fa0d7fff700 1 --2- 172.21.15.146:0/3294105525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0d80692b0 0x7fa0d8161090 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fa0c800c740 tx=0x7fa0c8007a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:34.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.361+0000 7fa0bffff700 1 -- 172.21.15.146:0/3294105525 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c80072e0 con 0x7fa0d80692b0 2021-01-27T09:44:34.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.361+0000 7fa0dd788700 1 -- 172.21.15.146:0/3294105525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d815d810 con 0x7fa0d80692b0 2021-01-27T09:44:34.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.361+0000 7fa0bffff700 1 -- 172.21.15.146:0/3294105525 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c8007440 con 0x7fa0d80692b0 2021-01-27T09:44:34.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.361+0000 7fa0bffff700 1 -- 172.21.15.146:0/3294105525 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8005850 con 0x7fa0d80692b0 2021-01-27T09:44:34.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.361+0000 7fa0dd788700 1 -- 172.21.15.146:0/3294105525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d815dd50 con 0x7fa0d80692b0 2021-01-27T09:44:34.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.365+0000 7fa0dd788700 1 -- 172.21.15.146:0/3294105525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d8063d90 con 0x7fa0d80692b0 2021-01-27T09:44:34.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.365+0000 7fa0bffff700 1 -- 172.21.15.146:0/3294105525 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fa0c8010070 con 0x7fa0d80692b0 2021-01-27T09:44:34.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.365+0000 7fa0bffff700 1 --2- 172.21.15.146:0/3294105525 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa0b80561e0 0x7fa0b80586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:34.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.365+0000 7fa0bffff700 1 -- 172.21.15.146:0/3294105525 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fa0c806ec30 con 0x7fa0d80692b0 2021-01-27T09:44:34.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.365+0000 7fa0d77fe700 1 --2- 172.21.15.146:0/3294105525 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa0b80561e0 0x7fa0b80586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:34.373 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.369+0000 7fa0d77fe700 1 --2- 172.21.15.146:0/3294105525 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa0b80561e0 0x7fa0b80586a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa0cc003740 tx=0x7fa0cc007bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:34.375 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.373+0000 7fa0bffff700 1 -- 172.21.15.146:0/3294105525 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fa0c8044170 con 0x7fa0d80692b0 2021-01-27T09:44:34.519 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.517+0000 7fa0dd788700 1 -- 172.21.15.146:0/3294105525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0d8044680 con 0x7fa0d80692b0 2021-01-27T09:44:34.521 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.517+0000 7fa0bffff700 1 -- 172.21.15.146:0/3294105525 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18638 (secure 0 0 0) 0x7fa0c8047790 con 0x7fa0d80692b0 2021-01-27T09:44:34.522 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:44:34.523 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":26,"fsid":"968a1bec-aac5-444e-b70f-7770587be945","created":"2021-01-27T09:44:13.797940+0000","modified":"2021-01-27T09:44:33.763400+0000","last_up_change":"2021-01-27T09:44:23.479967+0000","last_in_change":"2021-01-27T09:44:23.479967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T09:44:18.497521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-27T09:44:24.550303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-27T09:44:27.607542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-27T09:44:28.331389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-01-27T09:44:31.378452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25441909-a40b-4d82-828d-326685513ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":14470},{"type":"v1","addr":"172.21.15.146:6801","nonce":14470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":14470},{"type":"v1","addr":"172.21.15.146:6803","nonce":14470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":14470},{"type":"v1","addr":"172.21.15.146:6810","nonce":14470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":14470},{"type":"v1","addr":"172.21.15.146:6807","nonce":14470}]},"public_addr":"172.21.15.146:6801/14470","cluster_addr":"172.21.15.146:6803/14470","heartbeat_back_addr":"172.21.15.146:6810/14470","heartbeat_front_addr":"172.21.15.146:6807/14470","state":["exists","up"]},{"osd":1,"uuid":"825bbc51-2ffe-4612-a300-00960e48be02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":14472},{"type":"v1","addr":"172.21.15.146:6817","nonce":14472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":14472},{"type":"v1","addr":"172.21.15.146:6819","nonce":14472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":14472},{"type":"v1","addr":"172.21.15.146:6827","nonce":14472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":14472},{"type":"v1","addr":"172.21.15.146:6823","nonce":14472}]},"public_addr":"172.21.15.146:6817/14472","cluster_addr":"172.21.15.146:6819/14472","heartbeat_back_addr":"172.21.15.146:6827/14472","heartbeat_front_addr":"172.21.15.146:6823/14472","state":["exists","up"]},{"osd":2,"uuid":"e568b97a-8e71-4ab9-bd64-056892110b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":14474},{"type":"v1","addr":"172.21.15.146:6822","nonce":14474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":14474},{"type":"v1","addr":"172.21.15.146:6826","nonce":14474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":14474},{"type":"v1","addr":"172.21.15.146:6831","nonce":14474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":14474},{"type":"v1","addr":"172.21.15.146:6829","nonce":14474}]},"public_addr":"172.21.15.146:6822/14474","cluster_addr":"172.21.15.146:6826/14474","heartbeat_back_addr":"172.21.15.146:6831/14474","heartbeat_front_addr":"172.21.15.146:6829/14474","state":["exists","up"]},{"osd":3,"uuid":"f5d50f63-f74a-4aea-a62d-51c38db4d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":14471},{"type":"v1","addr":"172.21.15.146:6806","nonce":14471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":14471},{"type":"v1","addr":"172.21.15.146:6811","nonce":14471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":14471},{"type":"v1","addr":"172.21.15.146:6815","nonce":14471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":14471},{"type":"v1","addr":"172.21.15.146:6813","nonce":14471}]},"public_addr":"172.21.15.146:6806/14471","cluster_addr":"172.21.15.146:6811/14471","heartbeat_back_addr":"172.21.15.146:6815/14471","heartbeat_front_addr":"172.21.15.146:6813/14471","state":["exists","up"]},{"osd":4,"uuid":"782458d7-6f52-48f4-9466-67b61ef27016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":15826},{"type":"v1","addr":"172.21.15.78:6817","nonce":15826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":15826},{"type":"v1","addr":"172.21.15.78:6819","nonce":15826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":15826},{"type":"v1","addr":"172.21.15.78:6823","nonce":15826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":15826},{"type":"v1","addr":"172.21.15.78:6821","nonce":15826}]},"public_addr":"172.21.15.78:6817/15826","cluster_addr":"172.21.15.78:6819/15826","heartbeat_back_addr":"172.21.15.78:6823/15826","heartbeat_front_addr":"172.21.15.78:6821/15826","state":["exists","up"]},{"osd":5,"uuid":"1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":15827},{"type":"v1","addr":"172.21.15.78:6801","nonce":15827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":15827},{"type":"v1","addr":"172.21.15.78:6803","nonce":15827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":15827},{"type":"v1","addr":"172.21.15.78:6807","nonce":15827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":15827},{"type":"v1","addr":"172.21.15.78:6805","nonce":15827}]},"public_addr":"172.21.15.78:6801/15827","cluster_addr":"172.21.15.78:6803/15827","heartbeat_back_addr":"172.21.15.78:6807/15827","heartbeat_front_addr":"172.21.15.78:6805/15827","state":["exists","up"]},{"osd":6,"uuid":"4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":15825},{"type":"v1","addr":"172.21.15.78:6809","nonce":15825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":15825},{"type":"v1","addr":"172.21.15.78:6811","nonce":15825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":15825},{"type":"v1","addr":"172.21.15.78:6815","nonce":15825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":15825},{"type":"v1","addr":"172.21.15.78:6813","nonce":15825}]},"public_addr":"172.21.15.78:6809/15825","cluster_addr":"172.21.15.78:6811/15825","heartbeat_back_addr":"172.21.15.78:6815/15825","heartbeat_front_addr":"172.21.15.78:6813/15825","state":["exists","up"]},{"osd":7,"uuid":"851aeaf3-bcdc-4ac6-b578-c42e1bf87c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":15828},{"type":"v1","addr":"172.21.15.78:6825","nonce":15828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":15828},{"type":"v1","addr":"172.21.15.78:6827","nonce":15828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":15828},{"type":"v1","addr":"172.21.15.78:6831","nonce":15828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":15828},{"type":"v1","addr":"172.21.15.78:6829","nonce":15828}]},"public_addr":"172.21.15.78:6825/15828","cluster_addr":"172.21.15.78:6827/15828","heartbeat_back_addr":"172.21.15.78:6831/15828","heartbeat_front_addr":"172.21.15.78:6829/15828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.573930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.718144+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.641838+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.551598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.374444+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.171108+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.360910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.356020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:44:34.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.521+0000 7fa0dd788700 1 -- 172.21.15.146:0/3294105525 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa0b80561e0 msgr2=0x7fa0b80586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:34.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.521+0000 7fa0dd788700 1 --2- 172.21.15.146:0/3294105525 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa0b80561e0 0x7fa0b80586a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa0cc003740 tx=0x7fa0cc007bc0).stop 2021-01-27T09:44:34.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.521+0000 7fa0dd788700 1 -- 172.21.15.146:0/3294105525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0d80692b0 msgr2=0x7fa0d8161090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:34.525 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.521+0000 7fa0dd788700 1 --2- 172.21.15.146:0/3294105525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0d80692b0 0x7fa0d8161090 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fa0c800c740 tx=0x7fa0c8007a90).stop 2021-01-27T09:44:34.525 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.521+0000 7fa0dd788700 1 -- 172.21.15.146:0/3294105525 shutdown_connections 2021-01-27T09:44:34.525 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.521+0000 7fa0dd788700 1 --2- 172.21.15.146:0/3294105525 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0d80be110 0x7fa0d8146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:34.525 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.521+0000 7fa0dd788700 1 --2- 172.21.15.146:0/3294105525 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0d8069690 0x7fa0d80ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:34.526 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.521+0000 7fa0dd788700 1 --2- 172.21.15.146:0/3294105525 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa0b80561e0 0x7fa0b80586a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:34.526 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.521+0000 7fa0dd788700 1 --2- 172.21.15.146:0/3294105525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0d80692b0 0x7fa0d8161090 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:34.526 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.521+0000 7fa0dd788700 1 -- 172.21.15.146:0/3294105525 >> 172.21.15.146:0/3294105525 conn(0x7fa0d8064240 msgr2=0x7fa0d814bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:34.527 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.521+0000 7fa0dd788700 1 -- 172.21.15.146:0/3294105525 shutdown_connections 2021-01-27T09:44:34.527 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.521+0000 7fa0dd788700 1 -- 172.21.15.146:0/3294105525 wait complete. 2021-01-27T09:44:34.555 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-01-27T09:44:34.721 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.717+0000 7f3091494700 1 Processor -- start 2021-01-27T09:44:34.722 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.717+0000 7f3091494700 1 -- start start 2021-01-27T09:44:34.723 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.721+0000 7f3091494700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f308c063a50 0x7f308c14f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:34.723 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.721+0000 7f3091494700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f308c0be8e0 con 0x7f308c0614a0 2021-01-27T09:44:34.723 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.721+0000 7f3091494700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f308c0bb7e0 con 0x7f308c062c20 2021-01-27T09:44:34.723 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.721+0000 7f3091494700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f308c1521c0 con 0x7f308c063a50 2021-01-27T09:44:34.724 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.721+0000 7f308bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f308c063a50 0x7f308c14f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:34.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.721+0000 7f308bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f308c063a50 0x7f308c14f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46290/0 (socket says 172.21.15.146:46290) 2021-01-27T09:44:34.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.721+0000 7f308bfff700 1 -- 172.21.15.146:0/1212031918 learned_addr learned my addr 172.21.15.146:0/1212031918 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:34.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.721+0000 7f308bfff700 1 -- 172.21.15.146:0/1212031918 >> v1:172.21.15.146:6789/0 conn(0x7f308c062c20 legacy=0x7f308c14ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:34.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.721+0000 7f308bfff700 1 -- 172.21.15.146:0/1212031918 >> v1:172.21.15.78:6789/0 conn(0x7f308c0614a0 legacy=0x7f308c0be1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:34.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.721+0000 7f308bfff700 1 -- 172.21.15.146:0/1212031918 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308c1523b0 con 0x7f308c063a50 2021-01-27T09:44:34.726 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.721+0000 7f308bfff700 1 --2- 172.21.15.146:0/1212031918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f308c063a50 0x7f308c14f4a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f3084009df0 tx=0x7f30840092d0).ready entity=mon.1 client_cookie=6e9b6813ff300b7b server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:34.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.721+0000 7f3089ffb700 1 -- 172.21.15.146:0/1212031918 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308400bb70 con 0x7f308c063a50 2021-01-27T09:44:34.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.721+0000 7f3089ffb700 1 -- 172.21.15.146:0/1212031918 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308400bcd0 con 0x7f308c063a50 2021-01-27T09:44:34.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.721+0000 7f3089ffb700 1 -- 172.21.15.146:0/1212031918 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3084011610 con 0x7f308c063a50 2021-01-27T09:44:34.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.721+0000 7f3091494700 1 -- 172.21.15.146:0/1212031918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f308c063a50 msgr2=0x7f308c14f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:34.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.721+0000 7f3091494700 1 --2- 172.21.15.146:0/1212031918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f308c063a50 0x7f308c14f4a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f3084009df0 tx=0x7f30840092d0).stop 2021-01-27T09:44:34.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.721+0000 7f3091494700 1 -- 172.21.15.146:0/1212031918 shutdown_connections 2021-01-27T09:44:34.729 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.721+0000 7f3091494700 1 --2- 172.21.15.146:0/1212031918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f308c063a50 0x7f308c14f4a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:34.729 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.721+0000 7f3091494700 1 -- 172.21.15.146:0/1212031918 >> 172.21.15.146:0/1212031918 conn(0x7f308c062810 msgr2=0x7f308c063330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:34.729 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.725+0000 7f3091494700 1 -- 172.21.15.146:0/1212031918 shutdown_connections 2021-01-27T09:44:34.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.725+0000 7f3091494700 1 -- 172.21.15.146:0/1212031918 wait complete. 2021-01-27T09:44:34.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.725+0000 7f3091494700 1 Processor -- start 2021-01-27T09:44:34.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.725+0000 7f3091494700 1 -- start start 2021-01-27T09:44:34.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.729+0000 7f3091494700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f308c0614a0 0x7f308c1659e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:34.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.729+0000 7f3091494700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f308c062c20 0x7f308c14c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:34.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.729+0000 7f3091494700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f308c063a50 0x7f308c0b7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:34.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.729+0000 7f3091494700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308c165ed0 con 0x7f308c062c20 2021-01-27T09:44:34.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.729+0000 7f3091494700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308c0b67a0 con 0x7f308c0614a0 2021-01-27T09:44:34.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.729+0000 7f3091494700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308c0be710 con 0x7f308c063a50 2021-01-27T09:44:34.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.729+0000 7f308affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f308c0614a0 0x7f308c1659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:34.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.729+0000 7f308affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f308c0614a0 0x7f308c1659e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46292/0 (socket says 172.21.15.146:46292) 2021-01-27T09:44:34.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.729+0000 7f308affd700 1 -- 172.21.15.146:0/3006140916 learned_addr learned my addr 172.21.15.146:0/3006140916 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:34.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.729+0000 7f308a7fc700 1 --2- 172.21.15.146:0/3006140916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f308c062c20 0x7f308c14c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:34.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.729+0000 7f308bfff700 1 --2- 172.21.15.146:0/3006140916 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f308c063a50 0x7f308c0b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:34.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.729+0000 7f308affd700 1 -- 172.21.15.146:0/3006140916 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f308c063a50 msgr2=0x7f308c0b7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:34.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.729+0000 7f308affd700 1 --2- 172.21.15.146:0/3006140916 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f308c063a50 0x7f308c0b7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:34.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.729+0000 7f308affd700 1 -- 172.21.15.146:0/3006140916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f308c062c20 msgr2=0x7f308c14c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:34.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.729+0000 7f308affd700 1 --2- 172.21.15.146:0/3006140916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f308c062c20 0x7f308c14c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:34.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.729+0000 7f308affd700 1 -- 172.21.15.146:0/3006140916 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308c0be470 con 0x7f308c0614a0 2021-01-27T09:44:34.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.729+0000 7f308bfff700 1 --2- 172.21.15.146:0/3006140916 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f308c063a50 0x7f308c0b7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:44:34.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.729+0000 7f308affd700 1 --2- 172.21.15.146:0/3006140916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f308c0614a0 0x7f308c1659e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f307c00c6e0 tx=0x7f307c007c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:34.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.729+0000 7f3072ffd700 1 -- 172.21.15.146:0/3006140916 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307c007020 con 0x7f308c0614a0 2021-01-27T09:44:34.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.729+0000 7f3072ffd700 1 -- 172.21.15.146:0/3006140916 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307c007180 con 0x7f308c0614a0 2021-01-27T09:44:34.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.729+0000 7f3091494700 1 -- 172.21.15.146:0/3006140916 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f308c0b6a00 con 0x7f308c0614a0 2021-01-27T09:44:34.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.729+0000 7f3072ffd700 1 -- 172.21.15.146:0/3006140916 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307c006570 con 0x7f308c0614a0 2021-01-27T09:44:34.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.729+0000 7f3091494700 1 -- 172.21.15.146:0/3006140916 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f308c0b6f40 con 0x7f308c0614a0 2021-01-27T09:44:34.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.733+0000 7f3091494700 1 -- 172.21.15.146:0/3006140916 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f308c044ee0 con 0x7f308c0614a0 2021-01-27T09:44:34.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.733+0000 7f3072ffd700 1 -- 172.21.15.146:0/3006140916 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f307c010070 con 0x7f308c0614a0 2021-01-27T09:44:34.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.733+0000 7f3072ffd700 1 --2- 172.21.15.146:0/3006140916 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f306c056210 0x7f306c0586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:34.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.733+0000 7f3072ffd700 1 -- 172.21.15.146:0/3006140916 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f307c06e7b0 con 0x7f308c0614a0 2021-01-27T09:44:34.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.733+0000 7f308a7fc700 1 --2- 172.21.15.146:0/3006140916 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f306c056210 0x7f306c0586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:34.740 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.733+0000 7f308a7fc700 1 --2- 172.21.15.146:0/3006140916 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f306c056210 0x7f306c0586d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f308c14cab0 tx=0x7f3080009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:34.742 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.741+0000 7f3072ffd700 1 -- 172.21.15.146:0/3006140916 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f307c043e60 con 0x7f308c0614a0 2021-01-27T09:44:34.884 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.881+0000 7f3091494700 1 -- 172.21.15.146:0/3006140916 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f308c0be8e0 con 0x7f308c0614a0 2021-01-27T09:44:34.886 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.881+0000 7f3072ffd700 1 -- 172.21.15.146:0/3006140916 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18638 (secure 0 0 0) 0x7f307c0248e0 con 0x7f308c0614a0 2021-01-27T09:44:34.887 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:44:34.887 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":26,"fsid":"968a1bec-aac5-444e-b70f-7770587be945","created":"2021-01-27T09:44:13.797940+0000","modified":"2021-01-27T09:44:33.763400+0000","last_up_change":"2021-01-27T09:44:23.479967+0000","last_in_change":"2021-01-27T09:44:23.479967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T09:44:18.497521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-27T09:44:24.550303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-27T09:44:27.607542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-27T09:44:28.331389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-01-27T09:44:31.378452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25441909-a40b-4d82-828d-326685513ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":14470},{"type":"v1","addr":"172.21.15.146:6801","nonce":14470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":14470},{"type":"v1","addr":"172.21.15.146:6803","nonce":14470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":14470},{"type":"v1","addr":"172.21.15.146:6810","nonce":14470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":14470},{"type":"v1","addr":"172.21.15.146:6807","nonce":14470}]},"public_addr":"172.21.15.146:6801/14470","cluster_addr":"172.21.15.146:6803/14470","heartbeat_back_addr":"172.21.15.146:6810/14470","heartbeat_front_addr":"172.21.15.146:6807/14470","state":["exists","up"]},{"osd":1,"uuid":"825bbc51-2ffe-4612-a300-00960e48be02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":14472},{"type":"v1","addr":"172.21.15.146:6817","nonce":14472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":14472},{"type":"v1","addr":"172.21.15.146:6819","nonce":14472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":14472},{"type":"v1","addr":"172.21.15.146:6827","nonce":14472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":14472},{"type":"v1","addr":"172.21.15.146:6823","nonce":14472}]},"public_addr":"172.21.15.146:6817/14472","cluster_addr":"172.21.15.146:6819/14472","heartbeat_back_addr":"172.21.15.146:6827/14472","heartbeat_front_addr":"172.21.15.146:6823/14472","state":["exists","up"]},{"osd":2,"uuid":"e568b97a-8e71-4ab9-bd64-056892110b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":14474},{"type":"v1","addr":"172.21.15.146:6822","nonce":14474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":14474},{"type":"v1","addr":"172.21.15.146:6826","nonce":14474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":14474},{"type":"v1","addr":"172.21.15.146:6831","nonce":14474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":14474},{"type":"v1","addr":"172.21.15.146:6829","nonce":14474}]},"public_addr":"172.21.15.146:6822/14474","cluster_addr":"172.21.15.146:6826/14474","heartbeat_back_addr":"172.21.15.146:6831/14474","heartbeat_front_addr":"172.21.15.146:6829/14474","state":["exists","up"]},{"osd":3,"uuid":"f5d50f63-f74a-4aea-a62d-51c38db4d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":14471},{"type":"v1","addr":"172.21.15.146:6806","nonce":14471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":14471},{"type":"v1","addr":"172.21.15.146:6811","nonce":14471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":14471},{"type":"v1","addr":"172.21.15.146:6815","nonce":14471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":14471},{"type":"v1","addr":"172.21.15.146:6813","nonce":14471}]},"public_addr":"172.21.15.146:6806/14471","cluster_addr":"172.21.15.146:6811/14471","heartbeat_back_addr":"172.21.15.146:6815/14471","heartbeat_front_addr":"172.21.15.146:6813/14471","state":["exists","up"]},{"osd":4,"uuid":"782458d7-6f52-48f4-9466-67b61ef27016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":15826},{"type":"v1","addr":"172.21.15.78:6817","nonce":15826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":15826},{"type":"v1","addr":"172.21.15.78:6819","nonce":15826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":15826},{"type":"v1","addr":"172.21.15.78:6823","nonce":15826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":15826},{"type":"v1","addr":"172.21.15.78:6821","nonce":15826}]},"public_addr":"172.21.15.78:6817/15826","cluster_addr":"172.21.15.78:6819/15826","heartbeat_back_addr":"172.21.15.78:6823/15826","heartbeat_front_addr":"172.21.15.78:6821/15826","state":["exists","up"]},{"osd":5,"uuid":"1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":15827},{"type":"v1","addr":"172.21.15.78:6801","nonce":15827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":15827},{"type":"v1","addr":"172.21.15.78:6803","nonce":15827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":15827},{"type":"v1","addr":"172.21.15.78:6807","nonce":15827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":15827},{"type":"v1","addr":"172.21.15.78:6805","nonce":15827}]},"public_addr":"172.21.15.78:6801/15827","cluster_addr":"172.21.15.78:6803/15827","heartbeat_back_addr":"172.21.15.78:6807/15827","heartbeat_front_addr":"172.21.15.78:6805/15827","state":["exists","up"]},{"osd":6,"uuid":"4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":15825},{"type":"v1","addr":"172.21.15.78:6809","nonce":15825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":15825},{"type":"v1","addr":"172.21.15.78:6811","nonce":15825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":15825},{"type":"v1","addr":"172.21.15.78:6815","nonce":15825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":15825},{"type":"v1","addr":"172.21.15.78:6813","nonce":15825}]},"public_addr":"172.21.15.78:6809/15825","cluster_addr":"172.21.15.78:6811/15825","heartbeat_back_addr":"172.21.15.78:6815/15825","heartbeat_front_addr":"172.21.15.78:6813/15825","state":["exists","up"]},{"osd":7,"uuid":"851aeaf3-bcdc-4ac6-b578-c42e1bf87c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":15828},{"type":"v1","addr":"172.21.15.78:6825","nonce":15828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":15828},{"type":"v1","addr":"172.21.15.78:6827","nonce":15828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":15828},{"type":"v1","addr":"172.21.15.78:6831","nonce":15828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":15828},{"type":"v1","addr":"172.21.15.78:6829","nonce":15828}]},"public_addr":"172.21.15.78:6825/15828","cluster_addr":"172.21.15.78:6827/15828","heartbeat_back_addr":"172.21.15.78:6831/15828","heartbeat_front_addr":"172.21.15.78:6829/15828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.573930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.718144+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.641838+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.551598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.374444+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.171108+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.360910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.356020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:44:34.891 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.889+0000 7f3091494700 1 -- 172.21.15.146:0/3006140916 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f306c056210 msgr2=0x7f306c0586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:34.892 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.889+0000 7f3091494700 1 --2- 172.21.15.146:0/3006140916 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f306c056210 0x7f306c0586d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f308c14cab0 tx=0x7f3080009040).stop 2021-01-27T09:44:34.892 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.889+0000 7f3091494700 1 -- 172.21.15.146:0/3006140916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f308c0614a0 msgr2=0x7f308c1659e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:34.892 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.889+0000 7f3091494700 1 --2- 172.21.15.146:0/3006140916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f308c0614a0 0x7f308c1659e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f307c00c6e0 tx=0x7f307c007c70).stop 2021-01-27T09:44:34.893 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.889+0000 7f3091494700 1 -- 172.21.15.146:0/3006140916 shutdown_connections 2021-01-27T09:44:34.893 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.889+0000 7f3091494700 1 --2- 172.21.15.146:0/3006140916 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f308c063a50 0x7f308c0b7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:34.893 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.889+0000 7f3091494700 1 --2- 172.21.15.146:0/3006140916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f308c062c20 0x7f308c14c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:34.893 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.889+0000 7f3091494700 1 --2- 172.21.15.146:0/3006140916 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f306c056210 0x7f306c0586d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:34.893 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.889+0000 7f3091494700 1 --2- 172.21.15.146:0/3006140916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f308c0614a0 0x7f308c1659e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:34.894 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.889+0000 7f3091494700 1 -- 172.21.15.146:0/3006140916 >> 172.21.15.146:0/3006140916 conn(0x7f308c062810 msgr2=0x7f308c14d470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:34.894 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.889+0000 7f3091494700 1 -- 172.21.15.146:0/3006140916 shutdown_connections 2021-01-27T09:44:34.894 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:34.889+0000 7f3091494700 1 -- 172.21.15.146:0/3006140916 wait complete. 2021-01-27T09:44:34.930 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2021-01-27T09:44:34.931 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2021-01-27T09:44:34.932 INFO:tasks.cephfs.mount:self.client.name = client.admin 2021-01-27T09:44:34.932 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2021-01-27T09:44:34.932 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2021-01-27T09:44:34.933 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2021-01-27T09:44:34.933 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2021-01-27T09:44:34.933 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2021-01-27T09:44:34.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:44:34.934 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2021-01-27T09:44:34.954 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2021-01-27T09:44:34.955 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2021-01-27T09:44:34.955 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2021-01-27T09:44:34.955 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2021-01-27T09:44:34.955 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2021-01-27T09:44:34.956 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2021-01-27T09:44:34.956 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2021-01-27T09:44:34.956 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2021-01-27T09:44:34.956 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2021-01-27T09:44:34.957 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2021-01-27T09:44:34.957 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2021-01-27T09:44:34.957 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2021-01-27T09:44:34.957 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2021-01-27T09:44:34.957 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2021-01-27T09:44:34.958 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2021-01-27T09:44:34.958 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2021-01-27T09:44:34.958 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2021-01-27T09:44:34.958 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42793sec preferred_lft 42793sec 2021-01-27T09:44:34.958 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2021-01-27T09:44:34.959 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2021-01-27T09:44:34.959 INFO:teuthology.orchestra.run.smithi146.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2021-01-27T09:44:34.959 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 02:42:d4:7b:a0:1b brd ff:ff:ff:ff:ff:ff 2021-01-27T09:44:34.959 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2021-01-27T09:44:34.959 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2021-01-27T09:44:34.960 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2021-01-27T09:44:34.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:44:34.961 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec sudo bash -c ' 2021-01-27T09:44:34.961 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2021-01-27T09:44:34.962 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add name ceph-brx type bridge 2021-01-27T09:44:34.962 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr flush dev ceph-brx 2021-01-27T09:44:34.962 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set ceph-brx up 2021-01-27T09:44:34.963 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2021-01-27T09:44:34.963 DEBUG:teuthology.orchestra.run.smithi146:> ') 2021-01-27T09:44:35.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:44:35.103 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2021-01-27T09:44:35.137 INFO:teuthology.orchestra.run.smithi146.stdout:1 2021-01-27T09:44:35.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:44:35.141 DEBUG:teuthology.orchestra.run.smithi146:> route 2021-01-27T09:44:35.187 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2021-01-27T09:44:35.187 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2021-01-27T09:44:35.188 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2021-01-27T09:44:35.188 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2021-01-27T09:44:35.188 INFO:teuthology.orchestra.run.smithi146.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2021-01-27T09:44:35.188 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2021-01-27T09:44:35.189 INFO:teuthology.orchestra.run.smithi146.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2021-01-27T09:44:35.189 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2021-01-27T09:44:35.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:44:35.190 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec sudo bash -c ' 2021-01-27T09:44:35.191 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2021-01-27T09:44:35.191 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2021-01-27T09:44:35.192 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2021-01-27T09:44:35.192 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2021-01-27T09:44:35.193 DEBUG:teuthology.orchestra.run.smithi146:> ') 2021-01-27T09:44:35.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:44:35.471 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2021-01-27T09:44:35.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:44:35.490 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list-id 2021-01-27T09:44:35.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:44:35.509 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec sudo bash -c ' 2021-01-27T09:44:35.510 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2021-01-27T09:44:35.510 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2021-01-27T09:44:35.510 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2021-01-27T09:44:35.511 DEBUG:teuthology.orchestra.run.smithi146:> ') 2021-01-27T09:44:35.649 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2021-01-27T09:44:35.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:44:35.651 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec sudo bash -c ' 2021-01-27T09:44:35.651 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2021-01-27T09:44:35.652 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2021-01-27T09:44:35.652 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2021-01-27T09:44:35.653 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2021-01-27T09:44:35.653 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2021-01-27T09:44:35.653 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2021-01-27T09:44:35.654 DEBUG:teuthology.orchestra.run.smithi146:> ') 2021-01-27T09:44:35.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:44:35.867 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec sudo bash -c ' 2021-01-27T09:44:35.867 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2021-01-27T09:44:35.867 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2021-01-27T09:44:35.868 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set dev brx.0 master ceph-brx 2021-01-27T09:44:35.868 DEBUG:teuthology.orchestra.run.smithi146:> ') 2021-01-27T09:44:35.970 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-01-27T09:44:36.140 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.137+0000 7f4d50c88700 1 Processor -- start 2021-01-27T09:44:36.140 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.137+0000 7f4d50c88700 1 -- start start 2021-01-27T09:44:36.141 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.137+0000 7f4d50c88700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d4c069690 0x7f4d4c14c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:36.142 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.137+0000 7f4d50c88700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4d4c0b08b0 0x7f4d4c0be110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:36.142 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.137+0000 7f4d50c88700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4c14b960 con 0x7f4d4c0692b0 2021-01-27T09:44:36.142 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.137+0000 7f4d50c88700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4c0be600 con 0x7f4d4c0b08b0 2021-01-27T09:44:36.142 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.137+0000 7f4d50c88700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c067210 con 0x7f4d4c069690 2021-01-27T09:44:36.143 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.141+0000 7f4d4b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4d4c0692b0 0x7f4d4c066af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45872/0 (socket says 172.21.15.146:45872) 2021-01-27T09:44:36.144 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.141+0000 7f4d4b7fe700 1 -- 172.21.15.146:0/890868232 learned_addr learned my addr 172.21.15.146:0/890868232 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:36.144 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.141+0000 7f4d4bfff700 1 --2- 172.21.15.146:0/890868232 >> v2:172.21.15.78:3300/0 conn(0x7f4d4c0b08b0 0x7f4d4c0be110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:36.144 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.141+0000 7f4d43fff700 1 --2- 172.21.15.146:0/890868232 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d4c069690 0x7f4d4c14c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:36.144 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.141+0000 7f4d4affd700 1 -- 172.21.15.146:0/890868232 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898023328 0 0) 0x7f4d4c14b960 con 0x7f4d4c0692b0 2021-01-27T09:44:36.145 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.141+0000 7f4d4affd700 1 -- 172.21.15.146:0/890868232 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d2c003270 con 0x7f4d4c0692b0 2021-01-27T09:44:36.145 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.141+0000 7f4d4bfff700 1 -- 172.21.15.146:0/890868232 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d4c069690 msgr2=0x7f4d4c14c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:36.145 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.141+0000 7f4d4bfff700 1 --2- 172.21.15.146:0/890868232 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d4c069690 0x7f4d4c14c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:36.145 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.141+0000 7f4d4bfff700 1 -- 172.21.15.146:0/890868232 >> v1:172.21.15.146:6789/0 conn(0x7f4d4c0692b0 legacy=0x7f4d4c066af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:36.145 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.141+0000 7f4d4bfff700 1 -- 172.21.15.146:0/890868232 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c0674a0 con 0x7f4d4c0b08b0 2021-01-27T09:44:36.146 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.141+0000 7f4d4bfff700 1 --2- 172.21.15.146:0/890868232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d4c0b08b0 0x7f4d4c0be110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f4d44009cc0 tx=0x7f4d44009220).ready entity=mon.0 client_cookie=5af401cc27758e82 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:36.147 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.141+0000 7f4d4affd700 1 -- 172.21.15.146:0/890868232 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4400b960 con 0x7f4d4c0b08b0 2021-01-27T09:44:36.147 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.141+0000 7f4d4affd700 1 -- 172.21.15.146:0/890868232 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4400bac0 con 0x7f4d4c0b08b0 2021-01-27T09:44:36.147 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.141+0000 7f4d4affd700 1 -- 172.21.15.146:0/890868232 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4400be60 con 0x7f4d4c0b08b0 2021-01-27T09:44:36.147 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.141+0000 7f4d50c88700 1 -- 172.21.15.146:0/890868232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d4c0b08b0 msgr2=0x7f4d4c0be110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:36.148 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.141+0000 7f4d50c88700 1 --2- 172.21.15.146:0/890868232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d4c0b08b0 0x7f4d4c0be110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f4d44009cc0 tx=0x7f4d44009220).stop 2021-01-27T09:44:36.148 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.141+0000 7f4d50c88700 1 -- 172.21.15.146:0/890868232 shutdown_connections 2021-01-27T09:44:36.148 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.141+0000 7f4d50c88700 1 --2- 172.21.15.146:0/890868232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d4c0b08b0 0x7f4d4c0be110 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:36.148 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.141+0000 7f4d50c88700 1 --2- 172.21.15.146:0/890868232 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d4c069690 0x7f4d4c14c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:36.149 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.141+0000 7f4d50c88700 1 -- 172.21.15.146:0/890868232 >> 172.21.15.146:0/890868232 conn(0x7f4d4c064240 msgr2=0x7f4d4c0601f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:36.149 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.141+0000 7f4d50c88700 1 -- 172.21.15.146:0/890868232 shutdown_connections 2021-01-27T09:44:36.149 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.141+0000 7f4d50c88700 1 -- 172.21.15.146:0/890868232 wait complete. 2021-01-27T09:44:36.151 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.145+0000 7f4d50c88700 1 Processor -- start 2021-01-27T09:44:36.151 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.145+0000 7f4d50c88700 1 -- start start 2021-01-27T09:44:36.151 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.145+0000 7f4d50c88700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d4c0692b0 0x7f4d4c13d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:36.151 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.145+0000 7f4d50c88700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d4c069690 0x7f4d4c14ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:36.151 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.145+0000 7f4d50c88700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d4c0b08b0 0x7f4d4c0acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:36.152 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.149+0000 7f4d50c88700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c14cd60 con 0x7f4d4c069690 2021-01-27T09:44:36.152 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.149+0000 7f4d50c88700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c14d000 con 0x7f4d4c0692b0 2021-01-27T09:44:36.152 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.149+0000 7f4d50c88700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c14d2a0 con 0x7f4d4c0b08b0 2021-01-27T09:44:36.152 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.149+0000 7f4d4b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d4c0692b0 0x7f4d4c13d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:36.152 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.149+0000 7f4d4b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d4c0692b0 0x7f4d4c13d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46306/0 (socket says 172.21.15.146:46306) 2021-01-27T09:44:36.153 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.149+0000 7f4d4b7fe700 1 -- 172.21.15.146:0/3855525528 learned_addr learned my addr 172.21.15.146:0/3855525528 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:36.153 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.149+0000 7f4d43fff700 1 --2- 172.21.15.146:0/3855525528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d4c069690 0x7f4d4c14ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:36.153 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.149+0000 7f4d4bfff700 1 --2- 172.21.15.146:0/3855525528 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d4c0b08b0 0x7f4d4c0acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:36.154 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.149+0000 7f4d4b7fe700 1 -- 172.21.15.146:0/3855525528 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d4c0b08b0 msgr2=0x7f4d4c0acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:36.154 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.149+0000 7f4d4b7fe700 1 --2- 172.21.15.146:0/3855525528 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d4c0b08b0 0x7f4d4c0acf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:36.155 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.149+0000 7f4d4b7fe700 1 -- 172.21.15.146:0/3855525528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d4c069690 msgr2=0x7f4d4c14ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:36.155 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.149+0000 7f4d4b7fe700 1 --2- 172.21.15.146:0/3855525528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d4c069690 0x7f4d4c14ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:36.155 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.149+0000 7f4d4b7fe700 1 -- 172.21.15.146:0/3855525528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c14d540 con 0x7f4d4c0692b0 2021-01-27T09:44:36.155 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.149+0000 7f4d4b7fe700 1 --2- 172.21.15.146:0/3855525528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d4c0692b0 0x7f4d4c13d850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f4d3c00c770 tx=0x7f4d3c007b00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.149+0000 7f4d437fe700 1 -- 172.21.15.146:0/3855525528 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c0072e0 con 0x7f4d4c0692b0 2021-01-27T09:44:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.149+0000 7f4d437fe700 1 -- 172.21.15.146:0/3855525528 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3c007440 con 0x7f4d4c0692b0 2021-01-27T09:44:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.149+0000 7f4d50c88700 1 -- 172.21.15.146:0/3855525528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4c14d7e0 con 0x7f4d4c0692b0 2021-01-27T09:44:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.149+0000 7f4d437fe700 1 -- 172.21.15.146:0/3855525528 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c005830 con 0x7f4d4c0692b0 2021-01-27T09:44:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.149+0000 7f4d50c88700 1 -- 172.21.15.146:0/3855525528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4c13dd40 con 0x7f4d4c0692b0 2021-01-27T09:44:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.149+0000 7f4d50c88700 1 -- 172.21.15.146:0/3855525528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d4c063d90 con 0x7f4d4c0692b0 2021-01-27T09:44:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.153+0000 7f4d437fe700 1 -- 172.21.15.146:0/3855525528 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f4d3c010070 con 0x7f4d4c0692b0 2021-01-27T09:44:36.158 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.153+0000 7f4d437fe700 1 --2- 172.21.15.146:0/3855525528 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4d300561e0 0x7f4d300586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:36.158 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.153+0000 7f4d437fe700 1 -- 172.21.15.146:0/3855525528 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f4d3c06ed20 con 0x7f4d4c0692b0 2021-01-27T09:44:36.158 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.153+0000 7f4d43fff700 1 --2- 172.21.15.146:0/3855525528 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4d300561e0 0x7f4d300586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:36.158 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.157+0000 7f4d43fff700 1 --2- 172.21.15.146:0/3855525528 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4d300561e0 0x7f4d300586a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4d4c0af9d0 tx=0x7f4d34006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:36.163 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.161+0000 7f4d437fe700 1 -- 172.21.15.146:0/3855525528 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f4d3c073070 con 0x7f4d4c0692b0 2021-01-27T09:44:36.306 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.301+0000 7f4d50c88700 1 -- 172.21.15.146:0/3855525528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d4c14b890 con 0x7f4d4c0692b0 2021-01-27T09:44:36.307 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.305+0000 7f4d437fe700 1 -- 172.21.15.146:0/3855525528 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18638 (secure 0 0 0) 0x7f4d3c0443d0 con 0x7f4d4c0692b0 2021-01-27T09:44:36.308 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:44:36.308 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":26,"fsid":"968a1bec-aac5-444e-b70f-7770587be945","created":"2021-01-27T09:44:13.797940+0000","modified":"2021-01-27T09:44:33.763400+0000","last_up_change":"2021-01-27T09:44:23.479967+0000","last_in_change":"2021-01-27T09:44:23.479967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T09:44:18.497521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-27T09:44:24.550303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-27T09:44:27.607542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-27T09:44:28.331389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-01-27T09:44:31.378452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25441909-a40b-4d82-828d-326685513ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":14470},{"type":"v1","addr":"172.21.15.146:6801","nonce":14470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":14470},{"type":"v1","addr":"172.21.15.146:6803","nonce":14470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":14470},{"type":"v1","addr":"172.21.15.146:6810","nonce":14470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":14470},{"type":"v1","addr":"172.21.15.146:6807","nonce":14470}]},"public_addr":"172.21.15.146:6801/14470","cluster_addr":"172.21.15.146:6803/14470","heartbeat_back_addr":"172.21.15.146:6810/14470","heartbeat_front_addr":"172.21.15.146:6807/14470","state":["exists","up"]},{"osd":1,"uuid":"825bbc51-2ffe-4612-a300-00960e48be02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":14472},{"type":"v1","addr":"172.21.15.146:6817","nonce":14472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":14472},{"type":"v1","addr":"172.21.15.146:6819","nonce":14472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":14472},{"type":"v1","addr":"172.21.15.146:6827","nonce":14472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":14472},{"type":"v1","addr":"172.21.15.146:6823","nonce":14472}]},"public_addr":"172.21.15.146:6817/14472","cluster_addr":"172.21.15.146:6819/14472","heartbeat_back_addr":"172.21.15.146:6827/14472","heartbeat_front_addr":"172.21.15.146:6823/14472","state":["exists","up"]},{"osd":2,"uuid":"e568b97a-8e71-4ab9-bd64-056892110b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":14474},{"type":"v1","addr":"172.21.15.146:6822","nonce":14474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":14474},{"type":"v1","addr":"172.21.15.146:6826","nonce":14474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":14474},{"type":"v1","addr":"172.21.15.146:6831","nonce":14474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":14474},{"type":"v1","addr":"172.21.15.146:6829","nonce":14474}]},"public_addr":"172.21.15.146:6822/14474","cluster_addr":"172.21.15.146:6826/14474","heartbeat_back_addr":"172.21.15.146:6831/14474","heartbeat_front_addr":"172.21.15.146:6829/14474","state":["exists","up"]},{"osd":3,"uuid":"f5d50f63-f74a-4aea-a62d-51c38db4d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":14471},{"type":"v1","addr":"172.21.15.146:6806","nonce":14471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":14471},{"type":"v1","addr":"172.21.15.146:6811","nonce":14471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":14471},{"type":"v1","addr":"172.21.15.146:6815","nonce":14471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":14471},{"type":"v1","addr":"172.21.15.146:6813","nonce":14471}]},"public_addr":"172.21.15.146:6806/14471","cluster_addr":"172.21.15.146:6811/14471","heartbeat_back_addr":"172.21.15.146:6815/14471","heartbeat_front_addr":"172.21.15.146:6813/14471","state":["exists","up"]},{"osd":4,"uuid":"782458d7-6f52-48f4-9466-67b61ef27016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":15826},{"type":"v1","addr":"172.21.15.78:6817","nonce":15826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":15826},{"type":"v1","addr":"172.21.15.78:6819","nonce":15826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":15826},{"type":"v1","addr":"172.21.15.78:6823","nonce":15826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":15826},{"type":"v1","addr":"172.21.15.78:6821","nonce":15826}]},"public_addr":"172.21.15.78:6817/15826","cluster_addr":"172.21.15.78:6819/15826","heartbeat_back_addr":"172.21.15.78:6823/15826","heartbeat_front_addr":"172.21.15.78:6821/15826","state":["exists","up"]},{"osd":5,"uuid":"1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":15827},{"type":"v1","addr":"172.21.15.78:6801","nonce":15827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":15827},{"type":"v1","addr":"172.21.15.78:6803","nonce":15827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":15827},{"type":"v1","addr":"172.21.15.78:6807","nonce":15827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":15827},{"type":"v1","addr":"172.21.15.78:6805","nonce":15827}]},"public_addr":"172.21.15.78:6801/15827","cluster_addr":"172.21.15.78:6803/15827","heartbeat_back_addr":"172.21.15.78:6807/15827","heartbeat_front_addr":"172.21.15.78:6805/15827","state":["exists","up"]},{"osd":6,"uuid":"4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":15825},{"type":"v1","addr":"172.21.15.78:6809","nonce":15825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":15825},{"type":"v1","addr":"172.21.15.78:6811","nonce":15825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":15825},{"type":"v1","addr":"172.21.15.78:6815","nonce":15825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":15825},{"type":"v1","addr":"172.21.15.78:6813","nonce":15825}]},"public_addr":"172.21.15.78:6809/15825","cluster_addr":"172.21.15.78:6811/15825","heartbeat_back_addr":"172.21.15.78:6815/15825","heartbeat_front_addr":"172.21.15.78:6813/15825","state":["exists","up"]},{"osd":7,"uuid":"851aeaf3-bcdc-4ac6-b578-c42e1bf87c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":15828},{"type":"v1","addr":"172.21.15.78:6825","nonce":15828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":15828},{"type":"v1","addr":"172.21.15.78:6827","nonce":15828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":15828},{"type":"v1","addr":"172.21.15.78:6831","nonce":15828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":15828},{"type":"v1","addr":"172.21.15.78:6829","nonce":15828}]},"public_addr":"172.21.15.78:6825/15828","cluster_addr":"172.21.15.78:6827/15828","heartbeat_back_addr":"172.21.15.78:6831/15828","heartbeat_front_addr":"172.21.15.78:6829/15828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.573930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.718144+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.641838+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.551598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.374444+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.171108+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.360910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.356020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:44:36.309 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.305+0000 7f4d50c88700 1 -- 172.21.15.146:0/3855525528 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4d300561e0 msgr2=0x7f4d300586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:36.310 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.305+0000 7f4d50c88700 1 --2- 172.21.15.146:0/3855525528 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4d300561e0 0x7f4d300586a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4d4c0af9d0 tx=0x7f4d34006e20).stop 2021-01-27T09:44:36.310 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.305+0000 7f4d50c88700 1 -- 172.21.15.146:0/3855525528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d4c0692b0 msgr2=0x7f4d4c13d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:36.310 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.305+0000 7f4d50c88700 1 --2- 172.21.15.146:0/3855525528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d4c0692b0 0x7f4d4c13d850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f4d3c00c770 tx=0x7f4d3c007b00).stop 2021-01-27T09:44:36.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.305+0000 7f4d50c88700 1 -- 172.21.15.146:0/3855525528 shutdown_connections 2021-01-27T09:44:36.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.305+0000 7f4d50c88700 1 --2- 172.21.15.146:0/3855525528 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d4c0b08b0 0x7f4d4c0acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:36.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.305+0000 7f4d50c88700 1 --2- 172.21.15.146:0/3855525528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d4c069690 0x7f4d4c14ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:36.312 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.305+0000 7f4d50c88700 1 --2- 172.21.15.146:0/3855525528 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4d300561e0 0x7f4d300586a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:36.312 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.305+0000 7f4d50c88700 1 --2- 172.21.15.146:0/3855525528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d4c0692b0 0x7f4d4c13d850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:36.312 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.305+0000 7f4d50c88700 1 -- 172.21.15.146:0/3855525528 >> 172.21.15.146:0/3855525528 conn(0x7f4d4c064240 msgr2=0x7f4d4c1448f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:36.312 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.309+0000 7f4d50c88700 1 -- 172.21.15.146:0/3855525528 shutdown_connections 2021-01-27T09:44:36.313 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.309+0000 7f4d50c88700 1 -- 172.21.15.146:0/3855525528 wait complete. 2021-01-27T09:44:36.339 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-27T09:44:18.497521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-27T09:44:24.550303+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-27T09:44:27.607542+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-01-27T09:44:28.331389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2021-01-27T09:44:31.378452+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-27T09:44:36.340 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-01-27T09:44:36.515 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.513+0000 7f01740c5700 1 Processor -- start 2021-01-27T09:44:36.516 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.513+0000 7f01740c5700 1 -- start start 2021-01-27T09:44:36.518 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.513+0000 7f01740c5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f016c065260 0x7f016c0bf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:36.518 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.513+0000 7f01740c5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f016c065640 0x7f016c151d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:36.518 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.513+0000 7f01740c5700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016c0bf5c0 con 0x7f016c0bbb20 2021-01-27T09:44:36.519 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.517+0000 7f01740c5700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f016c063830 con 0x7f016c065640 2021-01-27T09:44:36.519 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.517+0000 7f01740c5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f016c0bfda0 con 0x7f016c065260 2021-01-27T09:44:36.520 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.517+0000 7f0172662700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f016c0bbb20 0x7f016c14af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:33920/0 (socket says 172.21.15.146:33920) 2021-01-27T09:44:36.520 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.517+0000 7f0172662700 1 -- 172.21.15.146:0/728338187 learned_addr learned my addr 172.21.15.146:0/728338187 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:36.520 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.517+0000 7f0171660700 1 --2- 172.21.15.146:0/728338187 >> v2:172.21.15.78:3300/0 conn(0x7f016c065640 0x7f016c151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:36.520 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.517+0000 7f0171e61700 1 --2- 172.21.15.146:0/728338187 >> v2:172.21.15.146:3300/0 conn(0x7f016c065260 0x7f016c0bf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:36.521 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.517+0000 7f0170e5f700 1 -- 172.21.15.146:0/728338187 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1502237358 0 0) 0x7f016c0bf5c0 con 0x7f016c0bbb20 2021-01-27T09:44:36.521 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.517+0000 7f0170e5f700 1 -- 172.21.15.146:0/728338187 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0154003270 con 0x7f016c0bbb20 2021-01-27T09:44:36.521 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.517+0000 7f0171660700 1 -- 172.21.15.146:0/728338187 >> v2:172.21.15.146:3300/0 conn(0x7f016c065260 msgr2=0x7f016c0bf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:36.521 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.517+0000 7f0171660700 1 --2- 172.21.15.146:0/728338187 >> v2:172.21.15.146:3300/0 conn(0x7f016c065260 0x7f016c0bf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:36.521 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.517+0000 7f0171660700 1 -- 172.21.15.146:0/728338187 >> v1:172.21.15.78:6789/0 conn(0x7f016c0bbb20 legacy=0x7f016c14af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:36.522 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.517+0000 7f0171660700 1 -- 172.21.15.146:0/728338187 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c0bf860 con 0x7f016c065640 2021-01-27T09:44:36.523 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.517+0000 7f0171660700 1 --2- 172.21.15.146:0/728338187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f016c065640 0x7f016c151d50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f016c064050 tx=0x7f015c006e20).ready entity=mon.0 client_cookie=299590350e077c46 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:36.523 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.517+0000 7f0170e5f700 1 -- 172.21.15.146:0/728338187 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015c0095c0 con 0x7f016c065640 2021-01-27T09:44:36.523 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.517+0000 7f0170e5f700 1 -- 172.21.15.146:0/728338187 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015c009720 con 0x7f016c065640 2021-01-27T09:44:36.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.517+0000 7f0170e5f700 1 -- 172.21.15.146:0/728338187 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015c009aa0 con 0x7f016c065640 2021-01-27T09:44:36.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.517+0000 7f01740c5700 1 -- 172.21.15.146:0/728338187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f016c065640 msgr2=0x7f016c151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:36.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.517+0000 7f01740c5700 1 --2- 172.21.15.146:0/728338187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f016c065640 0x7f016c151d50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f016c064050 tx=0x7f015c006e20).stop 2021-01-27T09:44:36.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.517+0000 7f01740c5700 1 -- 172.21.15.146:0/728338187 shutdown_connections 2021-01-27T09:44:36.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.517+0000 7f01740c5700 1 --2- 172.21.15.146:0/728338187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f016c065640 0x7f016c151d50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:36.525 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.517+0000 7f01740c5700 1 --2- 172.21.15.146:0/728338187 >> v2:172.21.15.146:3300/0 conn(0x7f016c065260 0x7f016c0bf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:36.525 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.517+0000 7f01740c5700 1 -- 172.21.15.146:0/728338187 >> 172.21.15.146:0/728338187 conn(0x7f016c069110 msgr2=0x7f016c067e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:36.525 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.521+0000 7f01740c5700 1 -- 172.21.15.146:0/728338187 shutdown_connections 2021-01-27T09:44:36.525 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.521+0000 7f01740c5700 1 -- 172.21.15.146:0/728338187 wait complete. 2021-01-27T09:44:36.526 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.521+0000 7f01740c5700 1 Processor -- start 2021-01-27T09:44:36.527 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.521+0000 7f01740c5700 1 -- start start 2021-01-27T09:44:36.527 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.521+0000 7f01740c5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f016c065260 0x7f016c0c2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:36.527 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.521+0000 7f01740c5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f016c065640 0x7f016c1621a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:36.527 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.521+0000 7f01740c5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f016c0bbb20 0x7f016c157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:36.527 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.521+0000 7f01740c5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c158c00 con 0x7f016c065640 2021-01-27T09:44:36.528 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.521+0000 7f01740c5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c158ea0 con 0x7f016c065260 2021-01-27T09:44:36.528 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.521+0000 7f01740c5700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016c159140 con 0x7f016c0bbb20 2021-01-27T09:44:36.528 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.525+0000 7f0171e61700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f016c065260 0x7f016c0c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:36.528 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.525+0000 7f0171e61700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f016c065260 0x7f016c0c2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46320/0 (socket says 172.21.15.146:46320) 2021-01-27T09:44:36.528 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.525+0000 7f0171e61700 1 -- 172.21.15.146:0/356147519 learned_addr learned my addr 172.21.15.146:0/356147519 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:36.529 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.525+0000 7f0171660700 1 --2- 172.21.15.146:0/356147519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f016c065640 0x7f016c1621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:36.530 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.525+0000 7f0172662700 1 --2- 172.21.15.146:0/356147519 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f016c0bbb20 0x7f016c157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:36.530 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.525+0000 7f0171e61700 1 -- 172.21.15.146:0/356147519 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f016c0bbb20 msgr2=0x7f016c157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:36.530 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.525+0000 7f0171e61700 1 --2- 172.21.15.146:0/356147519 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f016c0bbb20 0x7f016c157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:36.531 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.525+0000 7f0171e61700 1 -- 172.21.15.146:0/356147519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f016c065640 msgr2=0x7f016c1621a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:36.531 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.525+0000 7f0171e61700 1 --2- 172.21.15.146:0/356147519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f016c065640 0x7f016c1621a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:36.531 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.525+0000 7f0171e61700 1 -- 172.21.15.146:0/356147519 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c1593e0 con 0x7f016c065260 2021-01-27T09:44:36.531 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.525+0000 7f0172662700 1 --2- 172.21.15.146:0/356147519 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f016c0bbb20 0x7f016c157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:44:36.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.525+0000 7f0171e61700 1 --2- 172.21.15.146:0/356147519 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f016c065260 0x7f016c0c2480 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f016800ebd0 tx=0x7f0168006e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:36.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.525+0000 7f0159ffb700 1 -- 172.21.15.146:0/356147519 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016800c920 con 0x7f016c065260 2021-01-27T09:44:36.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.525+0000 7f01740c5700 1 -- 172.21.15.146:0/356147519 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f016c159680 con 0x7f016c065260 2021-01-27T09:44:36.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.525+0000 7f0159ffb700 1 -- 172.21.15.146:0/356147519 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016800ca80 con 0x7f016c065260 2021-01-27T09:44:36.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.525+0000 7f0159ffb700 1 -- 172.21.15.146:0/356147519 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016800ce00 con 0x7f016c065260 2021-01-27T09:44:36.533 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.525+0000 7f01740c5700 1 -- 172.21.15.146:0/356147519 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f016c0c2ad0 con 0x7f016c065260 2021-01-27T09:44:36.533 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.525+0000 7f01740c5700 1 -- 172.21.15.146:0/356147519 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f016c044ee0 con 0x7f016c065260 2021-01-27T09:44:36.534 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.529+0000 7f0159ffb700 1 -- 172.21.15.146:0/356147519 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f0168012600 con 0x7f016c065260 2021-01-27T09:44:36.534 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.529+0000 7f0159ffb700 1 --2- 172.21.15.146:0/356147519 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f014c0561e0 0x7f014c0586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:36.534 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.529+0000 7f0159ffb700 1 -- 172.21.15.146:0/356147519 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f016806f960 con 0x7f016c065260 2021-01-27T09:44:36.534 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.529+0000 7f0171660700 1 --2- 172.21.15.146:0/356147519 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f014c0561e0 0x7f014c0586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:36.535 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.529+0000 7f0171660700 1 --2- 172.21.15.146:0/356147519 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f014c0561e0 0x7f014c0586a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f016c065a90 tx=0x7f015c016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:36.538 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.537+0000 7f0159ffb700 1 -- 172.21.15.146:0/356147519 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f0168045010 con 0x7f016c065260 2021-01-27T09:44:36.688 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.685+0000 7f01740c5700 1 -- 172.21.15.146:0/356147519 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f016c085180 con 0x7f016c065260 2021-01-27T09:44:36.689 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.685+0000 7f0159ffb700 1 -- 172.21.15.146:0/356147519 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0168048630 con 0x7f016c065260 2021-01-27T09:44:36.689 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2021-01-27T09:44:36.691 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.689+0000 7f01740c5700 1 -- 172.21.15.146:0/356147519 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f014c0561e0 msgr2=0x7f014c0586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:36.691 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.689+0000 7f01740c5700 1 --2- 172.21.15.146:0/356147519 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f014c0561e0 0x7f014c0586a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f016c065a90 tx=0x7f015c016000).stop 2021-01-27T09:44:36.692 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.689+0000 7f01740c5700 1 -- 172.21.15.146:0/356147519 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f016c065260 msgr2=0x7f016c0c2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:36.692 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.689+0000 7f01740c5700 1 --2- 172.21.15.146:0/356147519 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f016c065260 0x7f016c0c2480 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f016800ebd0 tx=0x7f0168006e20).stop 2021-01-27T09:44:36.692 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.689+0000 7f01740c5700 1 -- 172.21.15.146:0/356147519 shutdown_connections 2021-01-27T09:44:36.692 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.689+0000 7f01740c5700 1 --2- 172.21.15.146:0/356147519 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f016c0bbb20 0x7f016c157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:36.693 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.689+0000 7f01740c5700 1 --2- 172.21.15.146:0/356147519 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f016c065640 0x7f016c1621a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:36.693 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.689+0000 7f01740c5700 1 --2- 172.21.15.146:0/356147519 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f014c0561e0 0x7f014c0586a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:36.693 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.689+0000 7f01740c5700 1 --2- 172.21.15.146:0/356147519 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f016c065260 0x7f016c0c2480 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:36.694 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.689+0000 7f01740c5700 1 -- 172.21.15.146:0/356147519 >> 172.21.15.146:0/356147519 conn(0x7f016c069110 msgr2=0x7f016c0be0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:36.694 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.689+0000 7f01740c5700 1 -- 172.21.15.146:0/356147519 shutdown_connections 2021-01-27T09:44:36.696 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.689+0000 7f01740c5700 1 -- 172.21.15.146:0/356147519 wait complete. 2021-01-27T09:44:36.715 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-01-27T09:44:36.887 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.885+0000 7f7a4b381700 1 Processor -- start 2021-01-27T09:44:36.887 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.885+0000 7f7a4b381700 1 -- start start 2021-01-27T09:44:36.890 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.889+0000 7f7a4b381700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7a440629b0 0x7f7a44067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:36.891 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.889+0000 7f7a4b381700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a44067210 con 0x7f7a44062d90 2021-01-27T09:44:36.891 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.889+0000 7f7a4b381700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a440be020 con 0x7f7a44068360 2021-01-27T09:44:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.889+0000 7f7a4b381700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a44069830 con 0x7f7a440629b0 2021-01-27T09:44:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.889+0000 7f7a49b7e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7a44062d90 0x7f7a4414dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:33934/0 (socket says 172.21.15.146:33934) 2021-01-27T09:44:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.889+0000 7f7a49b7e700 1 -- 172.21.15.146:0/1750855777 learned_addr learned my addr 172.21.15.146:0/1750855777 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.889+0000 7f7a4a37f700 1 --2- 172.21.15.146:0/1750855777 >> v2:172.21.15.78:3300/0 conn(0x7f7a440629b0 0x7f7a44067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:36.894 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.889+0000 7f7a4937d700 1 -- 172.21.15.146:0/1750855777 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 997130628 0 0) 0x7f7a44067210 con 0x7f7a44062d90 2021-01-27T09:44:36.894 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.889+0000 7f7a4937d700 1 -- 172.21.15.146:0/1750855777 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a2c003270 con 0x7f7a44062d90 2021-01-27T09:44:36.895 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.889+0000 7f7a4937d700 1 -- 172.21.15.146:0/1750855777 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1351906783 0 0) 0x7f7a440be020 con 0x7f7a44068360 2021-01-27T09:44:36.895 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.889+0000 7f7a4937d700 1 -- 172.21.15.146:0/1750855777 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a44067210 con 0x7f7a44068360 2021-01-27T09:44:36.895 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.889+0000 7f7a4a37f700 1 -- 172.21.15.146:0/1750855777 >> v1:172.21.15.146:6789/0 conn(0x7f7a44068360 legacy=0x7f7a44069110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:36.895 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.889+0000 7f7a4a37f700 1 -- 172.21.15.146:0/1750855777 >> v1:172.21.15.78:6789/0 conn(0x7f7a44062d90 legacy=0x7f7a4414dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:36.895 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.889+0000 7f7a4a37f700 1 -- 172.21.15.146:0/1750855777 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a440bb4c0 con 0x7f7a440629b0 2021-01-27T09:44:36.896 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.889+0000 7f7a4a37f700 1 --2- 172.21.15.146:0/1750855777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a440629b0 0x7f7a44067bb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f7a4000b9c0 tx=0x7f7a40006e20).ready entity=mon.0 client_cookie=c9c1811356ff67ee server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:36.896 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.889+0000 7f7a4937d700 1 -- 172.21.15.146:0/1750855777 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a40009600 con 0x7f7a440629b0 2021-01-27T09:44:36.896 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.889+0000 7f7a4937d700 1 -- 172.21.15.146:0/1750855777 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a40009760 con 0x7f7a440629b0 2021-01-27T09:44:36.896 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.889+0000 7f7a4937d700 1 -- 172.21.15.146:0/1750855777 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a40009ae0 con 0x7f7a440629b0 2021-01-27T09:44:36.898 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.893+0000 7f7a4b381700 1 -- 172.21.15.146:0/1750855777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a440629b0 msgr2=0x7f7a44067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:36.898 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.893+0000 7f7a4b381700 1 --2- 172.21.15.146:0/1750855777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a440629b0 0x7f7a44067bb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f7a4000b9c0 tx=0x7f7a40006e20).stop 2021-01-27T09:44:36.898 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.893+0000 7f7a4b381700 1 -- 172.21.15.146:0/1750855777 shutdown_connections 2021-01-27T09:44:36.898 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.893+0000 7f7a4b381700 1 --2- 172.21.15.146:0/1750855777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a440629b0 0x7f7a44067bb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:36.899 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.893+0000 7f7a4b381700 1 -- 172.21.15.146:0/1750855777 >> 172.21.15.146:0/1750855777 conn(0x7f7a44060020 msgr2=0x7f7a44064240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:36.899 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.893+0000 7f7a4b381700 1 -- 172.21.15.146:0/1750855777 shutdown_connections 2021-01-27T09:44:36.899 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.893+0000 7f7a4b381700 1 -- 172.21.15.146:0/1750855777 wait complete. 2021-01-27T09:44:36.899 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.893+0000 7f7a4b381700 1 Processor -- start 2021-01-27T09:44:36.900 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.893+0000 7f7a4b381700 1 -- start start 2021-01-27T09:44:36.901 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.897+0000 7f7a4b381700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a440629b0 0x7f7a4415f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:36.901 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.897+0000 7f7a4b381700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a44062d90 0x7f7a4415b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:36.901 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.897+0000 7f7a4b381700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a44068360 0x7f7a4415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.897+0000 7f7a4b381700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4415bf90 con 0x7f7a44062d90 2021-01-27T09:44:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.897+0000 7f7a4b381700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4415f930 con 0x7f7a44068360 2021-01-27T09:44:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.897+0000 7f7a4b381700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4415fbd0 con 0x7f7a440629b0 2021-01-27T09:44:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.897+0000 7f7a4ab80700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a44068360 0x7f7a4415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:36.903 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.897+0000 7f7a49b7e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a44062d90 0x7f7a4415b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:36.903 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.897+0000 7f7a4ab80700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a44068360 0x7f7a4415baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46338/0 (socket says 172.21.15.146:46338) 2021-01-27T09:44:36.903 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.897+0000 7f7a4a37f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a440629b0 0x7f7a4415f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:36.903 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.897+0000 7f7a4ab80700 1 -- 172.21.15.146:0/2020926048 learned_addr learned my addr 172.21.15.146:0/2020926048 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:36.904 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.897+0000 7f7a49b7e700 1 -- 172.21.15.146:0/2020926048 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a440629b0 msgr2=0x7f7a4415f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:36.904 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.897+0000 7f7a49b7e700 1 --2- 172.21.15.146:0/2020926048 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a440629b0 0x7f7a4415f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:36.904 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.897+0000 7f7a49b7e700 1 -- 172.21.15.146:0/2020926048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a44068360 msgr2=0x7f7a4415baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:36.904 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.897+0000 7f7a49b7e700 1 --2- 172.21.15.146:0/2020926048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a44068360 0x7f7a4415baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:36.904 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.897+0000 7f7a49b7e700 1 -- 172.21.15.146:0/2020926048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4415fe70 con 0x7f7a44062d90 2021-01-27T09:44:36.905 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.897+0000 7f7a4ab80700 1 --2- 172.21.15.146:0/2020926048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a44068360 0x7f7a4415baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:36.905 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.897+0000 7f7a49b7e700 1 --2- 172.21.15.146:0/2020926048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a44062d90 0x7f7a4415b5b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f7a340055d0 tx=0x7f7a34007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:36.906 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.901+0000 7f7a327fc700 1 -- 172.21.15.146:0/2020926048 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a340072e0 con 0x7f7a44062d90 2021-01-27T09:44:36.906 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.901+0000 7f7a327fc700 1 -- 172.21.15.146:0/2020926048 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a34007440 con 0x7f7a44062d90 2021-01-27T09:44:36.906 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.901+0000 7f7a327fc700 1 -- 172.21.15.146:0/2020926048 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34005810 con 0x7f7a44062d90 2021-01-27T09:44:36.907 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.901+0000 7f7a4b381700 1 -- 172.21.15.146:0/2020926048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a44160110 con 0x7f7a44062d90 2021-01-27T09:44:36.907 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.901+0000 7f7a4b381700 1 -- 172.21.15.146:0/2020926048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a44160650 con 0x7f7a44062d90 2021-01-27T09:44:36.907 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.901+0000 7f7a4b381700 1 -- 172.21.15.146:0/2020926048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a440b7ae0 con 0x7f7a44062d90 2021-01-27T09:44:36.908 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.905+0000 7f7a327fc700 1 -- 172.21.15.146:0/2020926048 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f7a34010070 con 0x7f7a44062d90 2021-01-27T09:44:36.908 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.905+0000 7f7a327fc700 1 --2- 172.21.15.146:0/2020926048 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f7a24056210 0x7f7a240586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:36.908 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.905+0000 7f7a327fc700 1 -- 172.21.15.146:0/2020926048 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f7a3406eba0 con 0x7f7a44062d90 2021-01-27T09:44:36.909 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.905+0000 7f7a4a37f700 1 --2- 172.21.15.146:0/2020926048 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f7a24056210 0x7f7a240586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:36.909 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.905+0000 7f7a4a37f700 1 --2- 172.21.15.146:0/2020926048 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f7a24056210 0x7f7a240586d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7a40006e60 tx=0x7f7a40016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:36.916 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:36.913+0000 7f7a327fc700 1 -- 172.21.15.146:0/2020926048 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f7a34044140 con 0x7f7a44062d90 2021-01-27T09:44:37.064 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.061+0000 7f7a4b381700 1 -- 172.21.15.146:0/2020926048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7a44044680 con 0x7f7a44062d90 2021-01-27T09:44:37.065 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.061+0000 7f7a327fc700 1 -- 172.21.15.146:0/2020926048 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7a34047760 con 0x7f7a44062d90 2021-01-27T09:44:37.065 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:44:37.068 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.065+0000 7f7a4b381700 1 -- 172.21.15.146:0/2020926048 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f7a24056210 msgr2=0x7f7a240586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:37.068 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.065+0000 7f7a4b381700 1 --2- 172.21.15.146:0/2020926048 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f7a24056210 0x7f7a240586d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7a40006e60 tx=0x7f7a40016000).stop 2021-01-27T09:44:37.068 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.065+0000 7f7a4b381700 1 -- 172.21.15.146:0/2020926048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a44062d90 msgr2=0x7f7a4415b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:37.069 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.065+0000 7f7a4b381700 1 --2- 172.21.15.146:0/2020926048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a44062d90 0x7f7a4415b5b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f7a340055d0 tx=0x7f7a34007a90).stop 2021-01-27T09:44:37.069 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.065+0000 7f7a4b381700 1 -- 172.21.15.146:0/2020926048 shutdown_connections 2021-01-27T09:44:37.069 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.065+0000 7f7a4b381700 1 --2- 172.21.15.146:0/2020926048 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f7a24056210 0x7f7a240586d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:37.069 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.065+0000 7f7a4b381700 1 --2- 172.21.15.146:0/2020926048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a44068360 0x7f7a4415baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:37.070 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.065+0000 7f7a4b381700 1 --2- 172.21.15.146:0/2020926048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a44062d90 0x7f7a4415b5b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:37.070 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.065+0000 7f7a4b381700 1 --2- 172.21.15.146:0/2020926048 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a440629b0 0x7f7a4415f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:37.070 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.065+0000 7f7a4b381700 1 -- 172.21.15.146:0/2020926048 >> 172.21.15.146:0/2020926048 conn(0x7f7a44060020 msgr2=0x7f7a440b9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:37.070 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.065+0000 7f7a4b381700 1 -- 172.21.15.146:0/2020926048 shutdown_connections 2021-01-27T09:44:37.071 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.065+0000 7f7a4b381700 1 -- 172.21.15.146:0/2020926048 wait complete. 2021-01-27T09:44:37.092 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-01-27T09:44:37.265 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.261+0000 7f696239e700 1 Processor -- start 2021-01-27T09:44:37.266 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.261+0000 7f696239e700 1 -- start start 2021-01-27T09:44:37.267 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.265+0000 7f696239e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f695c060f90 0x7f695c064240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:37.267 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.265+0000 7f696239e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f695c14e8d0 0x7f695c0bbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:37.268 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.265+0000 7f696239e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f695c151cb0 con 0x7f695c147f10 2021-01-27T09:44:37.268 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.265+0000 7f696239e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695c1482f0 con 0x7f695c14e8d0 2021-01-27T09:44:37.268 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.265+0000 7f696239e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695c151ad0 con 0x7f695c060f90 2021-01-27T09:44:37.269 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.265+0000 7f695b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f695c060f90 0x7f695c064240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:37.269 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.265+0000 7f696093b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f695c14e8d0 0x7f695c0bbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:37.270 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.265+0000 7f695bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f695c147f10 0x7f695c1513b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45914/0 (socket says 172.21.15.146:45914) 2021-01-27T09:44:37.270 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.265+0000 7f695bfff700 1 -- 172.21.15.146:0/4179967959 learned_addr learned my addr 172.21.15.146:0/4179967959 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:37.270 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.265+0000 7f695b7fe700 1 -- 172.21.15.146:0/4179967959 >> v2:172.21.15.78:3300/0 conn(0x7f695c14e8d0 msgr2=0x7f695c0bbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:37.270 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.265+0000 7f695b7fe700 1 --2- 172.21.15.146:0/4179967959 >> v2:172.21.15.78:3300/0 conn(0x7f695c14e8d0 0x7f695c0bbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:37.271 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.265+0000 7f695b7fe700 1 -- 172.21.15.146:0/4179967959 >> v1:172.21.15.146:6789/0 conn(0x7f695c147f10 legacy=0x7f695c1513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:37.271 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.265+0000 7f695affd700 1 -- 172.21.15.146:0/4179967959 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219403633 0 0) 0x7f695c151cb0 con 0x7f695c147f10 2021-01-27T09:44:37.271 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.265+0000 7f695b7fe700 1 -- 172.21.15.146:0/4179967959 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c151f50 con 0x7f695c060f90 2021-01-27T09:44:37.271 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.265+0000 7f695b7fe700 1 --2- 172.21.15.146:0/4179967959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695c060f90 0x7f695c064240 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f695c065b50 tx=0x7f6950006e20).ready entity=mon.1 client_cookie=a0bed95f20692489 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:37.272 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.265+0000 7f695affd700 1 -- 172.21.15.146:0/4179967959 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695000be80 con 0x7f695c060f90 2021-01-27T09:44:37.273 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.265+0000 7f695affd700 1 -- 172.21.15.146:0/4179967959 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6950009870 con 0x7f695c060f90 2021-01-27T09:44:37.273 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.265+0000 7f695affd700 1 -- 172.21.15.146:0/4179967959 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6950009bf0 con 0x7f695c060f90 2021-01-27T09:44:37.273 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.269+0000 7f696239e700 1 -- 172.21.15.146:0/4179967959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695c060f90 msgr2=0x7f695c064240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:37.273 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.269+0000 7f696239e700 1 --2- 172.21.15.146:0/4179967959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695c060f90 0x7f695c064240 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f695c065b50 tx=0x7f6950006e20).stop 2021-01-27T09:44:37.273 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.269+0000 7f696239e700 1 -- 172.21.15.146:0/4179967959 shutdown_connections 2021-01-27T09:44:37.274 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.269+0000 7f696239e700 1 --2- 172.21.15.146:0/4179967959 >> v2:172.21.15.78:3300/0 conn(0x7f695c14e8d0 0x7f695c0bbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:37.274 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.269+0000 7f696239e700 1 --2- 172.21.15.146:0/4179967959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695c060f90 0x7f695c064240 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:37.274 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.269+0000 7f696239e700 1 -- 172.21.15.146:0/4179967959 >> 172.21.15.146:0/4179967959 conn(0x7f695c067230 msgr2=0x7f695c069110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:37.274 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.269+0000 7f696239e700 1 -- 172.21.15.146:0/4179967959 shutdown_connections 2021-01-27T09:44:37.275 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.269+0000 7f696239e700 1 -- 172.21.15.146:0/4179967959 wait complete. 2021-01-27T09:44:37.275 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.269+0000 7f696239e700 1 Processor -- start 2021-01-27T09:44:37.276 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.273+0000 7f696239e700 1 -- start start 2021-01-27T09:44:37.276 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.273+0000 7f696239e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695c060f90 0x7f695c1616d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:37.276 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.273+0000 7f696239e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f695c147f10 0x7f695c14b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:37.276 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.273+0000 7f696239e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f695c14e8d0 0x7f695c150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:37.276 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.273+0000 7f696239e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c14b790 con 0x7f695c147f10 2021-01-27T09:44:37.277 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.273+0000 7f696239e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c14ab30 con 0x7f695c060f90 2021-01-27T09:44:37.277 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.273+0000 7f696239e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695c14ad60 con 0x7f695c14e8d0 2021-01-27T09:44:37.278 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.273+0000 7f695bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695c060f90 0x7f695c1616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:37.279 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.273+0000 7f695bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695c060f90 0x7f695c1616d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46348/0 (socket says 172.21.15.146:46348) 2021-01-27T09:44:37.279 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.273+0000 7f695bfff700 1 -- 172.21.15.146:0/2702485252 learned_addr learned my addr 172.21.15.146:0/2702485252 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:37.279 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.273+0000 7f695b7fe700 1 --2- 172.21.15.146:0/2702485252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f695c147f10 0x7f695c14b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:37.279 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.273+0000 7f696093b700 1 --2- 172.21.15.146:0/2702485252 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f695c14e8d0 0x7f695c150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:37.280 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.273+0000 7f695bfff700 1 -- 172.21.15.146:0/2702485252 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f695c14e8d0 msgr2=0x7f695c150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:37.280 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.273+0000 7f695bfff700 1 --2- 172.21.15.146:0/2702485252 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f695c14e8d0 0x7f695c150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:37.280 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.273+0000 7f695bfff700 1 -- 172.21.15.146:0/2702485252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f695c147f10 msgr2=0x7f695c14b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:37.280 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.273+0000 7f695bfff700 1 --2- 172.21.15.146:0/2702485252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f695c147f10 0x7f695c14b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:37.281 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.273+0000 7f695bfff700 1 -- 172.21.15.146:0/2702485252 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c14b000 con 0x7f695c060f90 2021-01-27T09:44:37.281 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.273+0000 7f695bfff700 1 --2- 172.21.15.146:0/2702485252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695c060f90 0x7f695c1616d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f694c00c7c0 tx=0x7f694c007af0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:37.282 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.273+0000 7f6943fff700 1 -- 172.21.15.146:0/2702485252 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c0072e0 con 0x7f695c060f90 2021-01-27T09:44:37.282 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.273+0000 7f6943fff700 1 -- 172.21.15.146:0/2702485252 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c007440 con 0x7f695c060f90 2021-01-27T09:44:37.282 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.273+0000 7f696239e700 1 -- 172.21.15.146:0/2702485252 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695c148590 con 0x7f695c060f90 2021-01-27T09:44:37.282 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.273+0000 7f6943fff700 1 -- 172.21.15.146:0/2702485252 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c005830 con 0x7f695c060f90 2021-01-27T09:44:37.282 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.273+0000 7f696239e700 1 -- 172.21.15.146:0/2702485252 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695c067990 con 0x7f695c060f90 2021-01-27T09:44:37.283 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.277+0000 7f696239e700 1 -- 172.21.15.146:0/2702485252 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695c044ee0 con 0x7f695c060f90 2021-01-27T09:44:37.284 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.277+0000 7f6943fff700 1 -- 172.21.15.146:0/2702485252 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f694c010070 con 0x7f695c060f90 2021-01-27T09:44:37.284 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.277+0000 7f6943fff700 1 --2- 172.21.15.146:0/2702485252 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f693c0561e0 0x7f693c0586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:37.284 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.277+0000 7f6943fff700 1 -- 172.21.15.146:0/2702485252 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f694c06eb00 con 0x7f695c060f90 2021-01-27T09:44:37.284 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.281+0000 7f695b7fe700 1 --2- 172.21.15.146:0/2702485252 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f693c0561e0 0x7f693c0586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:37.284 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.281+0000 7f695b7fe700 1 --2- 172.21.15.146:0/2702485252 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f693c0561e0 0x7f693c0586a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f6950006e60 tx=0x7f6950016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:37.288 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.285+0000 7f6943fff700 1 -- 172.21.15.146:0/2702485252 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f694c0441b0 con 0x7f695c060f90 2021-01-27T09:44:37.431 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.429+0000 7f696239e700 1 -- 172.21.15.146:0/2702485252 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f695c062000 con 0x7f695c060f90 2021-01-27T09:44:37.431 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.429+0000 7f6943fff700 1 -- 172.21.15.146:0/2702485252 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+10 (secure 0 0 0) 0x7f694c0477d0 con 0x7f695c060f90 2021-01-27T09:44:37.432 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:44:37.434 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.429+0000 7f696239e700 1 -- 172.21.15.146:0/2702485252 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f693c0561e0 msgr2=0x7f693c0586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:37.434 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.429+0000 7f696239e700 1 --2- 172.21.15.146:0/2702485252 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f693c0561e0 0x7f693c0586a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f6950006e60 tx=0x7f6950016000).stop 2021-01-27T09:44:37.435 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.429+0000 7f696239e700 1 -- 172.21.15.146:0/2702485252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695c060f90 msgr2=0x7f695c1616d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:37.435 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.429+0000 7f696239e700 1 --2- 172.21.15.146:0/2702485252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695c060f90 0x7f695c1616d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f694c00c7c0 tx=0x7f694c007af0).stop 2021-01-27T09:44:37.435 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.429+0000 7f696239e700 1 -- 172.21.15.146:0/2702485252 shutdown_connections 2021-01-27T09:44:37.435 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.429+0000 7f696239e700 1 --2- 172.21.15.146:0/2702485252 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f695c14e8d0 0x7f695c150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:37.435 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.429+0000 7f696239e700 1 --2- 172.21.15.146:0/2702485252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f695c147f10 0x7f695c14b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:37.436 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.429+0000 7f696239e700 1 --2- 172.21.15.146:0/2702485252 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f693c0561e0 0x7f693c0586a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:37.436 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.429+0000 7f696239e700 1 --2- 172.21.15.146:0/2702485252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695c060f90 0x7f695c1616d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:37.436 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.429+0000 7f696239e700 1 -- 172.21.15.146:0/2702485252 >> 172.21.15.146:0/2702485252 conn(0x7f695c067230 msgr2=0x7f695c061450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:37.437 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.433+0000 7f696239e700 1 -- 172.21.15.146:0/2702485252 shutdown_connections 2021-01-27T09:44:37.437 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.433+0000 7f696239e700 1 -- 172.21.15.146:0/2702485252 wait complete. 2021-01-27T09:44:37.460 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-01-27T09:44:37.626 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.621+0000 7f5dae0b5700 1 Processor -- start 2021-01-27T09:44:37.626 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.625+0000 7f5dae0b5700 1 -- start start 2021-01-27T09:44:37.628 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.625+0000 7f5dae0b5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5da80bd0a0 0x7f5da80651f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:37.628 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.625+0000 7f5dae0b5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5da814b630 0x7f5da8147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:37.628 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.625+0000 7f5dae0b5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da8065880 con 0x7f5da80bccc0 2021-01-27T09:44:37.629 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.625+0000 7f5dae0b5700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da8066fd0 con 0x7f5da80bd0a0 2021-01-27T09:44:37.629 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.625+0000 7f5dae0b5700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da814baa0 con 0x7f5da814b630 2021-01-27T09:44:37.630 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.625+0000 7f5da6ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5da80bd0a0 0x7f5da80651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:37.630 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.625+0000 7f5da7fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5da814b630 0x7f5da8147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:37.630 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.625+0000 7f5da6ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5da80bd0a0 0x7f5da80651f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:49230/0 (socket says 172.21.15.146:49230) 2021-01-27T09:44:37.631 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.625+0000 7f5da6ffd700 1 -- 172.21.15.146:0/275242187 learned_addr learned my addr 172.21.15.146:0/275242187 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:37.631 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.625+0000 7f5da77fe700 1 --1- 172.21.15.146:0/275242187 >> v1:172.21.15.146:6789/0 conn(0x7f5da80bccc0 0x7f5da80bac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45930/0 (socket says 172.21.15.146:45930) 2021-01-27T09:44:37.631 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.625+0000 7f5da6ffd700 1 -- 172.21.15.146:0/275242187 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5da814b630 msgr2=0x7f5da8147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:37.631 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.625+0000 7f5da6ffd700 1 --2- 172.21.15.146:0/275242187 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5da814b630 0x7f5da8147bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:37.631 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.625+0000 7f5da6ffd700 1 -- 172.21.15.146:0/275242187 >> v1:172.21.15.146:6789/0 conn(0x7f5da80bccc0 legacy=0x7f5da80bac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:37.632 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.625+0000 7f5da6ffd700 1 -- 172.21.15.146:0/275242187 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da80660b0 con 0x7f5da80bd0a0 2021-01-27T09:44:37.632 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.625+0000 7f5da7fff700 1 --2- 172.21.15.146:0/275242187 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5da814b630 0x7f5da8147bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:37.632 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.625+0000 7f5da67fc700 1 -- 172.21.15.146:0/275242187 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365546742 0 0) 0x7f5da8065880 con 0x7f5da80bccc0 2021-01-27T09:44:37.632 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.625+0000 7f5da6ffd700 1 --2- 172.21.15.146:0/275242187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5da80bd0a0 0x7f5da80651f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f5d9c00bca0 tx=0x7f5d9c006f70).ready entity=mon.0 client_cookie=574efaa8a71a5002 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:37.633 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.629+0000 7f5da67fc700 1 -- 172.21.15.146:0/275242187 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c00dce0 con 0x7f5da80bd0a0 2021-01-27T09:44:37.633 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.629+0000 7f5da67fc700 1 -- 172.21.15.146:0/275242187 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9c00de40 con 0x7f5da80bd0a0 2021-01-27T09:44:37.634 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.629+0000 7f5da67fc700 1 -- 172.21.15.146:0/275242187 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c010680 con 0x7f5da80bd0a0 2021-01-27T09:44:37.634 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.629+0000 7f5dae0b5700 1 -- 172.21.15.146:0/275242187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5da80bd0a0 msgr2=0x7f5da80651f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:37.634 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.629+0000 7f5dae0b5700 1 --2- 172.21.15.146:0/275242187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5da80bd0a0 0x7f5da80651f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f5d9c00bca0 tx=0x7f5d9c006f70).stop 2021-01-27T09:44:37.634 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.629+0000 7f5dae0b5700 1 -- 172.21.15.146:0/275242187 shutdown_connections 2021-01-27T09:44:37.635 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.629+0000 7f5dae0b5700 1 --2- 172.21.15.146:0/275242187 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5da814b630 0x7f5da8147bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:37.635 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.629+0000 7f5dae0b5700 1 --2- 172.21.15.146:0/275242187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5da80bd0a0 0x7f5da80651f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:37.635 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.629+0000 7f5dae0b5700 1 -- 172.21.15.146:0/275242187 >> 172.21.15.146:0/275242187 conn(0x7f5da8060910 msgr2=0x7f5da8064ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:37.635 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.629+0000 7f5dae0b5700 1 -- 172.21.15.146:0/275242187 shutdown_connections 2021-01-27T09:44:37.635 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.629+0000 7f5dae0b5700 1 -- 172.21.15.146:0/275242187 wait complete. 2021-01-27T09:44:37.636 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.633+0000 7f5dae0b5700 1 Processor -- start 2021-01-27T09:44:37.636 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.633+0000 7f5dae0b5700 1 -- start start 2021-01-27T09:44:37.637 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.633+0000 7f5dae0b5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5da80bccc0 0x7f5da81436a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:37.637 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.633+0000 7f5dae0b5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5da80bd0a0 0x7f5da813eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:37.638 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.633+0000 7f5dae0b5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5da814b630 0x7f5da813f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:37.638 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.633+0000 7f5dae0b5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da813f580 con 0x7f5da80bd0a0 2021-01-27T09:44:37.638 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.633+0000 7f5dae0b5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da80bf5e0 con 0x7f5da80bccc0 2021-01-27T09:44:37.638 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.633+0000 7f5dae0b5700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da8145750 con 0x7f5da814b630 2021-01-27T09:44:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.633+0000 7f5da77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5da80bccc0 0x7f5da81436a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.633+0000 7f5da77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5da80bccc0 0x7f5da81436a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46362/0 (socket says 172.21.15.146:46362) 2021-01-27T09:44:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.633+0000 7f5da77fe700 1 -- 172.21.15.146:0/3509407620 learned_addr learned my addr 172.21.15.146:0/3509407620 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.633+0000 7f5da6ffd700 1 --2- 172.21.15.146:0/3509407620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5da80bd0a0 0x7f5da813eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.633+0000 7f5da7fff700 1 --2- 172.21.15.146:0/3509407620 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5da814b630 0x7f5da813f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:37.640 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.633+0000 7f5da77fe700 1 -- 172.21.15.146:0/3509407620 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5da814b630 msgr2=0x7f5da813f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:37.641 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.633+0000 7f5da77fe700 1 --2- 172.21.15.146:0/3509407620 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5da814b630 0x7f5da813f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:37.641 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.633+0000 7f5da77fe700 1 -- 172.21.15.146:0/3509407620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5da80bd0a0 msgr2=0x7f5da813eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:37.641 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.633+0000 7f5da77fe700 1 --2- 172.21.15.146:0/3509407620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5da80bd0a0 0x7f5da813eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:37.641 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.633+0000 7f5da77fe700 1 -- 172.21.15.146:0/3509407620 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da80c0b00 con 0x7f5da80bccc0 2021-01-27T09:44:37.642 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.633+0000 7f5da7fff700 1 --2- 172.21.15.146:0/3509407620 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5da814b630 0x7f5da813f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:44:37.642 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.637+0000 7f5da77fe700 1 --2- 172.21.15.146:0/3509407620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5da80bccc0 0x7f5da81436a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f5d9800c720 tx=0x7f5d98007ae0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:37.642 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.637+0000 7f5d8f7fe700 1 -- 172.21.15.146:0/3509407620 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d980072e0 con 0x7f5da80bccc0 2021-01-27T09:44:37.642 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.637+0000 7f5d8f7fe700 1 -- 172.21.15.146:0/3509407620 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d98005560 con 0x7f5da80bccc0 2021-01-27T09:44:37.642 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.637+0000 7f5dae0b5700 1 -- 172.21.15.146:0/3509407620 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da8148ca0 con 0x7f5da80bccc0 2021-01-27T09:44:37.643 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.637+0000 7f5d8f7fe700 1 -- 172.21.15.146:0/3509407620 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d98007440 con 0x7f5da80bccc0 2021-01-27T09:44:37.643 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.637+0000 7f5dae0b5700 1 -- 172.21.15.146:0/3509407620 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da80c0d60 con 0x7f5da80bccc0 2021-01-27T09:44:37.643 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.637+0000 7f5dae0b5700 1 -- 172.21.15.146:0/3509407620 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da8044ee0 con 0x7f5da80bccc0 2021-01-27T09:44:37.644 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.637+0000 7f5d8f7fe700 1 -- 172.21.15.146:0/3509407620 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f5d98010070 con 0x7f5da80bccc0 2021-01-27T09:44:37.644 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.641+0000 7f5d8f7fe700 1 --2- 172.21.15.146:0/3509407620 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f5d880561e0 0x7f5d880586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:37.644 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.641+0000 7f5d8f7fe700 1 -- 172.21.15.146:0/3509407620 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f5d9806ece0 con 0x7f5da80bccc0 2021-01-27T09:44:37.644 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.641+0000 7f5da6ffd700 1 --2- 172.21.15.146:0/3509407620 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f5d880561e0 0x7f5d880586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:37.645 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.641+0000 7f5da6ffd700 1 --2- 172.21.15.146:0/3509407620 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f5d880561e0 0x7f5d880586a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f5d9c008fd0 tx=0x7f5da80b86a0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:37.648 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.645+0000 7f5d8f7fe700 1 -- 172.21.15.146:0/3509407620 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f5d98044390 con 0x7f5da80bccc0 2021-01-27T09:44:37.791 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.789+0000 7f5dae0b5700 1 -- 172.21.15.146:0/3509407620 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5da8063a20 con 0x7f5da80bccc0 2021-01-27T09:44:37.792 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.789+0000 7f5d8f7fe700 1 -- 172.21.15.146:0/3509407620 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5d980479b0 con 0x7f5da80bccc0 2021-01-27T09:44:37.793 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:44:37.795 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.793+0000 7f5dae0b5700 1 -- 172.21.15.146:0/3509407620 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f5d880561e0 msgr2=0x7f5d880586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:37.795 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.793+0000 7f5dae0b5700 1 --2- 172.21.15.146:0/3509407620 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f5d880561e0 0x7f5d880586a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f5d9c008fd0 tx=0x7f5da80b86a0).stop 2021-01-27T09:44:37.795 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.793+0000 7f5dae0b5700 1 -- 172.21.15.146:0/3509407620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5da80bccc0 msgr2=0x7f5da81436a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:37.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.793+0000 7f5dae0b5700 1 --2- 172.21.15.146:0/3509407620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5da80bccc0 0x7f5da81436a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f5d9800c720 tx=0x7f5d98007ae0).stop 2021-01-27T09:44:37.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.793+0000 7f5dae0b5700 1 -- 172.21.15.146:0/3509407620 shutdown_connections 2021-01-27T09:44:37.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.793+0000 7f5dae0b5700 1 --2- 172.21.15.146:0/3509407620 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5da814b630 0x7f5da813f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:37.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.793+0000 7f5dae0b5700 1 --2- 172.21.15.146:0/3509407620 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5da80bd0a0 0x7f5da813eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:37.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.793+0000 7f5dae0b5700 1 --2- 172.21.15.146:0/3509407620 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f5d880561e0 0x7f5d880586a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:37.797 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.793+0000 7f5dae0b5700 1 --2- 172.21.15.146:0/3509407620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5da80bccc0 0x7f5da81436a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:37.797 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.793+0000 7f5dae0b5700 1 -- 172.21.15.146:0/3509407620 >> 172.21.15.146:0/3509407620 conn(0x7f5da8060910 msgr2=0x7f5da8144440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:37.797 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.793+0000 7f5dae0b5700 1 -- 172.21.15.146:0/3509407620 shutdown_connections 2021-01-27T09:44:37.797 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.793+0000 7f5dae0b5700 1 -- 172.21.15.146:0/3509407620 wait complete. 2021-01-27T09:44:37.822 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2021-01-27T09:44:37.992 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.989+0000 7f381e87d700 1 Processor -- start 2021-01-27T09:44:37.993 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.989+0000 7f381e87d700 1 -- start start 2021-01-27T09:44:37.995 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.993+0000 7f381e87d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f38180bcb30 0x7f38180bd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:37.995 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.993+0000 7f381e87d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f38180bcf10 0x7f381814efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:37.996 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.993+0000 7f381e87d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3818155510 con 0x7f3818062f30 2021-01-27T09:44:37.996 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.993+0000 7f381e87d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3818067a90 con 0x7f38180bcb30 2021-01-27T09:44:37.996 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.993+0000 7f381e87d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38180ba460 con 0x7f38180bcf10 2021-01-27T09:44:37.999 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.993+0000 7f381e07c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3818062f30 0x7f3818152090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45942/0 (socket says 172.21.15.146:45942) 2021-01-27T09:44:37.999 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.993+0000 7f381e07c700 1 -- 172.21.15.146:0/2871476179 learned_addr learned my addr 172.21.15.146:0/2871476179 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:38.000 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.993+0000 7f381d07a700 1 --2- 172.21.15.146:0/2871476179 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f38180bcf10 0x7f381814efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:38.000 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.993+0000 7f381d87b700 1 --2- 172.21.15.146:0/2871476179 >> v2:172.21.15.146:3300/0 conn(0x7f38180bcb30 0x7f38180bd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:38.000 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.993+0000 7f381c879700 1 -- 172.21.15.146:0/2871476179 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208230742 0 0) 0x7f3818155510 con 0x7f3818062f30 2021-01-27T09:44:38.000 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.993+0000 7f381c879700 1 -- 172.21.15.146:0/2871476179 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3800003270 con 0x7f3818062f30 2021-01-27T09:44:38.001 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.993+0000 7f381d87b700 1 -- 172.21.15.146:0/2871476179 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f38180bcf10 msgr2=0x7f381814efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:38.001 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.993+0000 7f381d87b700 1 --2- 172.21.15.146:0/2871476179 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f38180bcf10 0x7f381814efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:38.001 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.993+0000 7f381d87b700 1 -- 172.21.15.146:0/2871476179 >> v1:172.21.15.146:6789/0 conn(0x7f3818062f30 legacy=0x7f3818152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:38.001 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.993+0000 7f381d87b700 1 -- 172.21.15.146:0/2871476179 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3818155770 con 0x7f38180bcb30 2021-01-27T09:44:38.001 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.993+0000 7f381d07a700 1 --2- 172.21.15.146:0/2871476179 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f38180bcf10 0x7f381814efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:38.002 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.993+0000 7f381d87b700 1 --2- 172.21.15.146:0/2871476179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38180bcb30 0x7f38180bd5c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f381400b9c0 tx=0x7f3814006e20).ready entity=mon.1 client_cookie=580474af3900ea1d server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:38.002 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.997+0000 7f381c879700 1 -- 172.21.15.146:0/2871476179 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3814009600 con 0x7f38180bcb30 2021-01-27T09:44:38.002 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.997+0000 7f381c879700 1 -- 172.21.15.146:0/2871476179 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3814009760 con 0x7f38180bcb30 2021-01-27T09:44:38.003 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.997+0000 7f381c879700 1 -- 172.21.15.146:0/2871476179 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3814009ae0 con 0x7f38180bcb30 2021-01-27T09:44:38.003 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.997+0000 7f381e87d700 1 -- 172.21.15.146:0/2871476179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38180bcb30 msgr2=0x7f38180bd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:38.004 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.997+0000 7f381e87d700 1 --2- 172.21.15.146:0/2871476179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38180bcb30 0x7f38180bd5c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f381400b9c0 tx=0x7f3814006e20).stop 2021-01-27T09:44:38.004 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.997+0000 7f381e87d700 1 -- 172.21.15.146:0/2871476179 shutdown_connections 2021-01-27T09:44:38.004 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.997+0000 7f381e87d700 1 --2- 172.21.15.146:0/2871476179 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f38180bcf10 0x7f381814efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:38.005 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.997+0000 7f381e87d700 1 --2- 172.21.15.146:0/2871476179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38180bcb30 0x7f38180bd5c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:38.005 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.997+0000 7f381e87d700 1 -- 172.21.15.146:0/2871476179 >> 172.21.15.146:0/2871476179 conn(0x7f3818069ba0 msgr2=0x7f3818062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:38.008 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.997+0000 7f381e87d700 1 -- 172.21.15.146:0/2871476179 shutdown_connections 2021-01-27T09:44:38.009 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.997+0000 7f381e87d700 1 -- 172.21.15.146:0/2871476179 wait complete. 2021-01-27T09:44:38.009 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.997+0000 7f381e87d700 1 Processor -- start 2021-01-27T09:44:38.009 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:37.997+0000 7f381e87d700 1 -- start start 2021-01-27T09:44:38.010 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f381e87d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3818062f30 0x7f381815f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:38.010 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f381e87d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38180bcf10 0x7f3818164dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:38.010 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f381e87d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f381815fb50 0x7f38181652c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:38.010 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f381e87d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180ad450 con 0x7f38180bcf10 2021-01-27T09:44:38.011 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f381e87d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180beae0 con 0x7f381815fb50 2021-01-27T09:44:38.011 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f381e87d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38180acf10 con 0x7f3818062f30 2021-01-27T09:44:38.011 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f381e07c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f381815fb50 0x7f38181652c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:38.011 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f381d07a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38180bcf10 0x7f3818164dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:38.011 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f381d07a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38180bcf10 0x7f3818164dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:49252/0 (socket says 172.21.15.146:49252) 2021-01-27T09:44:38.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f381d07a700 1 -- 172.21.15.146:0/684988771 learned_addr learned my addr 172.21.15.146:0/684988771 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:38.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f381d87b700 1 --2- 172.21.15.146:0/684988771 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3818062f30 0x7f381815f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:38.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f381e07c700 1 -- 172.21.15.146:0/684988771 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3818062f30 msgr2=0x7f381815f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:38.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f381e07c700 1 --2- 172.21.15.146:0/684988771 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3818062f30 0x7f381815f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:38.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f381e07c700 1 -- 172.21.15.146:0/684988771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38180bcf10 msgr2=0x7f3818164dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:38.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f381e07c700 1 --2- 172.21.15.146:0/684988771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38180bcf10 0x7f3818164dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:38.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f381e07c700 1 -- 172.21.15.146:0/684988771 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38180ad1b0 con 0x7f381815fb50 2021-01-27T09:44:38.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f381d07a700 1 --2- 172.21.15.146:0/684988771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38180bcf10 0x7f3818164dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:38.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f381d87b700 1 --2- 172.21.15.146:0/684988771 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3818062f30 0x7f381815f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:44:38.014 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f381e07c700 1 --2- 172.21.15.146:0/684988771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f381815fb50 0x7f38181652c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f3810001580 tx=0x7f3810007d90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:38.014 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f3805ffb700 1 -- 172.21.15.146:0/684988771 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810005bb0 con 0x7f381815fb50 2021-01-27T09:44:38.014 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f3805ffb700 1 -- 172.21.15.146:0/684988771 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3810005d10 con 0x7f381815fb50 2021-01-27T09:44:38.014 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f381e87d700 1 -- 172.21.15.146:0/684988771 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3818153e60 con 0x7f381815fb50 2021-01-27T09:44:38.014 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f3805ffb700 1 -- 172.21.15.146:0/684988771 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810007320 con 0x7f381815fb50 2021-01-27T09:44:38.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.001+0000 7f381e87d700 1 -- 172.21.15.146:0/684988771 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38181543a0 con 0x7f381815fb50 2021-01-27T09:44:38.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.005+0000 7f381e87d700 1 -- 172.21.15.146:0/684988771 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3818044680 con 0x7f381815fb50 2021-01-27T09:44:38.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.005+0000 7f3805ffb700 1 -- 172.21.15.146:0/684988771 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f3810010030 con 0x7f381815fb50 2021-01-27T09:44:38.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.005+0000 7f3805ffb700 1 --2- 172.21.15.146:0/684988771 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f37f80561e0 0x7f37f80586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:38.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.005+0000 7f3805ffb700 1 -- 172.21.15.146:0/684988771 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f381006f4d0 con 0x7f381815fb50 2021-01-27T09:44:38.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.009+0000 7f381d87b700 1 --2- 172.21.15.146:0/684988771 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f37f80561e0 0x7f37f80586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:38.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.009+0000 7f381d87b700 1 --2- 172.21.15.146:0/684988771 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f37f80561e0 0x7f37f80586a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f3818061d00 tx=0x7f3814016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:38.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.013+0000 7f3805ffb700 1 -- 172.21.15.146:0/684988771 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f3810044a70 con 0x7f381815fb50 2021-01-27T09:44:38.162 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.161+0000 7f381e87d700 1 -- 172.21.15.146:0/684988771 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f38181546a0 con 0x7f381815fb50 2021-01-27T09:44:38.163 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.161+0000 7f3805ffb700 1 -- 172.21.15.146:0/684988771 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+10 (secure 0 0 0) 0x7f3810048090 con 0x7f381815fb50 2021-01-27T09:44:38.164 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:44:38.167 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.165+0000 7f381e87d700 1 -- 172.21.15.146:0/684988771 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f37f80561e0 msgr2=0x7f37f80586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:38.167 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.165+0000 7f381e87d700 1 --2- 172.21.15.146:0/684988771 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f37f80561e0 0x7f37f80586a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f3818061d00 tx=0x7f3814016000).stop 2021-01-27T09:44:38.168 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.165+0000 7f381e87d700 1 -- 172.21.15.146:0/684988771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f381815fb50 msgr2=0x7f38181652c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:38.168 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.165+0000 7f381e87d700 1 --2- 172.21.15.146:0/684988771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f381815fb50 0x7f38181652c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f3810001580 tx=0x7f3810007d90).stop 2021-01-27T09:44:38.168 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.165+0000 7f381e87d700 1 -- 172.21.15.146:0/684988771 shutdown_connections 2021-01-27T09:44:38.168 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.165+0000 7f381e87d700 1 --2- 172.21.15.146:0/684988771 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f37f80561e0 0x7f37f80586a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:38.169 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.165+0000 7f381e87d700 1 --2- 172.21.15.146:0/684988771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f381815fb50 0x7f38181652c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:38.169 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.165+0000 7f381e87d700 1 --2- 172.21.15.146:0/684988771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38180bcf10 0x7f3818164dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:38.169 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.165+0000 7f381e87d700 1 --2- 172.21.15.146:0/684988771 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3818062f30 0x7f381815f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:38.169 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.165+0000 7f381e87d700 1 -- 172.21.15.146:0/684988771 >> 172.21.15.146:0/684988771 conn(0x7f3818069ba0 msgr2=0x7f38180ba780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:38.170 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.165+0000 7f381e87d700 1 -- 172.21.15.146:0/684988771 shutdown_connections 2021-01-27T09:44:38.170 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.165+0000 7f381e87d700 1 -- 172.21.15.146:0/684988771 wait complete. 2021-01-27T09:44:38.194 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-27T09:44:38.194 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:44:38.238 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:44:38.241 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:44:38.347 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.345+0000 7f017e67e700 1 Processor -- start 2021-01-27T09:44:38.347 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.345+0000 7f017e67e700 1 -- start start 2021-01-27T09:44:38.349 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.345+0000 7f017e67e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0178060ef0 0x7f017814a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:38.349 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.345+0000 7f017e67e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01780bd850 0x7f017814aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:38.349 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.345+0000 7f017e67e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0178067130 con 0x7f0178060b10 2021-01-27T09:44:38.349 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.345+0000 7f017e67e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01780678d0 con 0x7f0178060ef0 2021-01-27T09:44:38.350 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.345+0000 7f017e67e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017814e2c0 con 0x7f01780bd850 2021-01-27T09:44:38.351 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.345+0000 7f017d67c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0178060b10 0x7f0178147040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:33990/0 (socket says 172.21.15.146:33990) 2021-01-27T09:44:38.351 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.345+0000 7f017d67c700 1 -- 172.21.15.146:0/2380447959 learned_addr learned my addr 172.21.15.146:0/2380447959 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:38.351 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.345+0000 7f017de7d700 1 --2- 172.21.15.146:0/2380447959 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01780bd850 0x7f017814aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:38.352 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.345+0000 7f017ce7b700 1 --2- 172.21.15.146:0/2380447959 >> v2:172.21.15.146:3300/0 conn(0x7f0178060ef0 0x7f017814a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:38.352 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.349+0000 7f0167fff700 1 -- 172.21.15.146:0/2380447959 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491760550 0 0) 0x7f0178067130 con 0x7f0178060b10 2021-01-27T09:44:38.352 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.349+0000 7f0167fff700 1 -- 172.21.15.146:0/2380447959 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0160003270 con 0x7f0178060b10 2021-01-27T09:44:38.352 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.349+0000 7f017de7d700 1 -- 172.21.15.146:0/2380447959 >> v2:172.21.15.146:3300/0 conn(0x7f0178060ef0 msgr2=0x7f017814a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:38.353 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.349+0000 7f017de7d700 1 --2- 172.21.15.146:0/2380447959 >> v2:172.21.15.146:3300/0 conn(0x7f0178060ef0 0x7f017814a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:38.353 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.349+0000 7f017de7d700 1 -- 172.21.15.146:0/2380447959 >> v1:172.21.15.78:6789/0 conn(0x7f0178060b10 legacy=0x7f0178147040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:38.353 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.349+0000 7f017de7d700 1 -- 172.21.15.146:0/2380447959 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0178067390 con 0x7f01780bd850 2021-01-27T09:44:38.354 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.349+0000 7f017de7d700 1 --2- 172.21.15.146:0/2380447959 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01780bd850 0x7f017814aa40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f01780672c0 tx=0x7f0170006e20).ready entity=mon.2 client_cookie=9d68de322a067f1b server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:38.355 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.349+0000 7f0167fff700 1 -- 172.21.15.146:0/2380447959 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0170009650 con 0x7f01780bd850 2021-01-27T09:44:38.355 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.349+0000 7f0167fff700 1 -- 172.21.15.146:0/2380447959 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01700097b0 con 0x7f01780bd850 2021-01-27T09:44:38.355 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.349+0000 7f0167fff700 1 -- 172.21.15.146:0/2380447959 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0170009b30 con 0x7f01780bd850 2021-01-27T09:44:38.355 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.349+0000 7f017e67e700 1 -- 172.21.15.146:0/2380447959 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01780bd850 msgr2=0x7f017814aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.349+0000 7f017e67e700 1 --2- 172.21.15.146:0/2380447959 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01780bd850 0x7f017814aa40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f01780672c0 tx=0x7f0170006e20).stop 2021-01-27T09:44:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.349+0000 7f017e67e700 1 -- 172.21.15.146:0/2380447959 shutdown_connections 2021-01-27T09:44:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.349+0000 7f017e67e700 1 --2- 172.21.15.146:0/2380447959 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01780bd850 0x7f017814aa40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.349+0000 7f017e67e700 1 --2- 172.21.15.146:0/2380447959 >> v2:172.21.15.146:3300/0 conn(0x7f0178060ef0 0x7f017814a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.349+0000 7f017e67e700 1 -- 172.21.15.146:0/2380447959 >> 172.21.15.146:0/2380447959 conn(0x7f0178066740 msgr2=0x7f01780699a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:38.357 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.349+0000 7f017e67e700 1 -- 172.21.15.146:0/2380447959 shutdown_connections 2021-01-27T09:44:38.357 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.349+0000 7f017e67e700 1 -- 172.21.15.146:0/2380447959 wait complete. 2021-01-27T09:44:38.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.353+0000 7f017e67e700 1 Processor -- start 2021-01-27T09:44:38.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.353+0000 7f017e67e700 1 -- start start 2021-01-27T09:44:38.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.353+0000 7f017e67e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0178060b10 0x7f017813d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:38.360 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.353+0000 7f017e67e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0178060ef0 0x7f0178141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:38.360 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.353+0000 7f017e67e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01780bd850 0x7f017813ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:38.360 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.353+0000 7f017e67e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0178140a90 con 0x7f01780bd850 2021-01-27T09:44:38.360 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.353+0000 7f017e67e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0178149ee0 con 0x7f0178060b10 2021-01-27T09:44:38.361 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.353+0000 7f017e67e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017813da60 con 0x7f0178060ef0 2021-01-27T09:44:38.361 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.357+0000 7f017ce7b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0178060ef0 0x7f0178141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:38.361 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.357+0000 7f017d67c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0178060b10 0x7f017813d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:38.361 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.357+0000 7f017ce7b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0178060ef0 0x7f0178141d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:35876/0 (socket says 172.21.15.146:35876) 2021-01-27T09:44:38.361 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.357+0000 7f017ce7b700 1 -- 172.21.15.146:0/3162493998 learned_addr learned my addr 172.21.15.146:0/3162493998 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:38.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.357+0000 7f017de7d700 1 --2- 172.21.15.146:0/3162493998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01780bd850 0x7f017813ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:38.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.357+0000 7f017ce7b700 1 -- 172.21.15.146:0/3162493998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0178060b10 msgr2=0x7f017813d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:38.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.357+0000 7f017ce7b700 1 --2- 172.21.15.146:0/3162493998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0178060b10 0x7f017813d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:38.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.357+0000 7f017ce7b700 1 -- 172.21.15.146:0/3162493998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01780bd850 msgr2=0x7f017813ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:38.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.357+0000 7f017ce7b700 1 --2- 172.21.15.146:0/3162493998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01780bd850 0x7f017813ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:38.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.357+0000 7f017ce7b700 1 -- 172.21.15.146:0/3162493998 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017813c9e0 con 0x7f0178060ef0 2021-01-27T09:44:38.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.357+0000 7f017d67c700 1 --2- 172.21.15.146:0/3162493998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0178060b10 0x7f017813d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:38.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.357+0000 7f017ce7b700 1 --2- 172.21.15.146:0/3162493998 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0178060ef0 0x7f0178141d90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f016800ec00 tx=0x7f0168006e20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:38.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.357+0000 7f01657fa700 1 -- 172.21.15.146:0/3162493998 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016800c850 con 0x7f0178060ef0 2021-01-27T09:44:38.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.357+0000 7f01657fa700 1 -- 172.21.15.146:0/3162493998 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016800c9b0 con 0x7f0178060ef0 2021-01-27T09:44:38.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.357+0000 7f01657fa700 1 -- 172.21.15.146:0/3162493998 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016800cd30 con 0x7f0178060ef0 2021-01-27T09:44:38.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.357+0000 7f017e67e700 1 -- 172.21.15.146:0/3162493998 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f017813cc80 con 0x7f0178060ef0 2021-01-27T09:44:38.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.357+0000 7f017e67e700 1 -- 172.21.15.146:0/3162493998 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017813e8e0 con 0x7f0178060ef0 2021-01-27T09:44:38.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.357+0000 7f017e67e700 1 -- 172.21.15.146:0/3162493998 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01780bdf20 con 0x7f0178060ef0 2021-01-27T09:44:38.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.361+0000 7f01657fa700 1 -- 172.21.15.146:0/3162493998 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f0168012600 con 0x7f0178060ef0 2021-01-27T09:44:38.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.361+0000 7f01657fa700 1 --2- 172.21.15.146:0/3162493998 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f01580561e0 0x7f01580586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:38.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.361+0000 7f01657fa700 1 -- 172.21.15.146:0/3162493998 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f016806f920 con 0x7f0178060ef0 2021-01-27T09:44:38.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.361+0000 7f017d67c700 1 --2- 172.21.15.146:0/3162493998 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f01580561e0 0x7f01580586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:38.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.365+0000 7f017d67c700 1 --2- 172.21.15.146:0/3162493998 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f01580561e0 0x7f01580586a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f0174007fd0 tx=0x7f0174009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:38.376 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.373+0000 7f01657fa700 1 -- 172.21.15.146:0/3162493998 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f0168044e60 con 0x7f0178060ef0 2021-01-27T09:44:38.551 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.549+0000 7f017e67e700 1 -- 172.21.15.146:0/3162493998 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0178044680 con 0x7f0178060ef0 2021-01-27T09:44:38.552 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.549+0000 7f01657fa700 1 -- 172.21.15.146:0/3162493998 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3541 (secure 0 0 0) 0x7f0168048480 con 0x7f0178060ef0 2021-01-27T09:44:38.553 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:44:38.553 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":5},{"gid":4241,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/745099427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":745099427},{"type":"v1","addr":"172.21.15.146:6837","nonce":745099427}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:44:33.763837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2021-01-27T09:44:38.555 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.553+0000 7f017e67e700 1 -- 172.21.15.146:0/3162493998 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f01580561e0 msgr2=0x7f01580586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:38.555 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.553+0000 7f017e67e700 1 --2- 172.21.15.146:0/3162493998 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f01580561e0 0x7f01580586a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f0174007fd0 tx=0x7f0174009040).stop 2021-01-27T09:44:38.555 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.553+0000 7f017e67e700 1 -- 172.21.15.146:0/3162493998 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0178060ef0 msgr2=0x7f0178141d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:38.556 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.553+0000 7f017e67e700 1 --2- 172.21.15.146:0/3162493998 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0178060ef0 0x7f0178141d90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f016800ec00 tx=0x7f0168006e20).stop 2021-01-27T09:44:38.556 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.553+0000 7f017e67e700 1 -- 172.21.15.146:0/3162493998 shutdown_connections 2021-01-27T09:44:38.557 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.553+0000 7f017e67e700 1 --2- 172.21.15.146:0/3162493998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01780bd850 0x7f017813ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:38.557 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.553+0000 7f017e67e700 1 --2- 172.21.15.146:0/3162493998 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0178060ef0 0x7f0178141d90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:38.557 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.553+0000 7f017e67e700 1 --2- 172.21.15.146:0/3162493998 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f01580561e0 0x7f01580586a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:38.557 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.553+0000 7f017e67e700 1 --2- 172.21.15.146:0/3162493998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0178060b10 0x7f017813d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:38.558 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.553+0000 7f017e67e700 1 -- 172.21.15.146:0/3162493998 >> 172.21.15.146:0/3162493998 conn(0x7f0178066740 msgr2=0x7f01781453a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:38.558 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.553+0000 7f017e67e700 1 -- 172.21.15.146:0/3162493998 shutdown_connections 2021-01-27T09:44:38.558 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:38.553+0000 7f017e67e700 1 -- 172.21.15.146:0/3162493998 wait complete. 2021-01-27T09:44:38.560 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 7 2021-01-27T09:44:39.185 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-27T09:44:29.315988+0000', 'modified': '2021-01-27T09:44:33.763837+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4275}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4275': {'gid': 4275, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.78:6837/1117292103', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 1117292103}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 1117292103}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2021-01-27T09:44:39.186 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-27T09:44:39.186 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-01-27T09:44:39.304 INFO:teuthology.orchestra.run.smithi078.stdout:{"cluster_fsid":"968a1bec-aac5-444e-b70f-7770587be945","whoami":0,"id":4275,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.9766471729999999,"mdsmap_epoch":7,"osdmap_epoch":26,"osdmap_epoch_barrier":25,"uptime":13.436266605} 2021-01-27T09:44:39.305 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "968a1bec-aac5-444e-b70f-7770587be945", "fs_name": "cephfs", "id": 4275, "mdsmap_epoch": 7, "osdmap_epoch": 26, "osdmap_epoch_barrier": 25, "rank_uptime": 9.976647173, "state": "up:active", "uptime": 13.436266605, "want_state": "up:active", "whoami": 0 } 2021-01-27T09:44:39.306 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-27T09:44:39.306 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2021-01-27T09:44:39.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-27T09:44:39.307 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.admin) 2021-01-27T09:44:39.329 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2021-01-27T09:44:39.332 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2021-01-27T09:44:39.410 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-27T09:44:39.411 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-27T09:44:39.445 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-27T09:44:39.450 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-27T09:44:39.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-27T09:44:39.451 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2021-01-27T09:44:39.468 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-27T09:44:39.547 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --id admin --client_fs=cephfs /home/ubuntu/cephtest/mnt.admin) 2021-01-27T09:44:39.560 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2021-01-27T09:44:39.604 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-27T09:44:39.605 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-27T09:44:39.683 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-27T09:44:39.686 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-27T09:44:39.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-27T09:44:39.688 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2021-01-27T09:44:39.705 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi146.stderr:2021-01-27T09:44:39.701+0000 7fccd46ad080 -1 init, newargv = 0x562f497f42d0 newargc=15 2021-01-27T09:44:39.706 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi146.stderr:ceph-fuse[18636]: starting ceph client 2021-01-27T09:44:39.728 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi146.stderr:ceph-fuse[18636]: starting fuse 2021-01-27T09:44:40.811 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2021-01-27T09:44:40.855 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-27T09:44:40.856 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-27T09:44:40.932 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-27T09:44:40.935 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-27T09:44:40.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-27T09:44:40.936 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2021-01-27T09:44:40.956 INFO:teuthology.orchestra.run.smithi146.stdout:48 2021-01-27T09:44:40.956 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [48] 2021-01-27T09:44:40.957 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-01-27T09:44:40.957 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2021-01-27T09:44:40.958 DEBUG:teuthology.orchestra.run.smithi146:> import re 2021-01-27T09:44:40.958 DEBUG:teuthology.orchestra.run.smithi146:> import os 2021-01-27T09:44:40.958 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2021-01-27T09:44:40.959 DEBUG:teuthology.orchestra.run.smithi146:> 2021-01-27T09:44:40.959 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2021-01-27T09:44:40.959 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2021-01-27T09:44:40.960 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2021-01-27T09:44:40.960 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2021-01-27T09:44:40.961 DEBUG:teuthology.orchestra.run.smithi146:> 2021-01-27T09:44:40.961 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2021-01-27T09:44:40.961 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2021-01-27T09:44:40.962 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2021-01-27T09:44:40.962 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2021-01-27T09:44:40.963 DEBUG:teuthology.orchestra.run.smithi146:> 2021-01-27T09:44:40.963 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2021-01-27T09:44:40.963 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-27T09:44:40.964 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-27T09:44:40.964 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2021-01-27T09:44:40.964 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2021-01-27T09:44:40.965 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2021-01-27T09:44:40.965 DEBUG:teuthology.orchestra.run.smithi146:> return f 2021-01-27T09:44:40.966 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-27T09:44:40.966 DEBUG:teuthology.orchestra.run.smithi146:> 2021-01-27T09:44:40.966 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.admin")) 2021-01-27T09:44:40.967 DEBUG:teuthology.orchestra.run.smithi146:> ' 2021-01-27T09:44:41.089 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.admin.18636.asok 2021-01-27T09:44:41.276 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.18636.asok 2021-01-27T09:44:41.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-27T09:44:41.277 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.18636.asok status 2021-01-27T09:44:41.462 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2021-01-27T09:44:41.463 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2021-01-27T09:44:41.463 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "164b0f632a5fe3384fa7cbb10929c65ed7cc0f12", 2021-01-27T09:44:41.464 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 17.0.0-139-g164b0f63 (164b0f632a5fe3384fa7cbb10929c65ed7cc0f12) pacific (dev)", 2021-01-27T09:44:41.464 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "admin", 2021-01-27T09:44:41.465 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2021-01-27T09:44:41.465 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2021-01-27T09:44:41.465 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "18636", 2021-01-27T09:44:41.466 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2021-01-27T09:44:41.466 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2021-01-27T09:44:41.467 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2021-01-27T09:44:41.467 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2021-01-27T09:44:41.467 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 4366, 2021-01-27T09:44:41.468 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2021-01-27T09:44:41.468 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2021-01-27T09:44:41.469 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2021-01-27T09:44:41.469 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 4366 2021-01-27T09:44:41.469 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2021-01-27T09:44:41.470 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2021-01-27T09:44:41.470 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2021-01-27T09:44:41.471 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:0", 2021-01-27T09:44:41.471 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 3545398450 2021-01-27T09:44:41.471 INFO:teuthology.orchestra.run.smithi146.stdout: } 2021-01-27T09:44:41.472 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2021-01-27T09:44:41.472 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2021-01-27T09:44:41.473 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2021-01-27T09:44:41.473 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:0", 2021-01-27T09:44:41.473 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 3545398450 2021-01-27T09:44:41.474 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2021-01-27T09:44:41.474 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.4366 172.21.15.146:0/3545398450", 2021-01-27T09:44:41.475 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "172.21.15.146:0/3545398450", 2021-01-27T09:44:41.475 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2021-01-27T09:44:41.475 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 7, 2021-01-27T09:44:41.476 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 26, 2021-01-27T09:44:41.476 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2021-01-27T09:44:41.477 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2021-01-27T09:44:41.477 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2021-01-27T09:44:41.478 INFO:teuthology.orchestra.run.smithi146.stdout:} 2021-01-27T09:44:41.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-27T09:44:41.481 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.admin && exec sudo bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2021-01-27T09:44:41.649 INFO:teuthology.orchestra.run.smithi146.stdout:# file: . 2021-01-27T09:44:41.649 INFO:teuthology.orchestra.run.smithi146.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2021-01-27T09:44:41.649 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:44:41.654 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2021-01-27T09:44:41.654 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-27T09:44:41.655 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.admin) 2021-01-27T09:44:41.698 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi146.stderr:ceph-fuse[18636]: fuse finished with error 0 and tester_r 0 2021-01-27T09:44:41.702 INFO:teuthology.orchestra.run:waiting for 900 2021-01-27T09:44:47.805 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2021-01-27T09:44:47.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:44:47.806 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2021-01-27T09:44:47.846 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-01-27T09:44:48.008 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.005+0000 7f0b5b78d700 1 Processor -- start 2021-01-27T09:44:48.009 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.005+0000 7f0b5b78d700 1 -- start start 2021-01-27T09:44:48.010 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.005+0000 7f0b5b78d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b540be270 0x7f0b54066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:48.010 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.005+0000 7f0b5b78d700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b54156750 con 0x7f0b540be650 2021-01-27T09:44:48.010 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.005+0000 7f0b5b78d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b54155f80 con 0x7f0b540bec50 2021-01-27T09:44:48.010 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.005+0000 7f0b5b78d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b54156210 con 0x7f0b540be270 2021-01-27T09:44:48.011 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.009+0000 7f0b59529700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b540be270 0x7f0b54066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:48.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.009+0000 7f0b59529700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b540be270 0x7f0b54066520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46422/0 (socket says 172.21.15.146:46422) 2021-01-27T09:44:48.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.009+0000 7f0b59529700 1 -- 172.21.15.146:0/3838320123 learned_addr learned my addr 172.21.15.146:0/3838320123 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:48.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.009+0000 7f0b59529700 1 -- 172.21.15.146:0/3838320123 >> v1:172.21.15.146:6789/0 conn(0x7f0b540bec50 legacy=0x7f0b5414bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:48.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.009+0000 7f0b59529700 1 -- 172.21.15.146:0/3838320123 >> v1:172.21.15.78:6789/0 conn(0x7f0b540be650 legacy=0x7f0b54155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:48.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.009+0000 7f0b59529700 1 -- 172.21.15.146:0/3838320123 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b541564b0 con 0x7f0b540be270 2021-01-27T09:44:48.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.009+0000 7f0b59529700 1 --2- 172.21.15.146:0/3838320123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b540be270 0x7f0b54066520 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f0b5000ba20 tx=0x7f0b50006ee0).ready entity=mon.1 client_cookie=923093ad1d9e9881 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:48.014 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.009+0000 7f0b43fff700 1 -- 172.21.15.146:0/3838320123 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50009890 con 0x7f0b540be270 2021-01-27T09:44:48.014 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.009+0000 7f0b43fff700 1 -- 172.21.15.146:0/3838320123 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b500099f0 con 0x7f0b540be270 2021-01-27T09:44:48.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.009+0000 7f0b43fff700 1 -- 172.21.15.146:0/3838320123 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50009d70 con 0x7f0b540be270 2021-01-27T09:44:48.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.009+0000 7f0b5b78d700 1 -- 172.21.15.146:0/3838320123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b540be270 msgr2=0x7f0b54066520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:48.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.009+0000 7f0b5b78d700 1 --2- 172.21.15.146:0/3838320123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b540be270 0x7f0b54066520 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f0b5000ba20 tx=0x7f0b50006ee0).stop 2021-01-27T09:44:48.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.009+0000 7f0b5b78d700 1 -- 172.21.15.146:0/3838320123 shutdown_connections 2021-01-27T09:44:48.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.009+0000 7f0b5b78d700 1 --2- 172.21.15.146:0/3838320123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b540be270 0x7f0b54066520 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:48.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.009+0000 7f0b5b78d700 1 -- 172.21.15.146:0/3838320123 >> 172.21.15.146:0/3838320123 conn(0x7f0b54069110 msgr2=0x7f0b54067e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:48.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.009+0000 7f0b5b78d700 1 -- 172.21.15.146:0/3838320123 shutdown_connections 2021-01-27T09:44:48.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.009+0000 7f0b5b78d700 1 -- 172.21.15.146:0/3838320123 wait complete. 2021-01-27T09:44:48.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.013+0000 7f0b5b78d700 1 Processor -- start 2021-01-27T09:44:48.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.013+0000 7f0b5b78d700 1 -- start start 2021-01-27T09:44:48.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.013+0000 7f0b5b78d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b540be270 0x7f0b541650f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:48.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.013+0000 7f0b5b78d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b540be650 0x7f0b541429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:48.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.013+0000 7f0b5b78d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b540bec50 0x7f0b540b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:48.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.013+0000 7f0b5b78d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b540b71c0 con 0x7f0b540bec50 2021-01-27T09:44:48.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.013+0000 7f0b5b78d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b540b4f90 con 0x7f0b540be650 2021-01-27T09:44:48.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.013+0000 7f0b5b78d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b540b5230 con 0x7f0b540be270 2021-01-27T09:44:48.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.017+0000 7f0b58d28700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b540be650 0x7f0b541429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:48.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.017+0000 7f0b58d28700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b540be650 0x7f0b541429a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46428/0 (socket says 172.21.15.146:46428) 2021-01-27T09:44:48.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.017+0000 7f0b58d28700 1 -- 172.21.15.146:0/2587016170 learned_addr learned my addr 172.21.15.146:0/2587016170 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:48.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.017+0000 7f0b59d2a700 1 --2- 172.21.15.146:0/2587016170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b540bec50 0x7f0b540b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:48.023 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.017+0000 7f0b59529700 1 --2- 172.21.15.146:0/2587016170 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b540be270 0x7f0b541650f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:48.023 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.017+0000 7f0b58d28700 1 -- 172.21.15.146:0/2587016170 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b540be270 msgr2=0x7f0b541650f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:48.023 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.017+0000 7f0b58d28700 1 --2- 172.21.15.146:0/2587016170 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b540be270 0x7f0b541650f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:48.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.017+0000 7f0b58d28700 1 -- 172.21.15.146:0/2587016170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b540bec50 msgr2=0x7f0b540b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:48.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.017+0000 7f0b58d28700 1 --2- 172.21.15.146:0/2587016170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b540bec50 0x7f0b540b45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:48.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.017+0000 7f0b58d28700 1 -- 172.21.15.146:0/2587016170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b54164260 con 0x7f0b540be650 2021-01-27T09:44:48.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.017+0000 7f0b58d28700 1 --2- 172.21.15.146:0/2587016170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b540be650 0x7f0b541429a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f0b4400c730 tx=0x7f0b44007c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:48.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.017+0000 7f0b417fa700 1 -- 172.21.15.146:0/2587016170 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44013410 con 0x7f0b540be650 2021-01-27T09:44:48.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.017+0000 7f0b417fa700 1 -- 172.21.15.146:0/2587016170 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b44013590 con 0x7f0b540be650 2021-01-27T09:44:48.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.017+0000 7f0b5b78d700 1 -- 172.21.15.146:0/2587016170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b54164500 con 0x7f0b540be650 2021-01-27T09:44:48.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.017+0000 7f0b417fa700 1 -- 172.21.15.146:0/2587016170 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44013950 con 0x7f0b540be650 2021-01-27T09:44:48.026 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.017+0000 7f0b5b78d700 1 -- 172.21.15.146:0/2587016170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b54143330 con 0x7f0b540be650 2021-01-27T09:44:48.027 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.017+0000 7f0b5b78d700 1 -- 172.21.15.146:0/2587016170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b54044ee0 con 0x7f0b540be650 2021-01-27T09:44:48.027 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.021+0000 7f0b417fa700 1 -- 172.21.15.146:0/2587016170 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f0b44010030 con 0x7f0b540be650 2021-01-27T09:44:48.028 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.021+0000 7f0b417fa700 1 --2- 172.21.15.146:0/2587016170 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0b340561e0 0x7f0b340586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:48.028 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.021+0000 7f0b417fa700 1 -- 172.21.15.146:0/2587016170 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f0b4406f300 con 0x7f0b540be650 2021-01-27T09:44:48.028 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.021+0000 7f0b59529700 1 --2- 172.21.15.146:0/2587016170 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0b340561e0 0x7f0b340586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:48.028 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.021+0000 7f0b59529700 1 --2- 172.21.15.146:0/2587016170 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0b340561e0 0x7f0b340586a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f0b50006f20 tx=0x7f0b50016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:48.029 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.025+0000 7f0b417fa700 1 -- 172.21.15.146:0/2587016170 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f0b44044930 con 0x7f0b540be650 2021-01-27T09:44:48.168 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.165+0000 7f0b5b78d700 1 -- 172.21.15.146:0/2587016170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b540b73f0 con 0x7f0b540be650 2021-01-27T09:44:48.170 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.169+0000 7f0b417fa700 1 -- 172.21.15.146:0/2587016170 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18638 (secure 0 0 0) 0x7f0b44047f50 con 0x7f0b540be650 2021-01-27T09:44:48.171 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:44:48.171 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":26,"fsid":"968a1bec-aac5-444e-b70f-7770587be945","created":"2021-01-27T09:44:13.797940+0000","modified":"2021-01-27T09:44:33.763400+0000","last_up_change":"2021-01-27T09:44:23.479967+0000","last_in_change":"2021-01-27T09:44:23.479967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T09:44:18.497521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-27T09:44:24.550303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-27T09:44:27.607542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-27T09:44:28.331389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-01-27T09:44:31.378452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25441909-a40b-4d82-828d-326685513ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":14470},{"type":"v1","addr":"172.21.15.146:6801","nonce":14470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":14470},{"type":"v1","addr":"172.21.15.146:6803","nonce":14470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":14470},{"type":"v1","addr":"172.21.15.146:6810","nonce":14470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":14470},{"type":"v1","addr":"172.21.15.146:6807","nonce":14470}]},"public_addr":"172.21.15.146:6801/14470","cluster_addr":"172.21.15.146:6803/14470","heartbeat_back_addr":"172.21.15.146:6810/14470","heartbeat_front_addr":"172.21.15.146:6807/14470","state":["exists","up"]},{"osd":1,"uuid":"825bbc51-2ffe-4612-a300-00960e48be02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":14472},{"type":"v1","addr":"172.21.15.146:6817","nonce":14472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":14472},{"type":"v1","addr":"172.21.15.146:6819","nonce":14472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":14472},{"type":"v1","addr":"172.21.15.146:6827","nonce":14472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":14472},{"type":"v1","addr":"172.21.15.146:6823","nonce":14472}]},"public_addr":"172.21.15.146:6817/14472","cluster_addr":"172.21.15.146:6819/14472","heartbeat_back_addr":"172.21.15.146:6827/14472","heartbeat_front_addr":"172.21.15.146:6823/14472","state":["exists","up"]},{"osd":2,"uuid":"e568b97a-8e71-4ab9-bd64-056892110b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":14474},{"type":"v1","addr":"172.21.15.146:6822","nonce":14474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":14474},{"type":"v1","addr":"172.21.15.146:6826","nonce":14474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":14474},{"type":"v1","addr":"172.21.15.146:6831","nonce":14474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":14474},{"type":"v1","addr":"172.21.15.146:6829","nonce":14474}]},"public_addr":"172.21.15.146:6822/14474","cluster_addr":"172.21.15.146:6826/14474","heartbeat_back_addr":"172.21.15.146:6831/14474","heartbeat_front_addr":"172.21.15.146:6829/14474","state":["exists","up"]},{"osd":3,"uuid":"f5d50f63-f74a-4aea-a62d-51c38db4d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":14471},{"type":"v1","addr":"172.21.15.146:6806","nonce":14471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":14471},{"type":"v1","addr":"172.21.15.146:6811","nonce":14471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":14471},{"type":"v1","addr":"172.21.15.146:6815","nonce":14471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":14471},{"type":"v1","addr":"172.21.15.146:6813","nonce":14471}]},"public_addr":"172.21.15.146:6806/14471","cluster_addr":"172.21.15.146:6811/14471","heartbeat_back_addr":"172.21.15.146:6815/14471","heartbeat_front_addr":"172.21.15.146:6813/14471","state":["exists","up"]},{"osd":4,"uuid":"782458d7-6f52-48f4-9466-67b61ef27016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":15826},{"type":"v1","addr":"172.21.15.78:6817","nonce":15826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":15826},{"type":"v1","addr":"172.21.15.78:6819","nonce":15826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":15826},{"type":"v1","addr":"172.21.15.78:6823","nonce":15826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":15826},{"type":"v1","addr":"172.21.15.78:6821","nonce":15826}]},"public_addr":"172.21.15.78:6817/15826","cluster_addr":"172.21.15.78:6819/15826","heartbeat_back_addr":"172.21.15.78:6823/15826","heartbeat_front_addr":"172.21.15.78:6821/15826","state":["exists","up"]},{"osd":5,"uuid":"1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":15827},{"type":"v1","addr":"172.21.15.78:6801","nonce":15827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":15827},{"type":"v1","addr":"172.21.15.78:6803","nonce":15827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":15827},{"type":"v1","addr":"172.21.15.78:6807","nonce":15827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":15827},{"type":"v1","addr":"172.21.15.78:6805","nonce":15827}]},"public_addr":"172.21.15.78:6801/15827","cluster_addr":"172.21.15.78:6803/15827","heartbeat_back_addr":"172.21.15.78:6807/15827","heartbeat_front_addr":"172.21.15.78:6805/15827","state":["exists","up"]},{"osd":6,"uuid":"4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":15825},{"type":"v1","addr":"172.21.15.78:6809","nonce":15825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":15825},{"type":"v1","addr":"172.21.15.78:6811","nonce":15825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":15825},{"type":"v1","addr":"172.21.15.78:6815","nonce":15825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":15825},{"type":"v1","addr":"172.21.15.78:6813","nonce":15825}]},"public_addr":"172.21.15.78:6809/15825","cluster_addr":"172.21.15.78:6811/15825","heartbeat_back_addr":"172.21.15.78:6815/15825","heartbeat_front_addr":"172.21.15.78:6813/15825","state":["exists","up"]},{"osd":7,"uuid":"851aeaf3-bcdc-4ac6-b578-c42e1bf87c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":15828},{"type":"v1","addr":"172.21.15.78:6825","nonce":15828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":15828},{"type":"v1","addr":"172.21.15.78:6827","nonce":15828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":15828},{"type":"v1","addr":"172.21.15.78:6831","nonce":15828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":15828},{"type":"v1","addr":"172.21.15.78:6829","nonce":15828}]},"public_addr":"172.21.15.78:6825/15828","cluster_addr":"172.21.15.78:6827/15828","heartbeat_back_addr":"172.21.15.78:6831/15828","heartbeat_front_addr":"172.21.15.78:6829/15828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.573930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.718144+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.641838+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.551598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.374444+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.171108+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.360910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.356020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:44:48.172 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.169+0000 7f0b5b78d700 1 -- 172.21.15.146:0/2587016170 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0b340561e0 msgr2=0x7f0b340586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:48.173 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.169+0000 7f0b5b78d700 1 --2- 172.21.15.146:0/2587016170 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0b340561e0 0x7f0b340586a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f0b50006f20 tx=0x7f0b50016000).stop 2021-01-27T09:44:48.173 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.169+0000 7f0b5b78d700 1 -- 172.21.15.146:0/2587016170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b540be650 msgr2=0x7f0b541429a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:48.173 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.169+0000 7f0b5b78d700 1 --2- 172.21.15.146:0/2587016170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b540be650 0x7f0b541429a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f0b4400c730 tx=0x7f0b44007c30).stop 2021-01-27T09:44:48.174 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.169+0000 7f0b5b78d700 1 -- 172.21.15.146:0/2587016170 shutdown_connections 2021-01-27T09:44:48.174 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.169+0000 7f0b5b78d700 1 --2- 172.21.15.146:0/2587016170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b540bec50 0x7f0b540b45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:48.174 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.169+0000 7f0b5b78d700 1 --2- 172.21.15.146:0/2587016170 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0b340561e0 0x7f0b340586a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:48.175 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.169+0000 7f0b5b78d700 1 --2- 172.21.15.146:0/2587016170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b540be650 0x7f0b541429a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:48.175 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.169+0000 7f0b5b78d700 1 --2- 172.21.15.146:0/2587016170 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b540be270 0x7f0b541650f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:48.175 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.169+0000 7f0b5b78d700 1 -- 172.21.15.146:0/2587016170 >> 172.21.15.146:0/2587016170 conn(0x7f0b54069110 msgr2=0x7f0b540b9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:48.175 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.169+0000 7f0b5b78d700 1 -- 172.21.15.146:0/2587016170 shutdown_connections 2021-01-27T09:44:48.175 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.169+0000 7f0b5b78d700 1 -- 172.21.15.146:0/2587016170 wait complete. 2021-01-27T09:44:48.199 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-01-27T09:44:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.349+0000 7f1a1a050700 1 Processor -- start 2021-01-27T09:44:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.353+0000 7f1a1a050700 1 -- start start 2021-01-27T09:44:48.357 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.353+0000 7f1a1a050700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1a14069690 0x7f1a1414bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:48.357 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.353+0000 7f1a1a050700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a14152ec0 con 0x7f1a1414bfb0 2021-01-27T09:44:48.357 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.353+0000 7f1a1a050700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a140be1b0 con 0x7f1a140692b0 2021-01-27T09:44:48.358 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.353+0000 7f1a1a050700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a140be450 con 0x7f1a14069690 2021-01-27T09:44:48.358 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.353+0000 7f1a1904e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1a140692b0 0x7f1a140bcc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46008/0 (socket says 172.21.15.146:46008) 2021-01-27T09:44:48.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.353+0000 7f1a1904e700 1 -- 172.21.15.146:0/108903075 learned_addr learned my addr 172.21.15.146:0/108903075 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:48.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.353+0000 7f1a1884d700 1 --2- 172.21.15.146:0/108903075 >> v2:172.21.15.78:3300/0 conn(0x7f1a14069690 0x7f1a1414bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:48.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.357+0000 7f1a03fff700 1 -- 172.21.15.146:0/108903075 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517820556 0 0) 0x7f1a140be1b0 con 0x7f1a140692b0 2021-01-27T09:44:48.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.357+0000 7f1a03fff700 1 -- 172.21.15.146:0/108903075 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19fc003270 con 0x7f1a140692b0 2021-01-27T09:44:48.360 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.357+0000 7f1a1884d700 1 -- 172.21.15.146:0/108903075 >> v1:172.21.15.146:6789/0 conn(0x7f1a140692b0 legacy=0x7f1a140bcc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:48.360 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.357+0000 7f1a1884d700 1 -- 172.21.15.146:0/108903075 >> v1:172.21.15.78:6789/0 conn(0x7f1a1414bfb0 legacy=0x7f1a14151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:48.361 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.357+0000 7f1a1884d700 1 -- 172.21.15.146:0/108903075 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a140be6f0 con 0x7f1a14069690 2021-01-27T09:44:48.361 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.357+0000 7f1a1884d700 1 --2- 172.21.15.146:0/108903075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a14069690 0x7f1a1414bac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f1a0400b9c0 tx=0x7f1a04006e20).ready entity=mon.0 client_cookie=b374298750d71cef server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:48.361 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.357+0000 7f1a03fff700 1 -- 172.21.15.146:0/108903075 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a040097e0 con 0x7f1a14069690 2021-01-27T09:44:48.361 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.357+0000 7f1a03fff700 1 -- 172.21.15.146:0/108903075 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a04009940 con 0x7f1a14069690 2021-01-27T09:44:48.361 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.357+0000 7f1a03fff700 1 -- 172.21.15.146:0/108903075 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a04009cc0 con 0x7f1a14069690 2021-01-27T09:44:48.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.357+0000 7f1a1a050700 1 -- 172.21.15.146:0/108903075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a14069690 msgr2=0x7f1a1414bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:48.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.357+0000 7f1a1a050700 1 --2- 172.21.15.146:0/108903075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a14069690 0x7f1a1414bac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f1a0400b9c0 tx=0x7f1a04006e20).stop 2021-01-27T09:44:48.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.357+0000 7f1a1a050700 1 -- 172.21.15.146:0/108903075 shutdown_connections 2021-01-27T09:44:48.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.357+0000 7f1a1a050700 1 --2- 172.21.15.146:0/108903075 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a14069690 0x7f1a1414bac0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:48.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.357+0000 7f1a1a050700 1 -- 172.21.15.146:0/108903075 >> 172.21.15.146:0/108903075 conn(0x7f1a14064240 msgr2=0x7f1a140601f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:48.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.361+0000 7f1a1a050700 1 -- 172.21.15.146:0/108903075 shutdown_connections 2021-01-27T09:44:48.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.361+0000 7f1a1a050700 1 -- 172.21.15.146:0/108903075 wait complete. 2021-01-27T09:44:48.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.361+0000 7f1a1a050700 1 Processor -- start 2021-01-27T09:44:48.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.361+0000 7f1a1a050700 1 -- start start 2021-01-27T09:44:48.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.361+0000 7f1a1a050700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a140692b0 0x7f1a141659c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:48.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.361+0000 7f1a1a050700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a14069690 0x7f1a14065fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:48.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.361+0000 7f1a1a050700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1414bfb0 0x7f1a14144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:48.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.361+0000 7f1a1a050700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a14165eb0 con 0x7f1a14069690 2021-01-27T09:44:48.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.361+0000 7f1a1a050700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a14149d30 con 0x7f1a1414bfb0 2021-01-27T09:44:48.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.361+0000 7f1a1a050700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a14150a90 con 0x7f1a140692b0 2021-01-27T09:44:48.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.365+0000 7f1a1884d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a14069690 0x7f1a14065fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:48.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.365+0000 7f1a1984f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1414bfb0 0x7f1a14144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:48.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.365+0000 7f1a1904e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a140692b0 0x7f1a141659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:48.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.365+0000 7f1a1884d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a14069690 0x7f1a14065fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:49318/0 (socket says 172.21.15.146:49318) 2021-01-27T09:44:48.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.365+0000 7f1a1884d700 1 -- 172.21.15.146:0/3438554555 learned_addr learned my addr 172.21.15.146:0/3438554555 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:48.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.365+0000 7f1a1984f700 1 -- 172.21.15.146:0/3438554555 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a140692b0 msgr2=0x7f1a141659c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:48.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.365+0000 7f1a1984f700 1 --2- 172.21.15.146:0/3438554555 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a140692b0 0x7f1a141659c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:48.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.365+0000 7f1a1984f700 1 -- 172.21.15.146:0/3438554555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a14069690 msgr2=0x7f1a14065fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:48.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.365+0000 7f1a1984f700 1 --2- 172.21.15.146:0/3438554555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a14069690 0x7f1a14065fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:48.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.365+0000 7f1a1984f700 1 -- 172.21.15.146:0/3438554555 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a14149f60 con 0x7f1a1414bfb0 2021-01-27T09:44:48.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.365+0000 7f1a1984f700 1 --2- 172.21.15.146:0/3438554555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1414bfb0 0x7f1a14144ea0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f1a0c00ca60 tx=0x7f1a0c007f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:48.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.365+0000 7f1a017fa700 1 -- 172.21.15.146:0/3438554555 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c00a550 con 0x7f1a1414bfb0 2021-01-27T09:44:48.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.365+0000 7f1a017fa700 1 -- 172.21.15.146:0/3438554555 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0c00a6b0 con 0x7f1a1414bfb0 2021-01-27T09:44:48.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.365+0000 7f1a1a050700 1 -- 172.21.15.146:0/3438554555 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1414a200 con 0x7f1a1414bfb0 2021-01-27T09:44:48.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.365+0000 7f1a017fa700 1 -- 172.21.15.146:0/3438554555 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c00aa50 con 0x7f1a1414bfb0 2021-01-27T09:44:48.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.365+0000 7f1a1a050700 1 -- 172.21.15.146:0/3438554555 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a14144a00 con 0x7f1a1414bfb0 2021-01-27T09:44:48.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.365+0000 7f1a1a050700 1 -- 172.21.15.146:0/3438554555 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a14063d90 con 0x7f1a1414bfb0 2021-01-27T09:44:48.373 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.369+0000 7f1a017fa700 1 -- 172.21.15.146:0/3438554555 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f1a0c019030 con 0x7f1a1414bfb0 2021-01-27T09:44:48.373 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.369+0000 7f1a017fa700 1 --2- 172.21.15.146:0/3438554555 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f19f40561e0 0x7f19f40586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:48.373 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.369+0000 7f1a017fa700 1 -- 172.21.15.146:0/3438554555 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f1a0c003030 con 0x7f1a1414bfb0 2021-01-27T09:44:48.373 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.369+0000 7f1a1904e700 1 --2- 172.21.15.146:0/3438554555 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f19f40561e0 0x7f19f40586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:48.374 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.369+0000 7f1a1904e700 1 --2- 172.21.15.146:0/3438554555 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f19f40561e0 0x7f19f40586a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f1a100055d0 tx=0x7f1a10009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:48.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.373+0000 7f1a017fa700 1 -- 172.21.15.146:0/3438554555 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f1a0c070e60 con 0x7f1a1414bfb0 2021-01-27T09:44:48.518 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.513+0000 7f1a1a050700 1 -- 172.21.15.146:0/3438554555 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a14067840 con 0x7f1a1414bfb0 2021-01-27T09:44:48.520 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.517+0000 7f1a017fa700 1 -- 172.21.15.146:0/3438554555 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18638 (secure 0 0 0) 0x7f1a0c044260 con 0x7f1a1414bfb0 2021-01-27T09:44:48.521 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:44:48.521 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":26,"fsid":"968a1bec-aac5-444e-b70f-7770587be945","created":"2021-01-27T09:44:13.797940+0000","modified":"2021-01-27T09:44:33.763400+0000","last_up_change":"2021-01-27T09:44:23.479967+0000","last_in_change":"2021-01-27T09:44:23.479967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T09:44:18.497521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-27T09:44:24.550303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-27T09:44:27.607542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-27T09:44:28.331389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-01-27T09:44:31.378452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25441909-a40b-4d82-828d-326685513ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":14470},{"type":"v1","addr":"172.21.15.146:6801","nonce":14470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":14470},{"type":"v1","addr":"172.21.15.146:6803","nonce":14470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":14470},{"type":"v1","addr":"172.21.15.146:6810","nonce":14470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":14470},{"type":"v1","addr":"172.21.15.146:6807","nonce":14470}]},"public_addr":"172.21.15.146:6801/14470","cluster_addr":"172.21.15.146:6803/14470","heartbeat_back_addr":"172.21.15.146:6810/14470","heartbeat_front_addr":"172.21.15.146:6807/14470","state":["exists","up"]},{"osd":1,"uuid":"825bbc51-2ffe-4612-a300-00960e48be02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":14472},{"type":"v1","addr":"172.21.15.146:6817","nonce":14472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":14472},{"type":"v1","addr":"172.21.15.146:6819","nonce":14472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":14472},{"type":"v1","addr":"172.21.15.146:6827","nonce":14472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":14472},{"type":"v1","addr":"172.21.15.146:6823","nonce":14472}]},"public_addr":"172.21.15.146:6817/14472","cluster_addr":"172.21.15.146:6819/14472","heartbeat_back_addr":"172.21.15.146:6827/14472","heartbeat_front_addr":"172.21.15.146:6823/14472","state":["exists","up"]},{"osd":2,"uuid":"e568b97a-8e71-4ab9-bd64-056892110b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":14474},{"type":"v1","addr":"172.21.15.146:6822","nonce":14474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":14474},{"type":"v1","addr":"172.21.15.146:6826","nonce":14474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":14474},{"type":"v1","addr":"172.21.15.146:6831","nonce":14474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":14474},{"type":"v1","addr":"172.21.15.146:6829","nonce":14474}]},"public_addr":"172.21.15.146:6822/14474","cluster_addr":"172.21.15.146:6826/14474","heartbeat_back_addr":"172.21.15.146:6831/14474","heartbeat_front_addr":"172.21.15.146:6829/14474","state":["exists","up"]},{"osd":3,"uuid":"f5d50f63-f74a-4aea-a62d-51c38db4d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":14471},{"type":"v1","addr":"172.21.15.146:6806","nonce":14471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":14471},{"type":"v1","addr":"172.21.15.146:6811","nonce":14471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":14471},{"type":"v1","addr":"172.21.15.146:6815","nonce":14471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":14471},{"type":"v1","addr":"172.21.15.146:6813","nonce":14471}]},"public_addr":"172.21.15.146:6806/14471","cluster_addr":"172.21.15.146:6811/14471","heartbeat_back_addr":"172.21.15.146:6815/14471","heartbeat_front_addr":"172.21.15.146:6813/14471","state":["exists","up"]},{"osd":4,"uuid":"782458d7-6f52-48f4-9466-67b61ef27016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":15826},{"type":"v1","addr":"172.21.15.78:6817","nonce":15826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":15826},{"type":"v1","addr":"172.21.15.78:6819","nonce":15826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":15826},{"type":"v1","addr":"172.21.15.78:6823","nonce":15826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":15826},{"type":"v1","addr":"172.21.15.78:6821","nonce":15826}]},"public_addr":"172.21.15.78:6817/15826","cluster_addr":"172.21.15.78:6819/15826","heartbeat_back_addr":"172.21.15.78:6823/15826","heartbeat_front_addr":"172.21.15.78:6821/15826","state":["exists","up"]},{"osd":5,"uuid":"1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":15827},{"type":"v1","addr":"172.21.15.78:6801","nonce":15827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":15827},{"type":"v1","addr":"172.21.15.78:6803","nonce":15827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":15827},{"type":"v1","addr":"172.21.15.78:6807","nonce":15827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":15827},{"type":"v1","addr":"172.21.15.78:6805","nonce":15827}]},"public_addr":"172.21.15.78:6801/15827","cluster_addr":"172.21.15.78:6803/15827","heartbeat_back_addr":"172.21.15.78:6807/15827","heartbeat_front_addr":"172.21.15.78:6805/15827","state":["exists","up"]},{"osd":6,"uuid":"4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":15825},{"type":"v1","addr":"172.21.15.78:6809","nonce":15825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":15825},{"type":"v1","addr":"172.21.15.78:6811","nonce":15825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":15825},{"type":"v1","addr":"172.21.15.78:6815","nonce":15825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":15825},{"type":"v1","addr":"172.21.15.78:6813","nonce":15825}]},"public_addr":"172.21.15.78:6809/15825","cluster_addr":"172.21.15.78:6811/15825","heartbeat_back_addr":"172.21.15.78:6815/15825","heartbeat_front_addr":"172.21.15.78:6813/15825","state":["exists","up"]},{"osd":7,"uuid":"851aeaf3-bcdc-4ac6-b578-c42e1bf87c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":15828},{"type":"v1","addr":"172.21.15.78:6825","nonce":15828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":15828},{"type":"v1","addr":"172.21.15.78:6827","nonce":15828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":15828},{"type":"v1","addr":"172.21.15.78:6831","nonce":15828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":15828},{"type":"v1","addr":"172.21.15.78:6829","nonce":15828}]},"public_addr":"172.21.15.78:6825/15828","cluster_addr":"172.21.15.78:6827/15828","heartbeat_back_addr":"172.21.15.78:6831/15828","heartbeat_front_addr":"172.21.15.78:6829/15828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.573930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.718144+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.641838+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.551598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.374444+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.171108+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.360910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.356020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:44:48.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.521+0000 7f1a1a050700 1 -- 172.21.15.146:0/3438554555 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f19f40561e0 msgr2=0x7f19f40586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:48.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.521+0000 7f1a1a050700 1 --2- 172.21.15.146:0/3438554555 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f19f40561e0 0x7f19f40586a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f1a100055d0 tx=0x7f1a10009040).stop 2021-01-27T09:44:48.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.521+0000 7f1a1a050700 1 -- 172.21.15.146:0/3438554555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1414bfb0 msgr2=0x7f1a14144ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:48.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.521+0000 7f1a1a050700 1 --2- 172.21.15.146:0/3438554555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1414bfb0 0x7f1a14144ea0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f1a0c00ca60 tx=0x7f1a0c007f40).stop 2021-01-27T09:44:48.525 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.521+0000 7f1a1a050700 1 -- 172.21.15.146:0/3438554555 shutdown_connections 2021-01-27T09:44:48.525 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.521+0000 7f1a1a050700 1 --2- 172.21.15.146:0/3438554555 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f19f40561e0 0x7f19f40586a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.521+0000 7f1a1a050700 1 --2- 172.21.15.146:0/3438554555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1414bfb0 0x7f1a14144ea0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.521+0000 7f1a1a050700 1 --2- 172.21.15.146:0/3438554555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a14069690 0x7f1a14065fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.521+0000 7f1a1a050700 1 --2- 172.21.15.146:0/3438554555 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a140692b0 0x7f1a141659c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.521+0000 7f1a1a050700 1 -- 172.21.15.146:0/3438554555 >> 172.21.15.146:0/3438554555 conn(0x7f1a14064240 msgr2=0x7f1a140bcc00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:48.527 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.521+0000 7f1a1a050700 1 -- 172.21.15.146:0/3438554555 shutdown_connections 2021-01-27T09:44:48.527 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.521+0000 7f1a1a050700 1 -- 172.21.15.146:0/3438554555 wait complete. 2021-01-27T09:44:48.552 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-01-27T09:44:48.720 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.717+0000 7fa55f0dc700 1 Processor -- start 2021-01-27T09:44:48.721 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.717+0000 7fa55f0dc700 1 -- start start 2021-01-27T09:44:48.724 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.721+0000 7fa55f0dc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa5580bccb0 0x7fa55814b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:48.724 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.721+0000 7fa55f0dc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5580bd090 0x7fa558066b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:48.724 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.721+0000 7fa55f0dc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa558063050 con 0x7fa5580bd710 2021-01-27T09:44:48.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.721+0000 7fa55f0dc700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5580bc7f0 con 0x7fa5580bd090 2021-01-27T09:44:48.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.721+0000 7fa55f0dc700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55814b800 con 0x7fa5580bccb0 2021-01-27T09:44:48.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.721+0000 7fa55e0da700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa5580bccb0 0x7fa55814b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:48.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.721+0000 7fa55d8d9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5580bd090 0x7fa558066b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:48.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.721+0000 7fa55e0da700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa5580bccb0 0x7fa55814b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:35940/0 (socket says 172.21.15.146:35940) 2021-01-27T09:44:48.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.721+0000 7fa55e0da700 1 -- 172.21.15.146:0/1854635492 learned_addr learned my addr 172.21.15.146:0/1854635492 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:48.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.721+0000 7fa55e0da700 1 -- 172.21.15.146:0/1854635492 >> v2:172.21.15.78:3300/0 conn(0x7fa5580bd090 msgr2=0x7fa558066b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:48.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.721+0000 7fa55e0da700 1 --2- 172.21.15.146:0/1854635492 >> v2:172.21.15.78:3300/0 conn(0x7fa5580bd090 0x7fa558066b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:48.729 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.721+0000 7fa55e0da700 1 -- 172.21.15.146:0/1854635492 >> v1:172.21.15.146:6789/0 conn(0x7fa5580bd710 legacy=0x7fa5581477e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:48.729 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.721+0000 7fa55e0da700 1 -- 172.21.15.146:0/1854635492 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5580632f0 con 0x7fa5580bccb0 2021-01-27T09:44:48.729 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.725+0000 7fa55e0da700 1 --2- 172.21.15.146:0/1854635492 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa5580bccb0 0x7fa55814b310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fa55400bca0 tx=0x7fa554006f70).ready entity=mon.2 client_cookie=a902edbbda826540 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:48.729 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.725+0000 7fa55d0d8700 1 -- 172.21.15.146:0/1854635492 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55400dc50 con 0x7fa5580bccb0 2021-01-27T09:44:48.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.725+0000 7fa55d0d8700 1 -- 172.21.15.146:0/1854635492 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55400ddb0 con 0x7fa5580bccb0 2021-01-27T09:44:48.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.725+0000 7fa55d0d8700 1 -- 172.21.15.146:0/1854635492 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa554010680 con 0x7fa5580bccb0 2021-01-27T09:44:48.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.725+0000 7fa55f0dc700 1 -- 172.21.15.146:0/1854635492 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa5580bccb0 msgr2=0x7fa55814b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:48.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.725+0000 7fa55f0dc700 1 --2- 172.21.15.146:0/1854635492 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa5580bccb0 0x7fa55814b310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fa55400bca0 tx=0x7fa554006f70).stop 2021-01-27T09:44:48.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.725+0000 7fa55f0dc700 1 -- 172.21.15.146:0/1854635492 shutdown_connections 2021-01-27T09:44:48.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.725+0000 7fa55f0dc700 1 --2- 172.21.15.146:0/1854635492 >> v2:172.21.15.78:3300/0 conn(0x7fa5580bd090 0x7fa558066b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:48.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.725+0000 7fa55f0dc700 1 --2- 172.21.15.146:0/1854635492 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa5580bccb0 0x7fa55814b310 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:48.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.725+0000 7fa55f0dc700 1 -- 172.21.15.146:0/1854635492 >> 172.21.15.146:0/1854635492 conn(0x7fa558069ba0 msgr2=0x7fa558062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:48.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.725+0000 7fa55f0dc700 1 -- 172.21.15.146:0/1854635492 shutdown_connections 2021-01-27T09:44:48.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.725+0000 7fa55f0dc700 1 -- 172.21.15.146:0/1854635492 wait complete. 2021-01-27T09:44:48.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa55f0dc700 1 Processor -- start 2021-01-27T09:44:48.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa55f0dc700 1 -- start start 2021-01-27T09:44:48.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa55f0dc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5580bccb0 0x7fa5580b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:48.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa55f0dc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5580bd090 0x7fa55815ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:48.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa55f0dc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa5580bd710 0x7fa55815f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:48.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa55f0dc700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55815df40 con 0x7fa5580bccb0 2021-01-27T09:44:48.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa55f0dc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55815f6d0 con 0x7fa5580bd090 2021-01-27T09:44:48.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa55f0dc700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55815e120 con 0x7fa5580bd710 2021-01-27T09:44:48.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa55d8d9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5580bd090 0x7fa55815ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:48.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa55d8d9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5580bd090 0x7fa55815ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46460/0 (socket says 172.21.15.146:46460) 2021-01-27T09:44:48.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa55d8d9700 1 -- 172.21.15.146:0/4146685156 learned_addr learned my addr 172.21.15.146:0/4146685156 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:48.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa55e0da700 1 --2- 172.21.15.146:0/4146685156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5580bccb0 0x7fa5580b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:48.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa55e8db700 1 --2- 172.21.15.146:0/4146685156 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa5580bd710 0x7fa55815f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:48.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa55d8d9700 1 -- 172.21.15.146:0/4146685156 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa5580bd710 msgr2=0x7fa55815f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:48.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa55d8d9700 1 --2- 172.21.15.146:0/4146685156 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa5580bd710 0x7fa55815f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:48.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa55d8d9700 1 -- 172.21.15.146:0/4146685156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5580bccb0 msgr2=0x7fa5580b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:48.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa55d8d9700 1 --2- 172.21.15.146:0/4146685156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5580bccb0 0x7fa5580b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:48.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa55d8d9700 1 -- 172.21.15.146:0/4146685156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55815e3c0 con 0x7fa5580bd090 2021-01-27T09:44:48.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa55e0da700 1 --2- 172.21.15.146:0/4146685156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5580bccb0 0x7fa5580b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:44:48.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa55d8d9700 1 --2- 172.21.15.146:0/4146685156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5580bd090 0x7fa55815ecf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fa54800ebd0 tx=0x7fa548006e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:48.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa5467fc700 1 -- 172.21.15.146:0/4146685156 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54800c9b0 con 0x7fa5580bd090 2021-01-27T09:44:48.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa5467fc700 1 -- 172.21.15.146:0/4146685156 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54800cb10 con 0x7fa5580bd090 2021-01-27T09:44:48.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa5467fc700 1 -- 172.21.15.146:0/4146685156 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54800ce90 con 0x7fa5580bd090 2021-01-27T09:44:48.740 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.729+0000 7fa55f0dc700 1 -- 172.21.15.146:0/4146685156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5580b43b0 con 0x7fa5580bd090 2021-01-27T09:44:48.740 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.733+0000 7fa55f0dc700 1 -- 172.21.15.146:0/4146685156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5580b48f0 con 0x7fa5580bd090 2021-01-27T09:44:48.741 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.733+0000 7fa55f0dc700 1 -- 172.21.15.146:0/4146685156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5580b4ab0 con 0x7fa5580bd090 2021-01-27T09:44:48.741 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.733+0000 7fa5467fc700 1 -- 172.21.15.146:0/4146685156 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fa548012600 con 0x7fa5580bd090 2021-01-27T09:44:48.741 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.733+0000 7fa5467fc700 1 --2- 172.21.15.146:0/4146685156 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa5380561e0 0x7fa5380586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:48.742 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.733+0000 7fa5467fc700 1 -- 172.21.15.146:0/4146685156 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fa54806fa10 con 0x7fa5580bd090 2021-01-27T09:44:48.742 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.737+0000 7fa55e0da700 1 --2- 172.21.15.146:0/4146685156 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa5380561e0 0x7fa5380586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:48.742 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.737+0000 7fa55e0da700 1 --2- 172.21.15.146:0/4146685156 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa5380561e0 0x7fa5380586a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fa55400bfd0 tx=0x7fa5580ba330).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:48.743 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.741+0000 7fa5467fc700 1 -- 172.21.15.146:0/4146685156 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fa5480450c0 con 0x7fa5580bd090 2021-01-27T09:44:48.912 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:48.909+0000 7fa55f0dc700 1 -- 172.21.15.146:0/4146685156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa558044680 con 0x7fa5580bd090 2021-01-27T09:44:49.561 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.557+0000 7fa5467fc700 1 -- 172.21.15.146:0/4146685156 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa5480486e0 con 0x7fa5580bd090 2021-01-27T09:44:49.565 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.561+0000 7fa55f0dc700 1 -- 172.21.15.146:0/4146685156 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa5380561e0 msgr2=0x7fa5380586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:49.565 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.561+0000 7fa55f0dc700 1 --2- 172.21.15.146:0/4146685156 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa5380561e0 0x7fa5380586a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fa55400bfd0 tx=0x7fa5580ba330).stop 2021-01-27T09:44:49.566 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.561+0000 7fa55f0dc700 1 -- 172.21.15.146:0/4146685156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5580bd090 msgr2=0x7fa55815ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:49.566 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.561+0000 7fa55f0dc700 1 --2- 172.21.15.146:0/4146685156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5580bd090 0x7fa55815ecf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fa54800ebd0 tx=0x7fa548006e20).stop 2021-01-27T09:44:49.566 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.561+0000 7fa55f0dc700 1 -- 172.21.15.146:0/4146685156 shutdown_connections 2021-01-27T09:44:49.566 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.561+0000 7fa55f0dc700 1 --2- 172.21.15.146:0/4146685156 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa5580bd710 0x7fa55815f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:49.567 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.561+0000 7fa55f0dc700 1 --2- 172.21.15.146:0/4146685156 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa5380561e0 0x7fa5380586a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:49.567 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.561+0000 7fa55f0dc700 1 --2- 172.21.15.146:0/4146685156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5580bd090 0x7fa55815ecf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:49.567 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.561+0000 7fa55f0dc700 1 --2- 172.21.15.146:0/4146685156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5580bccb0 0x7fa5580b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:49.567 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.561+0000 7fa55f0dc700 1 -- 172.21.15.146:0/4146685156 >> 172.21.15.146:0/4146685156 conn(0x7fa558069ba0 msgr2=0x7fa5581459c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:49.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.561+0000 7fa55f0dc700 1 -- 172.21.15.146:0/4146685156 shutdown_connections 2021-01-27T09:44:49.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.565+0000 7fa55f0dc700 1 -- 172.21.15.146:0/4146685156 wait complete. 2021-01-27T09:44:49.593 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2021-01-27T09:44:49.764 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.761+0000 7f236954d700 1 Processor -- start 2021-01-27T09:44:49.764 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.761+0000 7f236954d700 1 -- start start 2021-01-27T09:44:49.767 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.765+0000 7f236954d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f23640bd090 0x7f236414b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:49.767 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.765+0000 7f236954d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f23640bd710 0x7f23641477e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.765+0000 7f236954d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2364063050 con 0x7f23640bccb0 2021-01-27T09:44:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.765+0000 7f236954d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23640bc7f0 con 0x7f23640bd090 2021-01-27T09:44:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.765+0000 7f236954d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f236414b800 con 0x7f23640bd710 2021-01-27T09:44:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.765+0000 7f2368d4c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f23640bd710 0x7f23641477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.765+0000 7f23637fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f23640bd090 0x7f236414b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.765+0000 7f23637fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f23640bd090 0x7f236414b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:49344/0 (socket says 172.21.15.146:49344) 2021-01-27T09:44:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.765+0000 7f23637fe700 1 -- 172.21.15.146:0/2916754365 learned_addr learned my addr 172.21.15.146:0/2916754365 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.765+0000 7f2363fff700 1 --1- 172.21.15.146:0/2916754365 >> v1:172.21.15.146:6789/0 conn(0x7f23640bccb0 0x7f2364066b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46040/0 (socket says 172.21.15.146:46040) 2021-01-27T09:44:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.765+0000 7f2368d4c700 1 -- 172.21.15.146:0/2916754365 >> v2:172.21.15.78:3300/0 conn(0x7f23640bd090 msgr2=0x7f236414b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:49.771 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.765+0000 7f2368d4c700 1 --2- 172.21.15.146:0/2916754365 >> v2:172.21.15.78:3300/0 conn(0x7f23640bd090 0x7f236414b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:49.771 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.765+0000 7f2368d4c700 1 -- 172.21.15.146:0/2916754365 >> v1:172.21.15.146:6789/0 conn(0x7f23640bccb0 legacy=0x7f2364066b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:49.771 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.765+0000 7f2368d4c700 1 -- 172.21.15.146:0/2916754365 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23640632f0 con 0x7f23640bd710 2021-01-27T09:44:49.772 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.765+0000 7f2368d4c700 1 --2- 172.21.15.146:0/2916754365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23640bd710 0x7f23641477e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f23640ba330 tx=0x7f235c009220).ready entity=mon.1 client_cookie=b7c30bea6d7d3af8 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:49.772 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.769+0000 7f2362ffd700 1 -- 172.21.15.146:0/2916754365 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c00b9e0 con 0x7f23640bd710 2021-01-27T09:44:49.772 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.769+0000 7f2362ffd700 1 -- 172.21.15.146:0/2916754365 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c00bb40 con 0x7f23640bd710 2021-01-27T09:44:49.773 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.769+0000 7f2362ffd700 1 -- 172.21.15.146:0/2916754365 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c011400 con 0x7f23640bd710 2021-01-27T09:44:49.773 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.769+0000 7f236954d700 1 -- 172.21.15.146:0/2916754365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23640bd710 msgr2=0x7f23641477e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:49.773 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.769+0000 7f236954d700 1 --2- 172.21.15.146:0/2916754365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23640bd710 0x7f23641477e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f23640ba330 tx=0x7f235c009220).stop 2021-01-27T09:44:49.773 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.769+0000 7f236954d700 1 -- 172.21.15.146:0/2916754365 shutdown_connections 2021-01-27T09:44:49.774 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.769+0000 7f236954d700 1 --2- 172.21.15.146:0/2916754365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23640bd710 0x7f23641477e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:49.774 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.769+0000 7f236954d700 1 --2- 172.21.15.146:0/2916754365 >> v2:172.21.15.78:3300/0 conn(0x7f23640bd090 0x7f236414b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:49.774 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.769+0000 7f236954d700 1 -- 172.21.15.146:0/2916754365 >> 172.21.15.146:0/2916754365 conn(0x7f2364069ba0 msgr2=0x7f2364062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:49.774 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.769+0000 7f236954d700 1 -- 172.21.15.146:0/2916754365 shutdown_connections 2021-01-27T09:44:49.774 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.769+0000 7f236954d700 1 -- 172.21.15.146:0/2916754365 wait complete. 2021-01-27T09:44:49.777 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.769+0000 7f236954d700 1 Processor -- start 2021-01-27T09:44:49.777 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.769+0000 7f236954d700 1 -- start start 2021-01-27T09:44:49.777 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f236954d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23640bccb0 0x7f2364160640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:49.777 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f236954d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23640bd090 0x7f236415d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:49.777 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f236954d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f23640bd710 0x7f23640bb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:49.778 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f236954d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23641488c0 con 0x7f23640bccb0 2021-01-27T09:44:49.778 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f236954d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23640befa0 con 0x7f23640bd090 2021-01-27T09:44:49.778 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f236954d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2364160bf0 con 0x7f23640bd710 2021-01-27T09:44:49.778 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f23637fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23640bd090 0x7f236415d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:49.779 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f23637fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23640bd090 0x7f236415d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46476/0 (socket says 172.21.15.146:46476) 2021-01-27T09:44:49.779 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f23637fe700 1 -- 172.21.15.146:0/2472011464 learned_addr learned my addr 172.21.15.146:0/2472011464 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:49.779 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f2368d4c700 1 --2- 172.21.15.146:0/2472011464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f23640bd710 0x7f23640bb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:49.779 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f2363fff700 1 --2- 172.21.15.146:0/2472011464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23640bccb0 0x7f2364160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:49.779 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f23637fe700 1 -- 172.21.15.146:0/2472011464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f23640bd710 msgr2=0x7f23640bb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:49.780 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f23637fe700 1 --2- 172.21.15.146:0/2472011464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f23640bd710 0x7f23640bb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:49.780 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f23637fe700 1 -- 172.21.15.146:0/2472011464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23640bccb0 msgr2=0x7f2364160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:49.780 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f23637fe700 1 --2- 172.21.15.146:0/2472011464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23640bccb0 0x7f2364160640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:49.780 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f23637fe700 1 -- 172.21.15.146:0/2472011464 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2364160e90 con 0x7f23640bd090 2021-01-27T09:44:49.780 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f2363fff700 1 --2- 172.21.15.146:0/2472011464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23640bccb0 0x7f2364160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:44:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f23637fe700 1 --2- 172.21.15.146:0/2472011464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23640bd090 0x7f236415d0f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f235800f9b0 tx=0x7f2358008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f234bfff700 1 -- 172.21.15.146:0/2472011464 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235800fe40 con 0x7f23640bd090 2021-01-27T09:44:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f234bfff700 1 -- 172.21.15.146:0/2472011464 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235800d860 con 0x7f23640bd090 2021-01-27T09:44:49.781 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f236954d700 1 -- 172.21.15.146:0/2472011464 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2364161130 con 0x7f23640bd090 2021-01-27T09:44:49.782 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f234bfff700 1 -- 172.21.15.146:0/2472011464 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235800dbe0 con 0x7f23640bd090 2021-01-27T09:44:49.782 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f236954d700 1 -- 172.21.15.146:0/2472011464 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23640bbce0 con 0x7f23640bd090 2021-01-27T09:44:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.773+0000 7f236954d700 1 -- 172.21.15.146:0/2472011464 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23640bf250 con 0x7f23640bd090 2021-01-27T09:44:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.777+0000 7f234bfff700 1 -- 172.21.15.146:0/2472011464 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f2358014460 con 0x7f23640bd090 2021-01-27T09:44:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.777+0000 7f234bfff700 1 --2- 172.21.15.146:0/2472011464 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f23440561b0 0x7f2344058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:49.784 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.777+0000 7f234bfff700 1 -- 172.21.15.146:0/2472011464 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f235806fa50 con 0x7f23640bd090 2021-01-27T09:44:49.785 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.777+0000 7f2363fff700 1 --2- 172.21.15.146:0/2472011464 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f23440561b0 0x7f2344058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:49.785 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.777+0000 7f2363fff700 1 --2- 172.21.15.146:0/2472011464 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f23440561b0 0x7f2344058670 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f2354005610 tx=0x7f2354007120).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:49.785 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.781+0000 7f234bfff700 1 -- 172.21.15.146:0/2472011464 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f23580450a0 con 0x7f23640bd090 2021-01-27T09:44:49.956 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:49.953+0000 7f236954d700 1 -- 172.21.15.146:0/2472011464 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f2364044680 con 0x7f23640bd090 2021-01-27T09:44:50.580 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.577+0000 7f234bfff700 1 -- 172.21.15.146:0/2472011464 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v9) v1 ==== 105+0+0 (secure 0 0 0) 0x7f23580180b0 con 0x7f23640bd090 2021-01-27T09:44:50.583 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.581+0000 7f236954d700 1 -- 172.21.15.146:0/2472011464 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f23440561b0 msgr2=0x7f2344058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:50.584 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.581+0000 7f236954d700 1 --2- 172.21.15.146:0/2472011464 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f23440561b0 0x7f2344058670 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f2354005610 tx=0x7f2354007120).stop 2021-01-27T09:44:50.584 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.581+0000 7f236954d700 1 -- 172.21.15.146:0/2472011464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23640bd090 msgr2=0x7f236415d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:50.585 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.581+0000 7f236954d700 1 --2- 172.21.15.146:0/2472011464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23640bd090 0x7f236415d0f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f235800f9b0 tx=0x7f2358008040).stop 2021-01-27T09:44:50.585 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.581+0000 7f236954d700 1 -- 172.21.15.146:0/2472011464 shutdown_connections 2021-01-27T09:44:50.585 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.581+0000 7f236954d700 1 --2- 172.21.15.146:0/2472011464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f23640bd710 0x7f23640bb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:50.585 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.581+0000 7f236954d700 1 --2- 172.21.15.146:0/2472011464 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f23440561b0 0x7f2344058670 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:50.586 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.581+0000 7f236954d700 1 --2- 172.21.15.146:0/2472011464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23640bd090 0x7f236415d0f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:50.586 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.581+0000 7f236954d700 1 --2- 172.21.15.146:0/2472011464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23640bccb0 0x7f2364160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:50.586 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.581+0000 7f236954d700 1 -- 172.21.15.146:0/2472011464 >> 172.21.15.146:0/2472011464 conn(0x7f2364069ba0 msgr2=0x7f236414a040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:50.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.581+0000 7f236954d700 1 -- 172.21.15.146:0/2472011464 shutdown_connections 2021-01-27T09:44:50.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.581+0000 7f236954d700 1 -- 172.21.15.146:0/2472011464 wait complete. 2021-01-27T09:44:50.616 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2021-01-27T09:44:50.790 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.789+0000 7f8512c37700 1 Processor -- start 2021-01-27T09:44:50.791 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.789+0000 7f8512c37700 1 -- start start 2021-01-27T09:44:50.794 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.789+0000 7f8512c37700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f850c0c1ad0 0x7f850c14ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:50.794 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.789+0000 7f8512c37700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850c14e2b0 con 0x7f850c0c4600 2021-01-27T09:44:50.794 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.789+0000 7f8512c37700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850c14e550 con 0x7f850c0c49e0 2021-01-27T09:44:50.795 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.789+0000 7f8512c37700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f850c060b70 con 0x7f850c0c1ad0 2021-01-27T09:44:50.795 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.789+0000 7f8512436700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f850c0c1ad0 0x7f850c14ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:50.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.789+0000 7f8511434700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f850c0c49e0 0x7f850c0c13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46072/0 (socket says 172.21.15.146:46072) 2021-01-27T09:44:50.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.789+0000 7f8511434700 1 -- 172.21.15.146:0/3521238221 learned_addr learned my addr 172.21.15.146:0/3521238221 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:50.800 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.793+0000 7f8510c33700 1 -- 172.21.15.146:0/3521238221 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663194754 0 0) 0x7f850c14e2b0 con 0x7f850c0c4600 2021-01-27T09:44:50.800 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.793+0000 7f8510c33700 1 -- 172.21.15.146:0/3521238221 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84f4003270 con 0x7f850c0c4600 2021-01-27T09:44:50.800 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.793+0000 7f8510c33700 1 -- 172.21.15.146:0/3521238221 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251220070 0 0) 0x7f850c14e550 con 0x7f850c0c49e0 2021-01-27T09:44:50.800 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.793+0000 7f8512436700 1 -- 172.21.15.146:0/3521238221 >> v1:172.21.15.146:6789/0 conn(0x7f850c0c49e0 legacy=0x7f850c0c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:50.801 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.793+0000 7f8512436700 1 -- 172.21.15.146:0/3521238221 >> v1:172.21.15.78:6789/0 conn(0x7f850c0c4600 legacy=0x7f850c060450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:50.801 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.793+0000 7f8512436700 1 -- 172.21.15.146:0/3521238221 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c14e7f0 con 0x7f850c0c1ad0 2021-01-27T09:44:50.801 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.793+0000 7f8512436700 1 --2- 172.21.15.146:0/3521238221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f850c0c1ad0 0x7f850c14ad70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f8504009cc0 tx=0x7f8504009220).ready entity=mon.1 client_cookie=8dc8d46a40c2019e server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:50.801 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.793+0000 7f8510c33700 1 -- 172.21.15.146:0/3521238221 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850400baa0 con 0x7f850c0c1ad0 2021-01-27T09:44:50.801 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.793+0000 7f8510c33700 1 -- 172.21.15.146:0/3521238221 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850400bc00 con 0x7f850c0c1ad0 2021-01-27T09:44:50.802 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.793+0000 7f8510c33700 1 -- 172.21.15.146:0/3521238221 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8504011400 con 0x7f850c0c1ad0 2021-01-27T09:44:50.802 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.793+0000 7f8512c37700 1 -- 172.21.15.146:0/3521238221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f850c0c1ad0 msgr2=0x7f850c14ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:50.802 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.793+0000 7f8512c37700 1 --2- 172.21.15.146:0/3521238221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f850c0c1ad0 0x7f850c14ad70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f8504009cc0 tx=0x7f8504009220).stop 2021-01-27T09:44:50.802 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.793+0000 7f8512c37700 1 -- 172.21.15.146:0/3521238221 shutdown_connections 2021-01-27T09:44:50.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.793+0000 7f8512c37700 1 --2- 172.21.15.146:0/3521238221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f850c0c1ad0 0x7f850c14ad70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:50.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.793+0000 7f8512c37700 1 -- 172.21.15.146:0/3521238221 >> 172.21.15.146:0/3521238221 conn(0x7f850c064f90 msgr2=0x7f850c0653a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:50.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.793+0000 7f8512c37700 1 -- 172.21.15.146:0/3521238221 shutdown_connections 2021-01-27T09:44:50.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.797+0000 7f8512c37700 1 -- 172.21.15.146:0/3521238221 wait complete. 2021-01-27T09:44:50.805 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.797+0000 7f8512c37700 1 Processor -- start 2021-01-27T09:44:50.805 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.797+0000 7f8512c37700 1 -- start start 2021-01-27T09:44:50.805 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.797+0000 7f8512c37700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f850c0c1ad0 0x7f850c152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:50.806 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.797+0000 7f8512c37700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f850c0c4600 0x7f850c143150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:50.806 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.797+0000 7f8512c37700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f850c0c49e0 0x7f850c0bebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:50.807 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.797+0000 7f8512c37700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850c0bf7b0 con 0x7f850c0c1ad0 2021-01-27T09:44:50.807 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.797+0000 7f8512c37700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850c15d2d0 con 0x7f850c0c49e0 2021-01-27T09:44:50.808 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.797+0000 7f8512c37700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850c146970 con 0x7f850c0c4600 2021-01-27T09:44:50.808 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.801+0000 7f8511c35700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f850c0c1ad0 0x7f850c152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:50.808 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.801+0000 7f8511c35700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f850c0c1ad0 0x7f850c152400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:49376/0 (socket says 172.21.15.146:49376) 2021-01-27T09:44:50.808 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.801+0000 7f8511c35700 1 -- 172.21.15.146:0/1447424768 learned_addr learned my addr 172.21.15.146:0/1447424768 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:50.808 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.801+0000 7f8512436700 1 --2- 172.21.15.146:0/1447424768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f850c0c49e0 0x7f850c0bebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:50.809 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.801+0000 7f8511434700 1 --2- 172.21.15.146:0/1447424768 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f850c0c4600 0x7f850c143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:50.809 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.801+0000 7f8511c35700 1 -- 172.21.15.146:0/1447424768 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f850c0c4600 msgr2=0x7f850c143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:50.809 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.801+0000 7f8511c35700 1 --2- 172.21.15.146:0/1447424768 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f850c0c4600 0x7f850c143150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:50.809 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.801+0000 7f8511c35700 1 -- 172.21.15.146:0/1447424768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f850c0c49e0 msgr2=0x7f850c0bebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:50.809 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.801+0000 7f8511c35700 1 --2- 172.21.15.146:0/1447424768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f850c0c49e0 0x7f850c0bebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:50.810 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.801+0000 7f8511c35700 1 -- 172.21.15.146:0/1447424768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c1466d0 con 0x7f850c0c1ad0 2021-01-27T09:44:50.810 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.801+0000 7f8511c35700 1 --2- 172.21.15.146:0/1447424768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f850c0c1ad0 0x7f850c152400 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f850800c710 tx=0x7f8508007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:50.810 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.801+0000 7f84f9ffb700 1 -- 172.21.15.146:0/1447424768 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850800e4a0 con 0x7f850c0c1ad0 2021-01-27T09:44:50.810 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.801+0000 7f84f9ffb700 1 -- 172.21.15.146:0/1447424768 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850800e600 con 0x7f850c0c1ad0 2021-01-27T09:44:50.811 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.801+0000 7f84f9ffb700 1 -- 172.21.15.146:0/1447424768 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850800e980 con 0x7f850c0c1ad0 2021-01-27T09:44:50.811 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.801+0000 7f8512c37700 1 -- 172.21.15.146:0/1447424768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f850c15d530 con 0x7f850c0c1ad0 2021-01-27T09:44:50.811 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.801+0000 7f8512c37700 1 -- 172.21.15.146:0/1447424768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f850c15da70 con 0x7f850c0c1ad0 2021-01-27T09:44:50.812 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.805+0000 7f8512c37700 1 -- 172.21.15.146:0/1447424768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850c146190 con 0x7f850c0c1ad0 2021-01-27T09:44:50.812 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.805+0000 7f84f9ffb700 1 -- 172.21.15.146:0/1447424768 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f8508019030 con 0x7f850c0c1ad0 2021-01-27T09:44:50.812 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.805+0000 7f84f9ffb700 1 --2- 172.21.15.146:0/1447424768 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f84ec0561e0 0x7f84ec0586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:50.813 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.805+0000 7f84f9ffb700 1 -- 172.21.15.146:0/1447424768 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f850806ea70 con 0x7f850c0c1ad0 2021-01-27T09:44:50.813 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.805+0000 7f8511434700 1 --2- 172.21.15.146:0/1447424768 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f84ec0561e0 0x7f84ec0586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:50.813 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.809+0000 7f8511434700 1 --2- 172.21.15.146:0/1447424768 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f84ec0561e0 0x7f84ec0586a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f84fc007fd0 tx=0x7f84fc007c50).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:50.817 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.813+0000 7f84f9ffb700 1 -- 172.21.15.146:0/1447424768 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f85080440c0 con 0x7f850c0c1ad0 2021-01-27T09:44:50.990 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:50.989+0000 7f8512c37700 1 -- 172.21.15.146:0/1447424768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f850c067a10 con 0x7f850c0c1ad0 2021-01-27T09:44:51.590 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.589+0000 7f84f9ffb700 1 -- 172.21.15.146:0/1447424768 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v11) v1 ==== 115+0+0 (secure 0 0 0) 0x7f85080476e0 con 0x7f850c0c1ad0 2021-01-27T09:44:51.594 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.593+0000 7f8512c37700 1 -- 172.21.15.146:0/1447424768 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f84ec0561e0 msgr2=0x7f84ec0586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:51.595 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.593+0000 7f8512c37700 1 --2- 172.21.15.146:0/1447424768 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f84ec0561e0 0x7f84ec0586a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f84fc007fd0 tx=0x7f84fc007c50).stop 2021-01-27T09:44:51.595 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.593+0000 7f8512c37700 1 -- 172.21.15.146:0/1447424768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f850c0c1ad0 msgr2=0x7f850c152400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:51.595 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.593+0000 7f8512c37700 1 --2- 172.21.15.146:0/1447424768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f850c0c1ad0 0x7f850c152400 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f850800c710 tx=0x7f8508007ac0).stop 2021-01-27T09:44:51.596 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.593+0000 7f8512c37700 1 -- 172.21.15.146:0/1447424768 shutdown_connections 2021-01-27T09:44:51.596 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.593+0000 7f8512c37700 1 --2- 172.21.15.146:0/1447424768 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f84ec0561e0 0x7f84ec0586a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:51.596 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.593+0000 7f8512c37700 1 --2- 172.21.15.146:0/1447424768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f850c0c49e0 0x7f850c0bebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:51.597 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.593+0000 7f8512c37700 1 --2- 172.21.15.146:0/1447424768 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f850c0c4600 0x7f850c143150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:51.597 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.593+0000 7f8512c37700 1 --2- 172.21.15.146:0/1447424768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f850c0c1ad0 0x7f850c152400 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:51.597 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.593+0000 7f8512c37700 1 -- 172.21.15.146:0/1447424768 >> 172.21.15.146:0/1447424768 conn(0x7f850c064f90 msgr2=0x7f850c14b210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:51.597 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.593+0000 7f8512c37700 1 -- 172.21.15.146:0/1447424768 shutdown_connections 2021-01-27T09:44:51.598 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.593+0000 7f8512c37700 1 -- 172.21.15.146:0/1447424768 wait complete. 2021-01-27T09:44:51.625 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:44:51.788 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.785+0000 7f1aa4546700 1 Processor -- start 2021-01-27T09:44:51.788 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.785+0000 7f1aa4546700 1 -- start start 2021-01-27T09:44:51.791 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.789+0000 7f1aa4546700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1a9c0b7880 0x7f1a9c14a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:51.791 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.789+0000 7f1aa4546700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1a9c0b8150 0x7f1a9c14ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:51.791 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.789+0000 7f1aa4546700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a9c0bea30 0x7f1a9c1474a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:51.791 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.789+0000 7f1aa4546700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a9c0b97b0 con 0x7f1a9c0b7880 2021-01-27T09:44:51.792 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.789+0000 7f1aa4546700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a9c0b9f20 con 0x7f1a9c0b8150 2021-01-27T09:44:51.792 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.789+0000 7f1aa4546700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c0b99e0 con 0x7f1a9c0bea30 2021-01-27T09:44:51.793 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.789+0000 7f1aa1ae1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1a9c0b8150 0x7f1a9c14ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:51.794 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.789+0000 7f1aa2ae3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a9c0bea30 0x7f1a9c1474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:51.794 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.789+0000 7f1aa1ae1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1a9c0b8150 0x7f1a9c14ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46522/0 (socket says 172.21.15.146:46522) 2021-01-27T09:44:51.794 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.789+0000 7f1aa1ae1700 1 -- 172.21.15.146:0/412999965 learned_addr learned my addr 172.21.15.146:0/412999965 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:51.794 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.789+0000 7f1aa22e2700 1 --2- 172.21.15.146:0/412999965 >> v2:172.21.15.78:3300/0 conn(0x7f1a9c0b7880 0x7f1a9c14a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:51.795 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.789+0000 7f1aa1ae1700 1 -- 172.21.15.146:0/412999965 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a9c0bea30 msgr2=0x7f1a9c1474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:51.795 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.789+0000 7f1aa1ae1700 1 --2- 172.21.15.146:0/412999965 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a9c0bea30 0x7f1a9c1474a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:51.795 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.789+0000 7f1aa1ae1700 1 -- 172.21.15.146:0/412999965 >> v2:172.21.15.78:3300/0 conn(0x7f1a9c0b7880 msgr2=0x7f1a9c14a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:51.795 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.789+0000 7f1aa1ae1700 1 --2- 172.21.15.146:0/412999965 >> v2:172.21.15.78:3300/0 conn(0x7f1a9c0b7880 0x7f1a9c14a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:51.795 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.789+0000 7f1aa1ae1700 1 -- 172.21.15.146:0/412999965 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9c0b9c80 con 0x7f1a9c0b8150 2021-01-27T09:44:51.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.789+0000 7f1aa2ae3700 1 --2- 172.21.15.146:0/412999965 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a9c0bea30 0x7f1a9c1474a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:51.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.789+0000 7f1aa1ae1700 1 --2- 172.21.15.146:0/412999965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a9c0b8150 0x7f1a9c14ae80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f1a9c065690 tx=0x7f1a8c006ee0).ready entity=mon.1 client_cookie=2c443b85b62f35cb server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:51.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.789+0000 7f1aa12e0700 1 -- 172.21.15.146:0/412999965 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c009720 con 0x7f1a9c0b8150 2021-01-27T09:44:51.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.789+0000 7f1aa12e0700 1 -- 172.21.15.146:0/412999965 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8c009880 con 0x7f1a9c0b8150 2021-01-27T09:44:51.797 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.789+0000 7f1aa12e0700 1 -- 172.21.15.146:0/412999965 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c009c00 con 0x7f1a9c0b8150 2021-01-27T09:44:51.799 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.793+0000 7f1aa4546700 1 -- 172.21.15.146:0/412999965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a9c0b8150 msgr2=0x7f1a9c14ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:51.799 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.793+0000 7f1aa4546700 1 --2- 172.21.15.146:0/412999965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a9c0b8150 0x7f1a9c14ae80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f1a9c065690 tx=0x7f1a8c006ee0).stop 2021-01-27T09:44:51.800 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.793+0000 7f1aa4546700 1 -- 172.21.15.146:0/412999965 shutdown_connections 2021-01-27T09:44:51.800 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.793+0000 7f1aa4546700 1 --2- 172.21.15.146:0/412999965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a9c0b8150 0x7f1a9c14ae80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:51.800 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.793+0000 7f1aa4546700 1 --2- 172.21.15.146:0/412999965 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a9c0bea30 0x7f1a9c1474a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:51.800 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.793+0000 7f1aa4546700 1 --2- 172.21.15.146:0/412999965 >> v2:172.21.15.78:3300/0 conn(0x7f1a9c0b7880 0x7f1a9c14a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:51.801 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.793+0000 7f1aa4546700 1 -- 172.21.15.146:0/412999965 >> 172.21.15.146:0/412999965 conn(0x7f1a9c069110 msgr2=0x7f1a9c067e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:51.801 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.793+0000 7f1aa4546700 1 -- 172.21.15.146:0/412999965 shutdown_connections 2021-01-27T09:44:51.801 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.793+0000 7f1aa4546700 1 -- 172.21.15.146:0/412999965 wait complete. 2021-01-27T09:44:51.802 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.793+0000 7f1aa4546700 1 Processor -- start 2021-01-27T09:44:51.802 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.793+0000 7f1aa4546700 1 -- start start 2021-01-27T09:44:51.802 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.797+0000 7f1aa4546700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a9c0b7880 0x7f1a9c1552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:51.802 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.797+0000 7f1aa4546700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a9c0b8150 0x7f1a9c14cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:51.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.797+0000 7f1aa4546700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a9c0bea30 0x7f1a9c14d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:51.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.797+0000 7f1aa4546700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c068590 con 0x7f1a9c0b7880 2021-01-27T09:44:51.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.797+0000 7f1aa4546700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c146340 con 0x7f1a9c0b8150 2021-01-27T09:44:51.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.797+0000 7f1aa4546700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c1465e0 con 0x7f1a9c0bea30 2021-01-27T09:44:51.804 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.797+0000 7f1aa1ae1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a9c0b8150 0x7f1a9c14cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:51.804 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.797+0000 7f1aa2ae3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a9c0bea30 0x7f1a9c14d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:51.804 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.797+0000 7f1aa22e2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a9c0b7880 0x7f1a9c1552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:51.804 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.797+0000 7f1aa1ae1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a9c0b8150 0x7f1a9c14cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46530/0 (socket says 172.21.15.146:46530) 2021-01-27T09:44:51.805 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.797+0000 7f1aa1ae1700 1 -- 172.21.15.146:0/2333736020 learned_addr learned my addr 172.21.15.146:0/2333736020 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:51.805 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.797+0000 7f1aa2ae3700 1 --2- 172.21.15.146:0/2333736020 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a9c0bea30 0x7f1a9c14d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36018/0 (socket says 172.21.15.146:36018) 2021-01-27T09:44:51.805 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.797+0000 7f1aa1ae1700 1 -- 172.21.15.146:0/2333736020 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a9c0bea30 msgr2=0x7f1a9c14d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:51.805 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.797+0000 7f1aa1ae1700 1 --2- 172.21.15.146:0/2333736020 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a9c0bea30 0x7f1a9c14d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:51.806 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.797+0000 7f1aa1ae1700 1 -- 172.21.15.146:0/2333736020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a9c0b7880 msgr2=0x7f1a9c1552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:51.806 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.797+0000 7f1aa1ae1700 1 --2- 172.21.15.146:0/2333736020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a9c0b7880 0x7f1a9c1552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:51.806 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.797+0000 7f1aa1ae1700 1 -- 172.21.15.146:0/2333736020 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9c146880 con 0x7f1a9c0b8150 2021-01-27T09:44:51.807 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.797+0000 7f1aa1ae1700 1 --2- 172.21.15.146:0/2333736020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a9c0b8150 0x7f1a9c14cc60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f1a8c010000 tx=0x7f1a8c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:51.808 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.797+0000 7f1a8a7fc700 1 -- 172.21.15.146:0/2333736020 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c012c50 con 0x7f1a9c0b8150 2021-01-27T09:44:51.808 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.797+0000 7f1a8a7fc700 1 -- 172.21.15.146:0/2333736020 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8c012db0 con 0x7f1a9c0b8150 2021-01-27T09:44:51.808 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.797+0000 7f1a8a7fc700 1 -- 172.21.15.146:0/2333736020 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c01c650 con 0x7f1a9c0b8150 2021-01-27T09:44:51.808 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.797+0000 7f1aa4546700 1 -- 172.21.15.146:0/2333736020 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9c14c520 con 0x7f1a9c0b8150 2021-01-27T09:44:51.809 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.797+0000 7f1aa4546700 1 -- 172.21.15.146:0/2333736020 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a9c146b20 con 0x7f1a9c0b8150 2021-01-27T09:44:51.809 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.801+0000 7f1a8a7fc700 1 -- 172.21.15.146:0/2333736020 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f1a8c00f070 con 0x7f1a9c0b8150 2021-01-27T09:44:51.809 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.801+0000 7f1aa4546700 1 -- 172.21.15.146:0/2333736020 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a9c14a1d0 con 0x7f1a9c0b8150 2021-01-27T09:44:51.809 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.801+0000 7f1a8a7fc700 1 --2- 172.21.15.146:0/2333736020 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f1a7c0561e0 0x7f1a7c0586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:51.810 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.801+0000 7f1a8a7fc700 1 -- 172.21.15.146:0/2333736020 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f1a8c0707e0 con 0x7f1a9c0b8150 2021-01-27T09:44:51.810 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.801+0000 7f1aa22e2700 1 --2- 172.21.15.146:0/2333736020 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f1a7c0561e0 0x7f1a7c0586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:51.810 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.801+0000 7f1aa22e2700 1 --2- 172.21.15.146:0/2333736020 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f1a7c0561e0 0x7f1a7c0586a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f1a9800bb90 tx=0x7f1a98006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:51.811 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.805+0000 7f1a8a7fc700 1 -- 172.21.15.146:0/2333736020 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f1a9c14a1d0 con 0x7f1a9c0b8150 2021-01-27T09:44:51.888 INFO:tasks.ceph.mds.b.smithi078.stderr:2021-01-27T09:44:51.887+0000 7f4c50272700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2021-01-27T09:44:51.980 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.977+0000 7f1aa4546700 1 -- 172.21.15.146:0/2333736020 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a9c0bd690 con 0x7f1a9c0b8150 2021-01-27T09:44:51.982 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.977+0000 7f1a8a7fc700 1 -- 172.21.15.146:0/2333736020 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+3576 (secure 0 0 0) 0x7f1a9c0bd690 con 0x7f1a9c0b8150 2021-01-27T09:44:51.982 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:44:51.983 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:44:51.591151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":2,"incarnation":12,"state":"up:creating","state_seq":1,"addr":"172.21.15.146:6837/745099427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":745099427},{"type":"v1","addr":"172.21.15.146:6837","nonce":745099427}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:44:51.984 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.981+0000 7f1aa4546700 1 -- 172.21.15.146:0/2333736020 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f1a7c0561e0 msgr2=0x7f1a7c0586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:51.985 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.981+0000 7f1aa4546700 1 --2- 172.21.15.146:0/2333736020 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f1a7c0561e0 0x7f1a7c0586a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f1a9800bb90 tx=0x7f1a98006e20).stop 2021-01-27T09:44:51.985 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.981+0000 7f1aa4546700 1 -- 172.21.15.146:0/2333736020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a9c0b8150 msgr2=0x7f1a9c14cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:51.985 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.981+0000 7f1aa4546700 1 --2- 172.21.15.146:0/2333736020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a9c0b8150 0x7f1a9c14cc60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f1a8c010000 tx=0x7f1a8c016000).stop 2021-01-27T09:44:51.986 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.981+0000 7f1aa4546700 1 -- 172.21.15.146:0/2333736020 shutdown_connections 2021-01-27T09:44:51.986 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.981+0000 7f1aa4546700 1 --2- 172.21.15.146:0/2333736020 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a9c0bea30 0x7f1a9c14d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:51.986 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.981+0000 7f1aa4546700 1 --2- 172.21.15.146:0/2333736020 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f1a7c0561e0 0x7f1a7c0586a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:51.986 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.981+0000 7f1aa4546700 1 --2- 172.21.15.146:0/2333736020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a9c0b8150 0x7f1a9c14cc60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.981+0000 7f1aa4546700 1 --2- 172.21.15.146:0/2333736020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a9c0b7880 0x7f1a9c1552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.981+0000 7f1aa4546700 1 -- 172.21.15.146:0/2333736020 >> 172.21.15.146:0/2333736020 conn(0x7f1a9c069110 msgr2=0x7f1a9c067e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.981+0000 7f1aa4546700 1 -- 172.21.15.146:0/2333736020 shutdown_connections 2021-01-27T09:44:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:51.981+0000 7f1aa4546700 1 -- 172.21.15.146:0/2333736020 wait complete. 2021-01-27T09:44:51.988 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 12 2021-01-27T09:44:52.011 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-01-27T09:44:52.164 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.161+0000 7fe607845700 1 Processor -- start 2021-01-27T09:44:52.165 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.161+0000 7fe607845700 1 -- start start 2021-01-27T09:44:52.167 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.165+0000 7fe607845700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe6000643e0 0x7fe6000b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:52.167 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.165+0000 7fe607845700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6000ade30 con 0x7fe6000647c0 2021-01-27T09:44:52.167 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.165+0000 7fe607845700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60014e1e0 con 0x7fe600147c80 2021-01-27T09:44:52.167 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.165+0000 7fe607845700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe60014e480 con 0x7fe6000643e0 2021-01-27T09:44:52.168 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.165+0000 7fe605de2700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe600147c80 0x7fe60014ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46112/0 (socket says 172.21.15.146:46112) 2021-01-27T09:44:52.168 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.165+0000 7fe605de2700 1 -- 172.21.15.146:0/3528148048 learned_addr learned my addr 172.21.15.146:0/3528148048 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:52.169 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.165+0000 7fe6055e1700 1 --2- 172.21.15.146:0/3528148048 >> v2:172.21.15.146:3300/0 conn(0x7fe6000643e0 0x7fe6000b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:52.169 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.165+0000 7fe5effff700 1 -- 172.21.15.146:0/3528148048 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65445994 0 0) 0x7fe60014e1e0 con 0x7fe600147c80 2021-01-27T09:44:52.169 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.165+0000 7fe5effff700 1 -- 172.21.15.146:0/3528148048 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5e8003270 con 0x7fe600147c80 2021-01-27T09:44:52.169 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.165+0000 7fe5effff700 1 -- 172.21.15.146:0/3528148048 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2915387632 0 0) 0x7fe6000ade30 con 0x7fe6000647c0 2021-01-27T09:44:52.171 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.165+0000 7fe5effff700 1 -- 172.21.15.146:0/3528148048 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe60014e1e0 con 0x7fe6000647c0 2021-01-27T09:44:52.171 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.165+0000 7fe6055e1700 1 -- 172.21.15.146:0/3528148048 >> v1:172.21.15.146:6789/0 conn(0x7fe600147c80 legacy=0x7fe60014ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:52.171 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.165+0000 7fe6055e1700 1 -- 172.21.15.146:0/3528148048 >> v1:172.21.15.78:6789/0 conn(0x7fe6000647c0 legacy=0x7fe6000ad650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:52.171 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.165+0000 7fe6055e1700 1 -- 172.21.15.146:0/3528148048 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60014e720 con 0x7fe6000643e0 2021-01-27T09:44:52.172 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.165+0000 7fe6055e1700 1 --2- 172.21.15.146:0/3528148048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6000643e0 0x7fe6000b87f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fe5fc00b9c0 tx=0x7fe5fc006e20).ready entity=mon.1 client_cookie=797138668a9885f1 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:52.172 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.165+0000 7fe5effff700 1 -- 172.21.15.146:0/3528148048 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc009600 con 0x7fe6000643e0 2021-01-27T09:44:52.172 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.165+0000 7fe5effff700 1 -- 172.21.15.146:0/3528148048 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5fc009760 con 0x7fe6000643e0 2021-01-27T09:44:52.172 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.165+0000 7fe5effff700 1 -- 172.21.15.146:0/3528148048 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc009ae0 con 0x7fe6000643e0 2021-01-27T09:44:52.172 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.169+0000 7fe607845700 1 -- 172.21.15.146:0/3528148048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6000643e0 msgr2=0x7fe6000b87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:52.173 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.169+0000 7fe607845700 1 --2- 172.21.15.146:0/3528148048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6000643e0 0x7fe6000b87f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fe5fc00b9c0 tx=0x7fe5fc006e20).stop 2021-01-27T09:44:52.173 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.169+0000 7fe607845700 1 -- 172.21.15.146:0/3528148048 shutdown_connections 2021-01-27T09:44:52.173 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.169+0000 7fe607845700 1 --2- 172.21.15.146:0/3528148048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6000643e0 0x7fe6000b87f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:52.173 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.169+0000 7fe607845700 1 -- 172.21.15.146:0/3528148048 >> 172.21.15.146:0/3528148048 conn(0x7fe6000bf6f0 msgr2=0x7fe600067230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:52.174 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.169+0000 7fe607845700 1 -- 172.21.15.146:0/3528148048 shutdown_connections 2021-01-27T09:44:52.174 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.169+0000 7fe607845700 1 -- 172.21.15.146:0/3528148048 wait complete. 2021-01-27T09:44:52.175 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.173+0000 7fe607845700 1 Processor -- start 2021-01-27T09:44:52.175 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.173+0000 7fe607845700 1 -- start start 2021-01-27T09:44:52.176 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.173+0000 7fe607845700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6000647c0 0x7fe60015e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:52.176 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.173+0000 7fe607845700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe600147c80 0x7fe6001458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:52.176 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.173+0000 7fe607845700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6000b87b0 0x7fe60013b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:52.177 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.173+0000 7fe607845700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60014b6b0 con 0x7fe600147c80 2021-01-27T09:44:52.177 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.173+0000 7fe607845700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60015eb40 con 0x7fe6000b87b0 2021-01-27T09:44:52.177 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.173+0000 7fe607845700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60014b410 con 0x7fe6000647c0 2021-01-27T09:44:52.178 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.173+0000 7fe605de2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6000b87b0 0x7fe60013b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:52.179 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.173+0000 7fe6055e1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6000647c0 0x7fe60015e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:52.179 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.173+0000 7fe605de2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6000b87b0 0x7fe60013b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46544/0 (socket says 172.21.15.146:46544) 2021-01-27T09:44:52.179 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.173+0000 7fe605de2700 1 -- 172.21.15.146:0/2730697915 learned_addr learned my addr 172.21.15.146:0/2730697915 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:52.179 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.173+0000 7fe604de0700 1 --2- 172.21.15.146:0/2730697915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe600147c80 0x7fe6001458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:52.180 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.173+0000 7fe605de2700 1 -- 172.21.15.146:0/2730697915 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6000647c0 msgr2=0x7fe60015e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:52.180 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.173+0000 7fe605de2700 1 --2- 172.21.15.146:0/2730697915 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6000647c0 0x7fe60015e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:52.180 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.173+0000 7fe605de2700 1 -- 172.21.15.146:0/2730697915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe600147c80 msgr2=0x7fe6001458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:52.180 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.173+0000 7fe605de2700 1 --2- 172.21.15.146:0/2730697915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe600147c80 0x7fe6001458d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:52.181 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.173+0000 7fe605de2700 1 -- 172.21.15.146:0/2730697915 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6000bdf30 con 0x7fe6000b87b0 2021-01-27T09:44:52.181 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.173+0000 7fe605de2700 1 --2- 172.21.15.146:0/2730697915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6000b87b0 0x7fe60013b590 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fe5f8001560 tx=0x7fe5f8007e50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:52.181 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.177+0000 7fe5ed7fa700 1 -- 172.21.15.146:0/2730697915 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800ce10 con 0x7fe6000b87b0 2021-01-27T09:44:52.181 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.177+0000 7fe5ed7fa700 1 -- 172.21.15.146:0/2730697915 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f8005bb0 con 0x7fe6000b87b0 2021-01-27T09:44:52.181 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.177+0000 7fe607845700 1 -- 172.21.15.146:0/2730697915 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6000be1d0 con 0x7fe6000b87b0 2021-01-27T09:44:52.182 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.177+0000 7fe5ed7fa700 1 -- 172.21.15.146:0/2730697915 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8007110 con 0x7fe6000b87b0 2021-01-27T09:44:52.182 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.177+0000 7fe607845700 1 -- 172.21.15.146:0/2730697915 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6000be470 con 0x7fe6000b87b0 2021-01-27T09:44:52.183 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.177+0000 7fe607845700 1 -- 172.21.15.146:0/2730697915 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6000b8c00 con 0x7fe6000b87b0 2021-01-27T09:44:52.183 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.177+0000 7fe5ed7fa700 1 -- 172.21.15.146:0/2730697915 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fe5f8010030 con 0x7fe6000b87b0 2021-01-27T09:44:52.183 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.181+0000 7fe5ed7fa700 1 --2- 172.21.15.146:0/2730697915 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe5e00561e0 0x7fe5e00586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:52.183 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.181+0000 7fe5ed7fa700 1 -- 172.21.15.146:0/2730697915 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fe5f806f4e0 con 0x7fe6000b87b0 2021-01-27T09:44:52.184 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.181+0000 7fe6055e1700 1 --2- 172.21.15.146:0/2730697915 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe5e00561e0 0x7fe5e00586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:52.184 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.181+0000 7fe6055e1700 1 --2- 172.21.15.146:0/2730697915 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe5e00561e0 0x7fe5e00586a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fe6000beeb0 tx=0x7fe5fc016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:52.188 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.185+0000 7fe5ed7fa700 1 -- 172.21.15.146:0/2730697915 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fe5f8044a80 con 0x7fe6000b87b0 2021-01-27T09:44:52.330 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.329+0000 7fe607845700 1 -- 172.21.15.146:0/2730697915 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe600044ee0 con 0x7fe6000b87b0 2021-01-27T09:44:52.333 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.329+0000 7fe5ed7fa700 1 -- 172.21.15.146:0/2730697915 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18638 (secure 0 0 0) 0x7fe5f80480a0 con 0x7fe6000b87b0 2021-01-27T09:44:52.334 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:44:52.334 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":26,"fsid":"968a1bec-aac5-444e-b70f-7770587be945","created":"2021-01-27T09:44:13.797940+0000","modified":"2021-01-27T09:44:33.763400+0000","last_up_change":"2021-01-27T09:44:23.479967+0000","last_in_change":"2021-01-27T09:44:23.479967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T09:44:18.497521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-27T09:44:24.550303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-27T09:44:27.607542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-27T09:44:28.331389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-01-27T09:44:31.378452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25441909-a40b-4d82-828d-326685513ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":14470},{"type":"v1","addr":"172.21.15.146:6801","nonce":14470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":14470},{"type":"v1","addr":"172.21.15.146:6803","nonce":14470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":14470},{"type":"v1","addr":"172.21.15.146:6810","nonce":14470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":14470},{"type":"v1","addr":"172.21.15.146:6807","nonce":14470}]},"public_addr":"172.21.15.146:6801/14470","cluster_addr":"172.21.15.146:6803/14470","heartbeat_back_addr":"172.21.15.146:6810/14470","heartbeat_front_addr":"172.21.15.146:6807/14470","state":["exists","up"]},{"osd":1,"uuid":"825bbc51-2ffe-4612-a300-00960e48be02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":14472},{"type":"v1","addr":"172.21.15.146:6817","nonce":14472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":14472},{"type":"v1","addr":"172.21.15.146:6819","nonce":14472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":14472},{"type":"v1","addr":"172.21.15.146:6827","nonce":14472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":14472},{"type":"v1","addr":"172.21.15.146:6823","nonce":14472}]},"public_addr":"172.21.15.146:6817/14472","cluster_addr":"172.21.15.146:6819/14472","heartbeat_back_addr":"172.21.15.146:6827/14472","heartbeat_front_addr":"172.21.15.146:6823/14472","state":["exists","up"]},{"osd":2,"uuid":"e568b97a-8e71-4ab9-bd64-056892110b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":14474},{"type":"v1","addr":"172.21.15.146:6822","nonce":14474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":14474},{"type":"v1","addr":"172.21.15.146:6826","nonce":14474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":14474},{"type":"v1","addr":"172.21.15.146:6831","nonce":14474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":14474},{"type":"v1","addr":"172.21.15.146:6829","nonce":14474}]},"public_addr":"172.21.15.146:6822/14474","cluster_addr":"172.21.15.146:6826/14474","heartbeat_back_addr":"172.21.15.146:6831/14474","heartbeat_front_addr":"172.21.15.146:6829/14474","state":["exists","up"]},{"osd":3,"uuid":"f5d50f63-f74a-4aea-a62d-51c38db4d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":14471},{"type":"v1","addr":"172.21.15.146:6806","nonce":14471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":14471},{"type":"v1","addr":"172.21.15.146:6811","nonce":14471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":14471},{"type":"v1","addr":"172.21.15.146:6815","nonce":14471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":14471},{"type":"v1","addr":"172.21.15.146:6813","nonce":14471}]},"public_addr":"172.21.15.146:6806/14471","cluster_addr":"172.21.15.146:6811/14471","heartbeat_back_addr":"172.21.15.146:6815/14471","heartbeat_front_addr":"172.21.15.146:6813/14471","state":["exists","up"]},{"osd":4,"uuid":"782458d7-6f52-48f4-9466-67b61ef27016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":15826},{"type":"v1","addr":"172.21.15.78:6817","nonce":15826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":15826},{"type":"v1","addr":"172.21.15.78:6819","nonce":15826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":15826},{"type":"v1","addr":"172.21.15.78:6823","nonce":15826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":15826},{"type":"v1","addr":"172.21.15.78:6821","nonce":15826}]},"public_addr":"172.21.15.78:6817/15826","cluster_addr":"172.21.15.78:6819/15826","heartbeat_back_addr":"172.21.15.78:6823/15826","heartbeat_front_addr":"172.21.15.78:6821/15826","state":["exists","up"]},{"osd":5,"uuid":"1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":15827},{"type":"v1","addr":"172.21.15.78:6801","nonce":15827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":15827},{"type":"v1","addr":"172.21.15.78:6803","nonce":15827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":15827},{"type":"v1","addr":"172.21.15.78:6807","nonce":15827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":15827},{"type":"v1","addr":"172.21.15.78:6805","nonce":15827}]},"public_addr":"172.21.15.78:6801/15827","cluster_addr":"172.21.15.78:6803/15827","heartbeat_back_addr":"172.21.15.78:6807/15827","heartbeat_front_addr":"172.21.15.78:6805/15827","state":["exists","up"]},{"osd":6,"uuid":"4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":15825},{"type":"v1","addr":"172.21.15.78:6809","nonce":15825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":15825},{"type":"v1","addr":"172.21.15.78:6811","nonce":15825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":15825},{"type":"v1","addr":"172.21.15.78:6815","nonce":15825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":15825},{"type":"v1","addr":"172.21.15.78:6813","nonce":15825}]},"public_addr":"172.21.15.78:6809/15825","cluster_addr":"172.21.15.78:6811/15825","heartbeat_back_addr":"172.21.15.78:6815/15825","heartbeat_front_addr":"172.21.15.78:6813/15825","state":["exists","up"]},{"osd":7,"uuid":"851aeaf3-bcdc-4ac6-b578-c42e1bf87c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":15828},{"type":"v1","addr":"172.21.15.78:6825","nonce":15828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":15828},{"type":"v1","addr":"172.21.15.78:6827","nonce":15828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":15828},{"type":"v1","addr":"172.21.15.78:6831","nonce":15828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":15828},{"type":"v1","addr":"172.21.15.78:6829","nonce":15828}]},"public_addr":"172.21.15.78:6825/15828","cluster_addr":"172.21.15.78:6827/15828","heartbeat_back_addr":"172.21.15.78:6831/15828","heartbeat_front_addr":"172.21.15.78:6829/15828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.573930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.718144+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.641838+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.551598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.374444+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.171108+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.360910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.356020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:44:52.336 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.333+0000 7fe607845700 1 -- 172.21.15.146:0/2730697915 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe5e00561e0 msgr2=0x7fe5e00586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:52.337 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.333+0000 7fe607845700 1 --2- 172.21.15.146:0/2730697915 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe5e00561e0 0x7fe5e00586a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fe6000beeb0 tx=0x7fe5fc016000).stop 2021-01-27T09:44:52.337 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.333+0000 7fe607845700 1 -- 172.21.15.146:0/2730697915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6000b87b0 msgr2=0x7fe60013b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:52.337 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.333+0000 7fe607845700 1 --2- 172.21.15.146:0/2730697915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6000b87b0 0x7fe60013b590 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fe5f8001560 tx=0x7fe5f8007e50).stop 2021-01-27T09:44:52.338 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.333+0000 7fe607845700 1 -- 172.21.15.146:0/2730697915 shutdown_connections 2021-01-27T09:44:52.338 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.333+0000 7fe607845700 1 --2- 172.21.15.146:0/2730697915 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe5e00561e0 0x7fe5e00586a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:52.339 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.333+0000 7fe607845700 1 --2- 172.21.15.146:0/2730697915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6000b87b0 0x7fe60013b590 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:52.339 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.333+0000 7fe607845700 1 --2- 172.21.15.146:0/2730697915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe600147c80 0x7fe6001458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:52.339 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.333+0000 7fe607845700 1 --2- 172.21.15.146:0/2730697915 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6000647c0 0x7fe60015e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:52.340 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.333+0000 7fe607845700 1 -- 172.21.15.146:0/2730697915 >> 172.21.15.146:0/2730697915 conn(0x7fe6000bf6f0 msgr2=0x7fe600142610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:52.340 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.333+0000 7fe607845700 1 -- 172.21.15.146:0/2730697915 shutdown_connections 2021-01-27T09:44:52.341 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.333+0000 7fe607845700 1 -- 172.21.15.146:0/2730697915 wait complete. 2021-01-27T09:44:52.361 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-01-27T09:44:52.362 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-01-27T09:44:52.523 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.521+0000 7f4222d75700 1 Processor -- start 2021-01-27T09:44:52.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.521+0000 7f4222d75700 1 -- start start 2021-01-27T09:44:52.525 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.521+0000 7f4222d75700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f421c0692b0 0x7f421c14c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:52.525 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.521+0000 7f4222d75700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421c0b08b0 0x7f421c0be110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:52.526 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.521+0000 7f4222d75700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f421c14b960 con 0x7f421c069690 2021-01-27T09:44:52.526 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.521+0000 7f4222d75700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f421c0be600 con 0x7f421c0692b0 2021-01-27T09:44:52.526 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.521+0000 7f4222d75700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421c067210 con 0x7f421c0b08b0 2021-01-27T09:44:52.528 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.521+0000 7f4222574700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421c0b08b0 0x7f421c0be110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:52.528 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.521+0000 7f4222574700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421c0b08b0 0x7f421c0be110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36036/0 (socket says 172.21.15.146:36036) 2021-01-27T09:44:52.528 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.521+0000 7f4222574700 1 -- 172.21.15.146:0/3054528756 learned_addr learned my addr 172.21.15.146:0/3054528756 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:52.528 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.521+0000 7f4221d73700 1 --2- 172.21.15.146:0/3054528756 >> v2:172.21.15.78:3300/0 conn(0x7f421c0692b0 0x7f421c14c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:52.528 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.525+0000 7f4222574700 1 -- 172.21.15.146:0/3054528756 >> v2:172.21.15.78:3300/0 conn(0x7f421c0692b0 msgr2=0x7f421c14c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:52.529 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.525+0000 7f4222574700 1 --2- 172.21.15.146:0/3054528756 >> v2:172.21.15.78:3300/0 conn(0x7f421c0692b0 0x7f421c14c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:52.529 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.525+0000 7f4222574700 1 -- 172.21.15.146:0/3054528756 >> v1:172.21.15.78:6789/0 conn(0x7f421c069690 legacy=0x7f421c066af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:52.529 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.525+0000 7f4222574700 1 -- 172.21.15.146:0/3054528756 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c0674a0 con 0x7f421c0b08b0 2021-01-27T09:44:52.529 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.525+0000 7f4222574700 1 --2- 172.21.15.146:0/3054528756 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421c0b08b0 0x7f421c0be110 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f4214009d90 tx=0x7f42140092d0).ready entity=mon.2 client_cookie=bd35d481bd50c2da server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:52.531 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.525+0000 7f4220d71700 1 -- 172.21.15.146:0/3054528756 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421400bbf0 con 0x7f421c0b08b0 2021-01-27T09:44:52.531 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.525+0000 7f4220d71700 1 -- 172.21.15.146:0/3054528756 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421400bd50 con 0x7f421c0b08b0 2021-01-27T09:44:52.531 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.525+0000 7f4220d71700 1 -- 172.21.15.146:0/3054528756 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4214011610 con 0x7f421c0b08b0 2021-01-27T09:44:52.531 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.525+0000 7f4222d75700 1 -- 172.21.15.146:0/3054528756 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421c0b08b0 msgr2=0x7f421c0be110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:52.531 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.525+0000 7f4222d75700 1 --2- 172.21.15.146:0/3054528756 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421c0b08b0 0x7f421c0be110 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f4214009d90 tx=0x7f42140092d0).stop 2021-01-27T09:44:52.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.525+0000 7f4222d75700 1 -- 172.21.15.146:0/3054528756 shutdown_connections 2021-01-27T09:44:52.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.525+0000 7f4222d75700 1 --2- 172.21.15.146:0/3054528756 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421c0b08b0 0x7f421c0be110 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:52.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.525+0000 7f4222d75700 1 --2- 172.21.15.146:0/3054528756 >> v2:172.21.15.78:3300/0 conn(0x7f421c0692b0 0x7f421c14c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:52.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.525+0000 7f4222d75700 1 -- 172.21.15.146:0/3054528756 >> 172.21.15.146:0/3054528756 conn(0x7f421c064240 msgr2=0x7f421c0601f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:52.533 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.529+0000 7f4222d75700 1 -- 172.21.15.146:0/3054528756 shutdown_connections 2021-01-27T09:44:52.533 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.529+0000 7f4222d75700 1 -- 172.21.15.146:0/3054528756 wait complete. 2021-01-27T09:44:52.533 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.529+0000 7f4222d75700 1 Processor -- start 2021-01-27T09:44:52.534 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.529+0000 7f4222d75700 1 -- start start 2021-01-27T09:44:52.535 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.533+0000 7f4222d75700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f421c0692b0 0x7f421c161050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:52.536 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.533+0000 7f4222d75700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f421c069690 0x7f421c144540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:52.536 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.533+0000 7f4222d75700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421c0b08b0 0x7f421c0bc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:52.536 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.533+0000 7f4222d75700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c161540 con 0x7f421c0692b0 2021-01-27T09:44:52.537 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.533+0000 7f4222d75700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c144d60 con 0x7f421c069690 2021-01-27T09:44:52.537 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.533+0000 7f4222d75700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421c145000 con 0x7f421c0b08b0 2021-01-27T09:44:52.537 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.533+0000 7f4221d73700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f421c0692b0 0x7f421c161050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:52.537 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.533+0000 7f4221d73700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f421c0692b0 0x7f421c161050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:49430/0 (socket says 172.21.15.146:49430) 2021-01-27T09:44:52.538 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.533+0000 7f4221d73700 1 -- 172.21.15.146:0/1212379229 learned_addr learned my addr 172.21.15.146:0/1212379229 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:52.538 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.533+0000 7f4221572700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f421c069690 0x7f421c144540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:52.538 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.533+0000 7f4222574700 1 --2- 172.21.15.146:0/1212379229 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421c0b08b0 0x7f421c0bc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:52.539 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.533+0000 7f4221d73700 1 -- 172.21.15.146:0/1212379229 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421c0b08b0 msgr2=0x7f421c0bc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:52.539 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.533+0000 7f4221d73700 1 --2- 172.21.15.146:0/1212379229 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421c0b08b0 0x7f421c0bc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:52.539 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.533+0000 7f4221d73700 1 -- 172.21.15.146:0/1212379229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f421c069690 msgr2=0x7f421c144540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:52.540 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.533+0000 7f4221d73700 1 --2- 172.21.15.146:0/1212379229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f421c069690 0x7f421c144540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:52.540 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.533+0000 7f4221d73700 1 -- 172.21.15.146:0/1212379229 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c15d1c0 con 0x7f421c0692b0 2021-01-27T09:44:52.540 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.533+0000 7f4221572700 1 --2- 172.21.15.146:0/1212379229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f421c069690 0x7f421c144540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:52.540 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.533+0000 7f4221d73700 1 --2- 172.21.15.146:0/1212379229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f421c0692b0 0x7f421c161050 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f421800db60 tx=0x7f4218008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:52.542 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.533+0000 7f4209ffb700 1 -- 172.21.15.146:0/1212379229 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421800be50 con 0x7f421c0692b0 2021-01-27T09:44:52.543 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.533+0000 7f4209ffb700 1 -- 172.21.15.146:0/1212379229 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42180097c0 con 0x7f421c0692b0 2021-01-27T09:44:52.543 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.533+0000 7f4222d75700 1 -- 172.21.15.146:0/1212379229 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f421c15d460 con 0x7f421c0692b0 2021-01-27T09:44:52.543 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.533+0000 7f4209ffb700 1 -- 172.21.15.146:0/1212379229 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218009b40 con 0x7f421c0692b0 2021-01-27T09:44:52.544 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.533+0000 7f4222d75700 1 -- 172.21.15.146:0/1212379229 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f421c15d9a0 con 0x7f421c0692b0 2021-01-27T09:44:52.544 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.537+0000 7f4222d75700 1 -- 172.21.15.146:0/1212379229 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f421c063d90 con 0x7f421c0692b0 2021-01-27T09:44:52.544 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.537+0000 7f4209ffb700 1 -- 172.21.15.146:0/1212379229 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f4218013480 con 0x7f421c0692b0 2021-01-27T09:44:52.544 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.537+0000 7f4209ffb700 1 --2- 172.21.15.146:0/1212379229 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f41fc056210 0x7f41fc0586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:52.545 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.537+0000 7f4209ffb700 1 -- 172.21.15.146:0/1212379229 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f421806f7c0 con 0x7f421c0692b0 2021-01-27T09:44:52.545 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.537+0000 7f4221572700 1 --2- 172.21.15.146:0/1212379229 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f41fc056210 0x7f41fc0586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:52.545 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.537+0000 7f4221572700 1 --2- 172.21.15.146:0/1212379229 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f41fc056210 0x7f41fc0586d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f421c069c90 tx=0x7f420c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:52.549 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.545+0000 7f4209ffb700 1 -- 172.21.15.146:0/1212379229 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f4218044d90 con 0x7f421c0692b0 2021-01-27T09:44:52.697 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.693+0000 7f4222d75700 1 -- 172.21.15.146:0/1212379229 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f421c044680 con 0x7f421c0692b0 2021-01-27T09:44:52.699 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.697+0000 7f4209ffb700 1 -- 172.21.15.146:0/1212379229 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18638 (secure 0 0 0) 0x7f42180483b0 con 0x7f421c0692b0 2021-01-27T09:44:52.700 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:44:52.700 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":26,"fsid":"968a1bec-aac5-444e-b70f-7770587be945","created":"2021-01-27T09:44:13.797940+0000","modified":"2021-01-27T09:44:33.763400+0000","last_up_change":"2021-01-27T09:44:23.479967+0000","last_in_change":"2021-01-27T09:44:23.479967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T09:44:18.497521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-27T09:44:24.550303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-27T09:44:27.607542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-27T09:44:28.331389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-01-27T09:44:31.378452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25441909-a40b-4d82-828d-326685513ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":14470},{"type":"v1","addr":"172.21.15.146:6801","nonce":14470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":14470},{"type":"v1","addr":"172.21.15.146:6803","nonce":14470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":14470},{"type":"v1","addr":"172.21.15.146:6810","nonce":14470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":14470},{"type":"v1","addr":"172.21.15.146:6807","nonce":14470}]},"public_addr":"172.21.15.146:6801/14470","cluster_addr":"172.21.15.146:6803/14470","heartbeat_back_addr":"172.21.15.146:6810/14470","heartbeat_front_addr":"172.21.15.146:6807/14470","state":["exists","up"]},{"osd":1,"uuid":"825bbc51-2ffe-4612-a300-00960e48be02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":14472},{"type":"v1","addr":"172.21.15.146:6817","nonce":14472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":14472},{"type":"v1","addr":"172.21.15.146:6819","nonce":14472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":14472},{"type":"v1","addr":"172.21.15.146:6827","nonce":14472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":14472},{"type":"v1","addr":"172.21.15.146:6823","nonce":14472}]},"public_addr":"172.21.15.146:6817/14472","cluster_addr":"172.21.15.146:6819/14472","heartbeat_back_addr":"172.21.15.146:6827/14472","heartbeat_front_addr":"172.21.15.146:6823/14472","state":["exists","up"]},{"osd":2,"uuid":"e568b97a-8e71-4ab9-bd64-056892110b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":14474},{"type":"v1","addr":"172.21.15.146:6822","nonce":14474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":14474},{"type":"v1","addr":"172.21.15.146:6826","nonce":14474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":14474},{"type":"v1","addr":"172.21.15.146:6831","nonce":14474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":14474},{"type":"v1","addr":"172.21.15.146:6829","nonce":14474}]},"public_addr":"172.21.15.146:6822/14474","cluster_addr":"172.21.15.146:6826/14474","heartbeat_back_addr":"172.21.15.146:6831/14474","heartbeat_front_addr":"172.21.15.146:6829/14474","state":["exists","up"]},{"osd":3,"uuid":"f5d50f63-f74a-4aea-a62d-51c38db4d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":14471},{"type":"v1","addr":"172.21.15.146:6806","nonce":14471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":14471},{"type":"v1","addr":"172.21.15.146:6811","nonce":14471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":14471},{"type":"v1","addr":"172.21.15.146:6815","nonce":14471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":14471},{"type":"v1","addr":"172.21.15.146:6813","nonce":14471}]},"public_addr":"172.21.15.146:6806/14471","cluster_addr":"172.21.15.146:6811/14471","heartbeat_back_addr":"172.21.15.146:6815/14471","heartbeat_front_addr":"172.21.15.146:6813/14471","state":["exists","up"]},{"osd":4,"uuid":"782458d7-6f52-48f4-9466-67b61ef27016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":15826},{"type":"v1","addr":"172.21.15.78:6817","nonce":15826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":15826},{"type":"v1","addr":"172.21.15.78:6819","nonce":15826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":15826},{"type":"v1","addr":"172.21.15.78:6823","nonce":15826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":15826},{"type":"v1","addr":"172.21.15.78:6821","nonce":15826}]},"public_addr":"172.21.15.78:6817/15826","cluster_addr":"172.21.15.78:6819/15826","heartbeat_back_addr":"172.21.15.78:6823/15826","heartbeat_front_addr":"172.21.15.78:6821/15826","state":["exists","up"]},{"osd":5,"uuid":"1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":15827},{"type":"v1","addr":"172.21.15.78:6801","nonce":15827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":15827},{"type":"v1","addr":"172.21.15.78:6803","nonce":15827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":15827},{"type":"v1","addr":"172.21.15.78:6807","nonce":15827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":15827},{"type":"v1","addr":"172.21.15.78:6805","nonce":15827}]},"public_addr":"172.21.15.78:6801/15827","cluster_addr":"172.21.15.78:6803/15827","heartbeat_back_addr":"172.21.15.78:6807/15827","heartbeat_front_addr":"172.21.15.78:6805/15827","state":["exists","up"]},{"osd":6,"uuid":"4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":15825},{"type":"v1","addr":"172.21.15.78:6809","nonce":15825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":15825},{"type":"v1","addr":"172.21.15.78:6811","nonce":15825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":15825},{"type":"v1","addr":"172.21.15.78:6815","nonce":15825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":15825},{"type":"v1","addr":"172.21.15.78:6813","nonce":15825}]},"public_addr":"172.21.15.78:6809/15825","cluster_addr":"172.21.15.78:6811/15825","heartbeat_back_addr":"172.21.15.78:6815/15825","heartbeat_front_addr":"172.21.15.78:6813/15825","state":["exists","up"]},{"osd":7,"uuid":"851aeaf3-bcdc-4ac6-b578-c42e1bf87c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":15828},{"type":"v1","addr":"172.21.15.78:6825","nonce":15828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":15828},{"type":"v1","addr":"172.21.15.78:6827","nonce":15828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":15828},{"type":"v1","addr":"172.21.15.78:6831","nonce":15828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":15828},{"type":"v1","addr":"172.21.15.78:6829","nonce":15828}]},"public_addr":"172.21.15.78:6825/15828","cluster_addr":"172.21.15.78:6827/15828","heartbeat_back_addr":"172.21.15.78:6831/15828","heartbeat_front_addr":"172.21.15.78:6829/15828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.573930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.718144+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.641838+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.551598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.374444+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.171108+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.360910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.356020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:44:52.703 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.701+0000 7f4222d75700 1 -- 172.21.15.146:0/1212379229 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f41fc056210 msgr2=0x7f41fc0586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:52.703 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.701+0000 7f4222d75700 1 --2- 172.21.15.146:0/1212379229 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f41fc056210 0x7f41fc0586d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f421c069c90 tx=0x7f420c009040).stop 2021-01-27T09:44:52.703 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.701+0000 7f4222d75700 1 -- 172.21.15.146:0/1212379229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f421c0692b0 msgr2=0x7f421c161050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:52.703 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.701+0000 7f4222d75700 1 --2- 172.21.15.146:0/1212379229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f421c0692b0 0x7f421c161050 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f421800db60 tx=0x7f4218008040).stop 2021-01-27T09:44:52.704 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.701+0000 7f4222d75700 1 -- 172.21.15.146:0/1212379229 shutdown_connections 2021-01-27T09:44:52.704 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.701+0000 7f4222d75700 1 --2- 172.21.15.146:0/1212379229 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421c0b08b0 0x7f421c0bc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:52.704 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.701+0000 7f4222d75700 1 --2- 172.21.15.146:0/1212379229 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f41fc056210 0x7f41fc0586d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:52.704 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.701+0000 7f4222d75700 1 --2- 172.21.15.146:0/1212379229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f421c069690 0x7f421c144540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:52.704 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.701+0000 7f4222d75700 1 --2- 172.21.15.146:0/1212379229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f421c0692b0 0x7f421c161050 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:52.705 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.701+0000 7f4222d75700 1 -- 172.21.15.146:0/1212379229 >> 172.21.15.146:0/1212379229 conn(0x7f421c064240 msgr2=0x7f421c14c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:52.705 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.701+0000 7f4222d75700 1 -- 172.21.15.146:0/1212379229 shutdown_connections 2021-01-27T09:44:52.705 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.701+0000 7f4222d75700 1 -- 172.21.15.146:0/1212379229 wait complete. 2021-01-27T09:44:52.729 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-27T09:44:18.497521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-27T09:44:24.550303+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-27T09:44:27.607542+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-01-27T09:44:28.331389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2021-01-27T09:44:31.378452+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-27T09:44:52.730 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-01-27T09:44:52.895 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.893+0000 7f9215889700 1 Processor -- start 2021-01-27T09:44:52.896 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.893+0000 7f9215889700 1 -- start start 2021-01-27T09:44:52.898 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.897+0000 7f9215889700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9210069830 0x7f92100bbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:52.898 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.897+0000 7f9215889700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f921014bd70 0x7f92100b9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:52.899 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.897+0000 7f9215889700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f921014c3d0 con 0x7f92100bb980 2021-01-27T09:44:52.899 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.897+0000 7f9215889700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f921014c1d0 con 0x7f921014bd70 2021-01-27T09:44:52.899 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.897+0000 7f9215889700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f921014c670 con 0x7f9210069830 2021-01-27T09:44:52.900 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.897+0000 7f920ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9210069830 0x7f92100bbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:52.901 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.897+0000 7f920ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9210069830 0x7f92100bbd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46566/0 (socket says 172.21.15.146:46566) 2021-01-27T09:44:52.901 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.897+0000 7f920ffff700 1 -- 172.21.15.146:0/3193861333 learned_addr learned my addr 172.21.15.146:0/3193861333 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:52.901 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.897+0000 7f9214887700 1 --1- 172.21.15.146:0/3193861333 >> v1:172.21.15.146:6789/0 conn(0x7f92100bb980 0x7f9210063660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46136/0 (socket says 172.21.15.146:46136) 2021-01-27T09:44:52.901 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.897+0000 7f9215088700 1 --2- 172.21.15.146:0/3193861333 >> v2:172.21.15.78:3300/0 conn(0x7f921014bd70 0x7f92100b9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:52.902 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.897+0000 7f920ffff700 1 -- 172.21.15.146:0/3193861333 >> v2:172.21.15.78:3300/0 conn(0x7f921014bd70 msgr2=0x7f92100b9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:52.902 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.897+0000 7f920ffff700 1 --2- 172.21.15.146:0/3193861333 >> v2:172.21.15.78:3300/0 conn(0x7f921014bd70 0x7f92100b9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:52.902 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.897+0000 7f920ffff700 1 -- 172.21.15.146:0/3193861333 >> v1:172.21.15.146:6789/0 conn(0x7f92100bb980 legacy=0x7f9210063660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:52.902 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.897+0000 7f920f7fe700 1 -- 172.21.15.146:0/3193861333 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002963248 0 0) 0x7f921014c3d0 con 0x7f92100bb980 2021-01-27T09:44:52.903 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.897+0000 7f920ffff700 1 -- 172.21.15.146:0/3193861333 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921014c910 con 0x7f9210069830 2021-01-27T09:44:52.903 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.897+0000 7f9215088700 1 --2- 172.21.15.146:0/3193861333 >> v2:172.21.15.78:3300/0 conn(0x7f921014bd70 0x7f92100b9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:44:52.903 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.897+0000 7f920ffff700 1 --2- 172.21.15.146:0/3193861333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9210069830 0x7f92100bbd60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f9210061610 tx=0x7f91fc006ee0).ready entity=mon.1 client_cookie=3e1b5527707a96ec server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:52.904 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.901+0000 7f920f7fe700 1 -- 172.21.15.146:0/3193861333 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc009840 con 0x7f9210069830 2021-01-27T09:44:52.905 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.901+0000 7f920f7fe700 1 -- 172.21.15.146:0/3193861333 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91fc0099a0 con 0x7f9210069830 2021-01-27T09:44:52.905 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.901+0000 7f920f7fe700 1 -- 172.21.15.146:0/3193861333 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc009d20 con 0x7f9210069830 2021-01-27T09:44:52.905 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.901+0000 7f9215889700 1 -- 172.21.15.146:0/3193861333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9210069830 msgr2=0x7f92100bbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:52.906 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.901+0000 7f9215889700 1 --2- 172.21.15.146:0/3193861333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9210069830 0x7f92100bbd60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f9210061610 tx=0x7f91fc006ee0).stop 2021-01-27T09:44:52.906 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.901+0000 7f9215889700 1 -- 172.21.15.146:0/3193861333 shutdown_connections 2021-01-27T09:44:52.906 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.901+0000 7f9215889700 1 --2- 172.21.15.146:0/3193861333 >> v2:172.21.15.78:3300/0 conn(0x7f921014bd70 0x7f92100b9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:52.906 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.901+0000 7f9215889700 1 --2- 172.21.15.146:0/3193861333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9210069830 0x7f92100bbd60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:52.906 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.901+0000 7f9215889700 1 -- 172.21.15.146:0/3193861333 >> 172.21.15.146:0/3193861333 conn(0x7f9210064240 msgr2=0x7f9210069110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:52.907 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.901+0000 7f9215889700 1 -- 172.21.15.146:0/3193861333 shutdown_connections 2021-01-27T09:44:52.907 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.901+0000 7f9215889700 1 -- 172.21.15.146:0/3193861333 wait complete. 2021-01-27T09:44:52.908 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.901+0000 7f9215889700 1 Processor -- start 2021-01-27T09:44:52.908 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.905+0000 7f9215889700 1 -- start start 2021-01-27T09:44:52.908 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.905+0000 7f9215889700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9210069830 0x7f921014df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:52.909 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.905+0000 7f9215889700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92100bb980 0x7f92100bcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:52.909 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.905+0000 7f9215889700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f921014bd70 0x7f921015bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:52.909 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.905+0000 7f9215889700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92100b6970 con 0x7f9210069830 2021-01-27T09:44:52.909 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.905+0000 7f9215889700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92100b6190 con 0x7f92100bb980 2021-01-27T09:44:52.910 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.905+0000 7f9215889700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92100b6430 con 0x7f921014bd70 2021-01-27T09:44:52.910 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.905+0000 7f920ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92100bb980 0x7f92100bcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:52.910 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.905+0000 7f9214887700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9210069830 0x7f921014df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:52.910 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.905+0000 7f9215088700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f921014bd70 0x7f921015bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:52.910 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.905+0000 7f920ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92100bb980 0x7f92100bcc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46572/0 (socket says 172.21.15.146:46572) 2021-01-27T09:44:52.911 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.905+0000 7f920ffff700 1 -- 172.21.15.146:0/2793677254 learned_addr learned my addr 172.21.15.146:0/2793677254 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:52.912 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.905+0000 7f920ffff700 1 -- 172.21.15.146:0/2793677254 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f921014bd70 msgr2=0x7f921015bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:52.912 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.905+0000 7f920ffff700 1 --2- 172.21.15.146:0/2793677254 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f921014bd70 0x7f921015bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:52.912 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.905+0000 7f920ffff700 1 -- 172.21.15.146:0/2793677254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9210069830 msgr2=0x7f921014df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:52.913 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.905+0000 7f920ffff700 1 --2- 172.21.15.146:0/2793677254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9210069830 0x7f921014df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:52.913 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.905+0000 7f920ffff700 1 -- 172.21.15.146:0/2793677254 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92100b66d0 con 0x7f92100bb980 2021-01-27T09:44:52.913 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.905+0000 7f9214887700 1 --2- 172.21.15.146:0/2793677254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9210069830 0x7f921014df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:52.913 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.905+0000 7f920ffff700 1 --2- 172.21.15.146:0/2793677254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92100bb980 0x7f92100bcc00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f91fc006f20 tx=0x7f91fc016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:52.914 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.905+0000 7f920cff9700 1 -- 172.21.15.146:0/2793677254 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc012d00 con 0x7f92100bb980 2021-01-27T09:44:52.914 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.905+0000 7f920cff9700 1 -- 172.21.15.146:0/2793677254 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91fc012e60 con 0x7f92100bb980 2021-01-27T09:44:52.914 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.905+0000 7f920cff9700 1 -- 172.21.15.146:0/2793677254 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc01b640 con 0x7f92100bb980 2021-01-27T09:44:52.914 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.905+0000 7f9215889700 1 -- 172.21.15.146:0/2793677254 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921015b600 con 0x7f92100bb980 2021-01-27T09:44:52.914 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.909+0000 7f9215889700 1 -- 172.21.15.146:0/2793677254 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921015bb40 con 0x7f92100bb980 2021-01-27T09:44:52.915 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.909+0000 7f9215889700 1 -- 172.21.15.146:0/2793677254 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921006a3d0 con 0x7f92100bb980 2021-01-27T09:44:52.915 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.909+0000 7f920cff9700 1 -- 172.21.15.146:0/2793677254 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f91fc02a070 con 0x7f92100bb980 2021-01-27T09:44:52.916 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.909+0000 7f920cff9700 1 --2- 172.21.15.146:0/2793677254 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f91f00561b0 0x7f91f0058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:52.916 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.909+0000 7f920cff9700 1 -- 172.21.15.146:0/2793677254 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f91fc070bf0 con 0x7f92100bb980 2021-01-27T09:44:52.916 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.913+0000 7f9214887700 1 --2- 172.21.15.146:0/2793677254 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f91f00561b0 0x7f91f0058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:52.916 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.913+0000 7f9214887700 1 --2- 172.21.15.146:0/2793677254 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f91f00561b0 0x7f91f0058670 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f9204007fd0 tx=0x7f9204007a50).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:52.918 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:52.917+0000 7f920cff9700 1 -- 172.21.15.146:0/2793677254 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f91fc046240 con 0x7f92100bb980 2021-01-27T09:44:53.060 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.057+0000 7f9215889700 1 -- 172.21.15.146:0/2793677254 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f92100bc030 con 0x7f92100bb980 2021-01-27T09:44:53.061 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.057+0000 7f920cff9700 1 -- 172.21.15.146:0/2793677254 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7f91fc049860 con 0x7f92100bb980 2021-01-27T09:44:53.061 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2021-01-27T09:44:53.065 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.061+0000 7f9215889700 1 -- 172.21.15.146:0/2793677254 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f91f00561b0 msgr2=0x7f91f0058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:53.065 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.061+0000 7f9215889700 1 --2- 172.21.15.146:0/2793677254 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f91f00561b0 0x7f91f0058670 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f9204007fd0 tx=0x7f9204007a50).stop 2021-01-27T09:44:53.065 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.061+0000 7f9215889700 1 -- 172.21.15.146:0/2793677254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92100bb980 msgr2=0x7f92100bcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:53.065 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.061+0000 7f9215889700 1 --2- 172.21.15.146:0/2793677254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92100bb980 0x7f92100bcc00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f91fc006f20 tx=0x7f91fc016000).stop 2021-01-27T09:44:53.066 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.061+0000 7f9215889700 1 -- 172.21.15.146:0/2793677254 shutdown_connections 2021-01-27T09:44:53.066 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.061+0000 7f9215889700 1 --2- 172.21.15.146:0/2793677254 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f921014bd70 0x7f921015bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:53.066 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.061+0000 7f9215889700 1 --2- 172.21.15.146:0/2793677254 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f91f00561b0 0x7f91f0058670 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:53.066 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.061+0000 7f9215889700 1 --2- 172.21.15.146:0/2793677254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92100bb980 0x7f92100bcc00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:53.067 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.061+0000 7f9215889700 1 --2- 172.21.15.146:0/2793677254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9210069830 0x7f921014df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:53.067 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.061+0000 7f9215889700 1 -- 172.21.15.146:0/2793677254 >> 172.21.15.146:0/2793677254 conn(0x7f9210064240 msgr2=0x7f9210151420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:53.067 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.061+0000 7f9215889700 1 -- 172.21.15.146:0/2793677254 shutdown_connections 2021-01-27T09:44:53.067 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.065+0000 7f9215889700 1 -- 172.21.15.146:0/2793677254 wait complete. 2021-01-27T09:44:53.091 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-01-27T09:44:53.261 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.257+0000 7fe3acb77700 1 Processor -- start 2021-01-27T09:44:53.261 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.257+0000 7fe3acb77700 1 -- start start 2021-01-27T09:44:53.262 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.261+0000 7fe3acb77700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe3a80c45d0 0x7fe3a814e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:53.263 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.261+0000 7fe3acb77700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a80692d0 con 0x7fe3a80c49b0 2021-01-27T09:44:53.263 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.261+0000 7fe3acb77700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a8069570 con 0x7fe3a80c1680 2021-01-27T09:44:53.264 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.261+0000 7fe3acb77700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a814eb30 con 0x7fe3a80c45d0 2021-01-27T09:44:53.264 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.261+0000 7fe3a77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe3a80c45d0 0x7fe3a814e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:53.264 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.261+0000 7fe3a6ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe3a80c49b0 0x7fe3a80c0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:34186/0 (socket says 172.21.15.146:34186) 2021-01-27T09:44:53.264 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.261+0000 7fe3a7fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe3a80c1680 0x7fe3a814a9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46154/0 (socket says 172.21.15.146:46154) 2021-01-27T09:44:53.264 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.261+0000 7fe3a6ffd700 1 -- 172.21.15.146:0/3739032359 learned_addr learned my addr 172.21.15.146:0/3739032359 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:53.266 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.261+0000 7fe3a67fc700 1 -- 172.21.15.146:0/3739032359 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 735058025 0 0) 0x7fe3a80692d0 con 0x7fe3a80c49b0 2021-01-27T09:44:53.266 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.261+0000 7fe3a67fc700 1 -- 172.21.15.146:0/3739032359 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe394003270 con 0x7fe3a80c49b0 2021-01-27T09:44:53.266 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.261+0000 7fe3a67fc700 1 -- 172.21.15.146:0/3739032359 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659654333 0 0) 0x7fe3a8069570 con 0x7fe3a80c1680 2021-01-27T09:44:53.266 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.261+0000 7fe3a67fc700 1 -- 172.21.15.146:0/3739032359 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3a80692d0 con 0x7fe3a80c1680 2021-01-27T09:44:53.267 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.261+0000 7fe3a77fe700 1 -- 172.21.15.146:0/3739032359 >> v1:172.21.15.146:6789/0 conn(0x7fe3a80c1680 legacy=0x7fe3a814a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:53.267 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.261+0000 7fe3a77fe700 1 -- 172.21.15.146:0/3739032359 >> v1:172.21.15.78:6789/0 conn(0x7fe3a80c49b0 legacy=0x7fe3a80c0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:53.267 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.261+0000 7fe3a77fe700 1 -- 172.21.15.146:0/3739032359 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a8069810 con 0x7fe3a80c45d0 2021-01-27T09:44:53.267 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.261+0000 7fe3a77fe700 1 --2- 172.21.15.146:0/3739032359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3a80c45d0 0x7fe3a814e640 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fe39800ba20 tx=0x7fe398006e20).ready entity=mon.1 client_cookie=f3673f61b14b027d server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:53.267 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.261+0000 7fe3a67fc700 1 -- 172.21.15.146:0/3739032359 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39800be60 con 0x7fe3a80c45d0 2021-01-27T09:44:53.268 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.265+0000 7fe3a67fc700 1 -- 172.21.15.146:0/3739032359 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe398009760 con 0x7fe3a80c45d0 2021-01-27T09:44:53.268 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.265+0000 7fe3a67fc700 1 -- 172.21.15.146:0/3739032359 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe398009ae0 con 0x7fe3a80c45d0 2021-01-27T09:44:53.269 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.265+0000 7fe3acb77700 1 -- 172.21.15.146:0/3739032359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3a80c45d0 msgr2=0x7fe3a814e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:53.269 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.265+0000 7fe3acb77700 1 --2- 172.21.15.146:0/3739032359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3a80c45d0 0x7fe3a814e640 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fe39800ba20 tx=0x7fe398006e20).stop 2021-01-27T09:44:53.269 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.265+0000 7fe3acb77700 1 -- 172.21.15.146:0/3739032359 shutdown_connections 2021-01-27T09:44:53.269 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.265+0000 7fe3acb77700 1 --2- 172.21.15.146:0/3739032359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3a80c45d0 0x7fe3a814e640 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:53.270 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.265+0000 7fe3acb77700 1 -- 172.21.15.146:0/3739032359 >> 172.21.15.146:0/3739032359 conn(0x7fe3a8064df0 msgr2=0x7fe3a80651d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:53.270 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.265+0000 7fe3acb77700 1 -- 172.21.15.146:0/3739032359 shutdown_connections 2021-01-27T09:44:53.270 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.265+0000 7fe3acb77700 1 -- 172.21.15.146:0/3739032359 wait complete. 2021-01-27T09:44:53.271 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.269+0000 7fe3acb77700 1 Processor -- start 2021-01-27T09:44:53.271 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.269+0000 7fe3acb77700 1 -- start start 2021-01-27T09:44:53.272 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.269+0000 7fe3acb77700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a80c1680 0x7fe3a815dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:53.273 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.269+0000 7fe3acb77700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe3a80c45d0 0x7fe3a80b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:53.273 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.269+0000 7fe3acb77700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3a80c49b0 0x7fe3a8151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:53.273 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.269+0000 7fe3acb77700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a80bc840 con 0x7fe3a80c1680 2021-01-27T09:44:53.273 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.269+0000 7fe3acb77700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a8150010 con 0x7fe3a80c49b0 2021-01-27T09:44:53.273 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.269+0000 7fe3acb77700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a814f6c0 con 0x7fe3a80c45d0 2021-01-27T09:44:53.275 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.269+0000 7fe3a7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3a80c49b0 0x7fe3a8151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:53.275 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.269+0000 7fe3a6ffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe3a80c45d0 0x7fe3a80b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:53.275 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.269+0000 7fe3a77fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a80c1680 0x7fe3a815dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:53.276 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.269+0000 7fe3a7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3a80c49b0 0x7fe3a8151260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46588/0 (socket says 172.21.15.146:46588) 2021-01-27T09:44:53.276 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.269+0000 7fe3a7fff700 1 -- 172.21.15.146:0/3519074005 learned_addr learned my addr 172.21.15.146:0/3519074005 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:53.276 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.273+0000 7fe3a7fff700 1 -- 172.21.15.146:0/3519074005 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe3a80c45d0 msgr2=0x7fe3a80b14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:53.276 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.273+0000 7fe3a7fff700 1 --2- 172.21.15.146:0/3519074005 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe3a80c45d0 0x7fe3a80b14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:53.277 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.273+0000 7fe3a7fff700 1 -- 172.21.15.146:0/3519074005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a80c1680 msgr2=0x7fe3a815dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:53.277 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.273+0000 7fe3a7fff700 1 --2- 172.21.15.146:0/3519074005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a80c1680 0x7fe3a815dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:53.277 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.273+0000 7fe3a7fff700 1 -- 172.21.15.146:0/3519074005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a814f960 con 0x7fe3a80c49b0 2021-01-27T09:44:53.278 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.273+0000 7fe3a77fe700 1 --2- 172.21.15.146:0/3519074005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a80c1680 0x7fe3a815dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:53.278 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.273+0000 7fe3a7fff700 1 --2- 172.21.15.146:0/3519074005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3a80c49b0 0x7fe3a8151260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fe3a000ca90 tx=0x7fe3a0007db0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:53.278 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.273+0000 7fe38f7fe700 1 -- 172.21.15.146:0/3519074005 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a00058e0 con 0x7fe3a80c49b0 2021-01-27T09:44:53.279 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.273+0000 7fe3acb77700 1 -- 172.21.15.146:0/3519074005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a814fc00 con 0x7fe3a80c49b0 2021-01-27T09:44:53.279 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.273+0000 7fe38f7fe700 1 -- 172.21.15.146:0/3519074005 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a0005a40 con 0x7fe3a80c49b0 2021-01-27T09:44:53.280 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.273+0000 7fe38f7fe700 1 -- 172.21.15.146:0/3519074005 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0005dc0 con 0x7fe3a80c49b0 2021-01-27T09:44:53.280 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.273+0000 7fe3acb77700 1 -- 172.21.15.146:0/3519074005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a8150dc0 con 0x7fe3a80c49b0 2021-01-27T09:44:53.281 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.273+0000 7fe3acb77700 1 -- 172.21.15.146:0/3519074005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a80699f0 con 0x7fe3a80c49b0 2021-01-27T09:44:53.281 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.273+0000 7fe38f7fe700 1 -- 172.21.15.146:0/3519074005 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fe3a0010030 con 0x7fe3a80c49b0 2021-01-27T09:44:53.281 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.277+0000 7fe38f7fe700 1 --2- 172.21.15.146:0/3519074005 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe3880561e0 0x7fe3880586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:53.281 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.277+0000 7fe38f7fe700 1 -- 172.21.15.146:0/3519074005 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fe3a006f4e0 con 0x7fe3a80c49b0 2021-01-27T09:44:53.282 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.277+0000 7fe3a77fe700 1 --2- 172.21.15.146:0/3519074005 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe3880561e0 0x7fe3880586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:53.282 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.277+0000 7fe3a77fe700 1 --2- 172.21.15.146:0/3519074005 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe3880561e0 0x7fe3880586a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fe398006b90 tx=0x7fe398016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:53.285 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.281+0000 7fe38f7fe700 1 -- 172.21.15.146:0/3519074005 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fe3a0044a80 con 0x7fe3a80c49b0 2021-01-27T09:44:53.428 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.425+0000 7fe3acb77700 1 -- 172.21.15.146:0/3519074005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe3a80bb660 con 0x7fe3a80c49b0 2021-01-27T09:44:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.425+0000 7fe38f7fe700 1 -- 172.21.15.146:0/3519074005 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe3a00480a0 con 0x7fe3a80c49b0 2021-01-27T09:44:53.429 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:44:53.431 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.429+0000 7fe3acb77700 1 -- 172.21.15.146:0/3519074005 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe3880561e0 msgr2=0x7fe3880586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:53.431 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.429+0000 7fe3acb77700 1 --2- 172.21.15.146:0/3519074005 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe3880561e0 0x7fe3880586a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fe398006b90 tx=0x7fe398016000).stop 2021-01-27T09:44:53.431 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.429+0000 7fe3acb77700 1 -- 172.21.15.146:0/3519074005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3a80c49b0 msgr2=0x7fe3a8151260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:53.431 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.429+0000 7fe3acb77700 1 --2- 172.21.15.146:0/3519074005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3a80c49b0 0x7fe3a8151260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fe3a000ca90 tx=0x7fe3a0007db0).stop 2021-01-27T09:44:53.432 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.429+0000 7fe3acb77700 1 -- 172.21.15.146:0/3519074005 shutdown_connections 2021-01-27T09:44:53.432 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.429+0000 7fe3acb77700 1 --2- 172.21.15.146:0/3519074005 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe3880561e0 0x7fe3880586a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:53.433 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.429+0000 7fe3acb77700 1 --2- 172.21.15.146:0/3519074005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3a80c49b0 0x7fe3a8151260 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:53.433 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.429+0000 7fe3acb77700 1 --2- 172.21.15.146:0/3519074005 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe3a80c45d0 0x7fe3a80b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:53.433 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.429+0000 7fe3acb77700 1 --2- 172.21.15.146:0/3519074005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a80c1680 0x7fe3a815dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:53.433 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.429+0000 7fe3acb77700 1 -- 172.21.15.146:0/3519074005 >> 172.21.15.146:0/3519074005 conn(0x7fe3a8064df0 msgr2=0x7fe3a80bedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:53.434 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.429+0000 7fe3acb77700 1 -- 172.21.15.146:0/3519074005 shutdown_connections 2021-01-27T09:44:53.434 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.429+0000 7fe3acb77700 1 -- 172.21.15.146:0/3519074005 wait complete. 2021-01-27T09:44:53.459 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-01-27T09:44:53.631 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.629+0000 7fab8759e700 1 Processor -- start 2021-01-27T09:44:53.631 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.629+0000 7fab8759e700 1 -- start start 2021-01-27T09:44:53.634 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.629+0000 7fab8759e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fab880c49e0 0x7fab880c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:53.634 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.629+0000 7fab8759e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fab8814dd70 0x7fab880c18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:53.634 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.629+0000 7fab8759e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab8814e2b0 con 0x7fab880c4600 2021-01-27T09:44:53.635 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.629+0000 7fab8759e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab88060b70 con 0x7fab8814dd70 2021-01-27T09:44:53.635 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.629+0000 7fab8759e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab880c1d90 con 0x7fab880c49e0 2021-01-27T09:44:53.635 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.629+0000 7fab85d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fab880c49e0 0x7fab880c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:53.636 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.629+0000 7fab85d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fab880c49e0 0x7fab880c13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46594/0 (socket says 172.21.15.146:46594) 2021-01-27T09:44:53.636 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.629+0000 7fab85d9b700 1 -- 172.21.15.146:0/797585145 learned_addr learned my addr 172.21.15.146:0/797585145 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:53.636 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.629+0000 7fab86d9d700 1 --2- 172.21.15.146:0/797585145 >> v2:172.21.15.78:3300/0 conn(0x7fab8814dd70 0x7fab880c18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:53.637 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.629+0000 7fab8659c700 1 --1- 172.21.15.146:0/797585145 >> v1:172.21.15.78:6789/0 conn(0x7fab880c4600 0x7fab88060450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:34198/0 (socket says 172.21.15.146:34198) 2021-01-27T09:44:53.640 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.633+0000 7fab85d9b700 1 -- 172.21.15.146:0/797585145 >> v2:172.21.15.78:3300/0 conn(0x7fab8814dd70 msgr2=0x7fab880c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:53.641 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.633+0000 7fab85d9b700 1 --2- 172.21.15.146:0/797585145 >> v2:172.21.15.78:3300/0 conn(0x7fab8814dd70 0x7fab880c18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:53.641 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.633+0000 7fab85d9b700 1 -- 172.21.15.146:0/797585145 >> v1:172.21.15.78:6789/0 conn(0x7fab880c4600 legacy=0x7fab88060450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:53.641 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.633+0000 7fab85d9b700 1 -- 172.21.15.146:0/797585145 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8814e550 con 0x7fab880c49e0 2021-01-27T09:44:53.641 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.633+0000 7fab85d9b700 1 --2- 172.21.15.146:0/797585145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab880c49e0 0x7fab880c13b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fab88065ba0 tx=0x7fab7c006ee0).ready entity=mon.1 client_cookie=191273e0b0a1fd69 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.633+0000 7fab8559a700 1 -- 172.21.15.146:0/797585145 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c0098d0 con 0x7fab880c49e0 2021-01-27T09:44:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.633+0000 7fab8559a700 1 -- 172.21.15.146:0/797585145 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7c009a30 con 0x7fab880c49e0 2021-01-27T09:44:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.633+0000 7fab8559a700 1 -- 172.21.15.146:0/797585145 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c009db0 con 0x7fab880c49e0 2021-01-27T09:44:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.633+0000 7fab8759e700 1 -- 172.21.15.146:0/797585145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab880c49e0 msgr2=0x7fab880c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.633+0000 7fab8759e700 1 --2- 172.21.15.146:0/797585145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab880c49e0 0x7fab880c13b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fab88065ba0 tx=0x7fab7c006ee0).stop 2021-01-27T09:44:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.633+0000 7fab8759e700 1 -- 172.21.15.146:0/797585145 shutdown_connections 2021-01-27T09:44:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.633+0000 7fab8759e700 1 --2- 172.21.15.146:0/797585145 >> v2:172.21.15.78:3300/0 conn(0x7fab8814dd70 0x7fab880c18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.633+0000 7fab8759e700 1 --2- 172.21.15.146:0/797585145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab880c49e0 0x7fab880c13b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.633+0000 7fab8759e700 1 -- 172.21.15.146:0/797585145 >> 172.21.15.146:0/797585145 conn(0x7fab88064f90 msgr2=0x7fab880653a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.633+0000 7fab8759e700 1 -- 172.21.15.146:0/797585145 shutdown_connections 2021-01-27T09:44:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.633+0000 7fab8759e700 1 -- 172.21.15.146:0/797585145 wait complete. 2021-01-27T09:44:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.637+0000 7fab8759e700 1 Processor -- start 2021-01-27T09:44:53.645 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.637+0000 7fab8759e700 1 -- start start 2021-01-27T09:44:53.647 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.637+0000 7fab8759e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab880c4600 0x7fab880c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:53.647 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.637+0000 7fab8759e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fab880c49e0 0x7fab880c2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:53.647 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.637+0000 7fab8759e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab8814dd70 0x7fab880bf110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:53.647 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.637+0000 7fab8759e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8814bac0 con 0x7fab880c4600 2021-01-27T09:44:53.648 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.637+0000 7fab8759e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab88144b10 con 0x7fab8814dd70 2021-01-27T09:44:53.648 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.637+0000 7fab8759e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab880c2850 con 0x7fab880c49e0 2021-01-27T09:44:53.648 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.641+0000 7fab86d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab8814dd70 0x7fab880bf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:53.648 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.641+0000 7fab8659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab880c4600 0x7fab880c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:53.649 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.641+0000 7fab8659c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab880c4600 0x7fab880c3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:49472/0 (socket says 172.21.15.146:49472) 2021-01-27T09:44:53.649 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.641+0000 7fab85d9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fab880c49e0 0x7fab880c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:53.649 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.641+0000 7fab8659c700 1 -- 172.21.15.146:0/3959730261 learned_addr learned my addr 172.21.15.146:0/3959730261 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:53.649 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.641+0000 7fab86d9d700 1 -- 172.21.15.146:0/3959730261 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fab880c49e0 msgr2=0x7fab880c2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:53.649 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.641+0000 7fab86d9d700 1 --2- 172.21.15.146:0/3959730261 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fab880c49e0 0x7fab880c2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:53.650 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.641+0000 7fab86d9d700 1 -- 172.21.15.146:0/3959730261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab880c4600 msgr2=0x7fab880c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:53.650 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.641+0000 7fab86d9d700 1 --2- 172.21.15.146:0/3959730261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab880c4600 0x7fab880c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:53.651 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.641+0000 7fab86d9d700 1 -- 172.21.15.146:0/3959730261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8815e250 con 0x7fab8814dd70 2021-01-27T09:44:53.651 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.641+0000 7fab8659c700 1 --2- 172.21.15.146:0/3959730261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab880c4600 0x7fab880c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:53.651 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.641+0000 7fab86d9d700 1 --2- 172.21.15.146:0/3959730261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab8814dd70 0x7fab880bf110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fab8000ebd0 tx=0x7fab80009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:53.651 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.641+0000 7fab767fc700 1 -- 172.21.15.146:0/3959730261 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8000c920 con 0x7fab8814dd70 2021-01-27T09:44:53.652 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.641+0000 7fab767fc700 1 -- 172.21.15.146:0/3959730261 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8000ca80 con 0x7fab8814dd70 2021-01-27T09:44:53.652 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.641+0000 7fab8759e700 1 -- 172.21.15.146:0/3959730261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8815e4f0 con 0x7fab8814dd70 2021-01-27T09:44:53.652 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.641+0000 7fab767fc700 1 -- 172.21.15.146:0/3959730261 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8000ce20 con 0x7fab8814dd70 2021-01-27T09:44:53.652 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.641+0000 7fab8759e700 1 -- 172.21.15.146:0/3959730261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab88144870 con 0x7fab8814dd70 2021-01-27T09:44:53.652 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.641+0000 7fab8759e700 1 -- 172.21.15.146:0/3959730261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab88044680 con 0x7fab8814dd70 2021-01-27T09:44:53.653 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.645+0000 7fab767fc700 1 -- 172.21.15.146:0/3959730261 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fab80022070 con 0x7fab8814dd70 2021-01-27T09:44:53.654 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.645+0000 7fab767fc700 1 --2- 172.21.15.146:0/3959730261 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fab640561b0 0x7fab64058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:53.654 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.645+0000 7fab767fc700 1 -- 172.21.15.146:0/3959730261 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fab8006fb10 con 0x7fab8814dd70 2021-01-27T09:44:53.654 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.645+0000 7fab8659c700 1 --2- 172.21.15.146:0/3959730261 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fab640561b0 0x7fab64058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:53.655 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.645+0000 7fab8659c700 1 --2- 172.21.15.146:0/3959730261 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fab640561b0 0x7fab64058670 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fab78007fd0 tx=0x7fab78007c70).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:53.655 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.653+0000 7fab767fc700 1 -- 172.21.15.146:0/3959730261 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fab80045240 con 0x7fab8814dd70 2021-01-27T09:44:53.798 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.793+0000 7fab8759e700 1 -- 172.21.15.146:0/3959730261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fab88063940 con 0x7fab8814dd70 2021-01-27T09:44:53.799 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.797+0000 7fab767fc700 1 -- 172.21.15.146:0/3959730261 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+10 (secure 0 0 0) 0x7fab80016020 con 0x7fab8814dd70 2021-01-27T09:44:53.799 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:44:53.801 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.797+0000 7fab8759e700 1 -- 172.21.15.146:0/3959730261 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fab640561b0 msgr2=0x7fab64058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:53.801 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.797+0000 7fab8759e700 1 --2- 172.21.15.146:0/3959730261 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fab640561b0 0x7fab64058670 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fab78007fd0 tx=0x7fab78007c70).stop 2021-01-27T09:44:53.802 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.797+0000 7fab8759e700 1 -- 172.21.15.146:0/3959730261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab8814dd70 msgr2=0x7fab880bf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:53.802 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.797+0000 7fab8759e700 1 --2- 172.21.15.146:0/3959730261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab8814dd70 0x7fab880bf110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fab8000ebd0 tx=0x7fab80009220).stop 2021-01-27T09:44:53.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.797+0000 7fab8759e700 1 -- 172.21.15.146:0/3959730261 shutdown_connections 2021-01-27T09:44:53.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.797+0000 7fab8759e700 1 --2- 172.21.15.146:0/3959730261 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fab640561b0 0x7fab64058670 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:53.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.797+0000 7fab8759e700 1 --2- 172.21.15.146:0/3959730261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab8814dd70 0x7fab880bf110 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:53.804 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.797+0000 7fab8759e700 1 --2- 172.21.15.146:0/3959730261 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fab880c49e0 0x7fab880c2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:53.804 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.797+0000 7fab8759e700 1 --2- 172.21.15.146:0/3959730261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab880c4600 0x7fab880c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:53.805 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.797+0000 7fab8759e700 1 -- 172.21.15.146:0/3959730261 >> 172.21.15.146:0/3959730261 conn(0x7fab88064f90 msgr2=0x7fab88060020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:53.805 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.797+0000 7fab8759e700 1 -- 172.21.15.146:0/3959730261 shutdown_connections 2021-01-27T09:44:53.805 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.797+0000 7fab8759e700 1 -- 172.21.15.146:0/3959730261 wait complete. 2021-01-27T09:44:53.825 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-01-27T09:44:53.991 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.989+0000 7f69eb59e700 1 Processor -- start 2021-01-27T09:44:53.991 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.989+0000 7f69eb59e700 1 -- start start 2021-01-27T09:44:53.995 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.993+0000 7f69eb59e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f69ec1527b0 0x7f69ec0bd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:53.995 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.993+0000 7f69eb59e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69ec155510 con 0x7f69ec0bcb30 2021-01-27T09:44:53.995 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.993+0000 7f69eb59e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69ec0ba460 con 0x7f69ec14f700 2021-01-27T09:44:53.996 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.993+0000 7f69eb59e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69ec067a90 con 0x7f69ec1527b0 2021-01-27T09:44:53.997 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.993+0000 7f69e9d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f69ec14f700 0x7f69ec152090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46180/0 (socket says 172.21.15.146:46180) 2021-01-27T09:44:53.997 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.993+0000 7f69e9d9b700 1 -- 172.21.15.146:0/1029581897 learned_addr learned my addr 172.21.15.146:0/1029581897 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:53.997 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.993+0000 7f69ead9d700 1 --2- 172.21.15.146:0/1029581897 >> v2:172.21.15.78:3300/0 conn(0x7f69ec1527b0 0x7f69ec0bd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:53.997 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.993+0000 7f69e959a700 1 -- 172.21.15.146:0/1029581897 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255438169 0 0) 0x7f69ec155510 con 0x7f69ec0bcb30 2021-01-27T09:44:53.998 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.993+0000 7f69e959a700 1 -- 172.21.15.146:0/1029581897 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69d0003270 con 0x7f69ec0bcb30 2021-01-27T09:44:53.998 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.993+0000 7f69e959a700 1 -- 172.21.15.146:0/1029581897 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3622570001 0 0) 0x7f69ec0ba460 con 0x7f69ec14f700 2021-01-27T09:44:53.998 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.993+0000 7f69e959a700 1 -- 172.21.15.146:0/1029581897 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69ec155510 con 0x7f69ec14f700 2021-01-27T09:44:53.998 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.993+0000 7f69ead9d700 1 -- 172.21.15.146:0/1029581897 >> v1:172.21.15.146:6789/0 conn(0x7f69ec14f700 legacy=0x7f69ec152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:53.998 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.993+0000 7f69ead9d700 1 -- 172.21.15.146:0/1029581897 >> v1:172.21.15.78:6789/0 conn(0x7f69ec0bcb30 legacy=0x7f69ec14efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:53.999 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.993+0000 7f69ead9d700 1 -- 172.21.15.146:0/1029581897 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ec155770 con 0x7f69ec1527b0 2021-01-27T09:44:53.999 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.993+0000 7f69ead9d700 1 --2- 172.21.15.146:0/1029581897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69ec1527b0 0x7f69ec0bd5c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f69e4009cc0 tx=0x7f69e4009220).ready entity=mon.0 client_cookie=7e47149ce01a1628 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:54.000 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.997+0000 7f69e959a700 1 -- 172.21.15.146:0/1029581897 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e400b960 con 0x7f69ec1527b0 2021-01-27T09:44:54.000 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.997+0000 7f69e959a700 1 -- 172.21.15.146:0/1029581897 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e400bac0 con 0x7f69ec1527b0 2021-01-27T09:44:54.000 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.997+0000 7f69e959a700 1 -- 172.21.15.146:0/1029581897 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e400be40 con 0x7f69ec1527b0 2021-01-27T09:44:54.000 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.997+0000 7f69eb59e700 1 -- 172.21.15.146:0/1029581897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69ec1527b0 msgr2=0x7f69ec0bd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:54.000 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.997+0000 7f69eb59e700 1 --2- 172.21.15.146:0/1029581897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69ec1527b0 0x7f69ec0bd5c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f69e4009cc0 tx=0x7f69e4009220).stop 2021-01-27T09:44:54.001 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.997+0000 7f69eb59e700 1 -- 172.21.15.146:0/1029581897 shutdown_connections 2021-01-27T09:44:54.001 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.997+0000 7f69eb59e700 1 --2- 172.21.15.146:0/1029581897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69ec1527b0 0x7f69ec0bd5c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.002 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.997+0000 7f69eb59e700 1 -- 172.21.15.146:0/1029581897 >> 172.21.15.146:0/1029581897 conn(0x7f69ec069ba0 msgr2=0x7f69ec062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:54.002 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.997+0000 7f69eb59e700 1 -- 172.21.15.146:0/1029581897 shutdown_connections 2021-01-27T09:44:54.002 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:53.997+0000 7f69eb59e700 1 -- 172.21.15.146:0/1029581897 wait complete. 2021-01-27T09:44:54.003 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.001+0000 7f69eb59e700 1 Processor -- start 2021-01-27T09:44:54.004 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.001+0000 7f69eb59e700 1 -- start start 2021-01-27T09:44:54.005 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.001+0000 7f69eb59e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69ec0bcb30 0x7f69ec0acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:54.005 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.001+0000 7f69eb59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69ec14f700 0x7f69ec0ba920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:54.006 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.001+0000 7f69eb59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69ec1527b0 0x7f69ec14d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:54.006 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.001+0000 7f69eb59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec0ad400 con 0x7f69ec1527b0 2021-01-27T09:44:54.006 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.001+0000 7f69eb59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec0af750 con 0x7f69ec14f700 2021-01-27T09:44:54.006 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.001+0000 7f69eb59e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec0af9f0 con 0x7f69ec0bcb30 2021-01-27T09:44:54.008 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.001+0000 7f69e9d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69ec14f700 0x7f69ec0ba920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:54.008 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.005+0000 7f69ea59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69ec0bcb30 0x7f69ec0acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:54.008 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.005+0000 7f69ead9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69ec1527b0 0x7f69ec14d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:54.008 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.005+0000 7f69e9d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69ec14f700 0x7f69ec0ba920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46616/0 (socket says 172.21.15.146:46616) 2021-01-27T09:44:54.009 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.005+0000 7f69e9d9b700 1 -- 172.21.15.146:0/3644709189 learned_addr learned my addr 172.21.15.146:0/3644709189 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:54.009 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.005+0000 7f69e9d9b700 1 -- 172.21.15.146:0/3644709189 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69ec0bcb30 msgr2=0x7f69ec0acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:54.009 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.005+0000 7f69e9d9b700 1 --2- 172.21.15.146:0/3644709189 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69ec0bcb30 0x7f69ec0acf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.009 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.005+0000 7f69e9d9b700 1 -- 172.21.15.146:0/3644709189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69ec1527b0 msgr2=0x7f69ec14d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:54.009 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.005+0000 7f69e9d9b700 1 --2- 172.21.15.146:0/3644709189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69ec1527b0 0x7f69ec14d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.005+0000 7f69e9d9b700 1 -- 172.21.15.146:0/3644709189 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ec161520 con 0x7f69ec14f700 2021-01-27T09:44:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.005+0000 7f69e9d9b700 1 --2- 172.21.15.146:0/3644709189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69ec14f700 0x7f69ec0ba920 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f69e000c770 tx=0x7f69e0007b00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.005+0000 7f69da7fc700 1 -- 172.21.15.146:0/3644709189 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e00072e0 con 0x7f69ec14f700 2021-01-27T09:44:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.005+0000 7f69da7fc700 1 -- 172.21.15.146:0/3644709189 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e0007440 con 0x7f69ec14f700 2021-01-27T09:44:54.011 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.005+0000 7f69eb59e700 1 -- 172.21.15.146:0/3644709189 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69ec1617c0 con 0x7f69ec14f700 2021-01-27T09:44:54.011 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.005+0000 7f69da7fc700 1 -- 172.21.15.146:0/3644709189 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e0005830 con 0x7f69ec14f700 2021-01-27T09:44:54.011 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.005+0000 7f69eb59e700 1 -- 172.21.15.146:0/3644709189 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69ec161d00 con 0x7f69ec14f700 2021-01-27T09:44:54.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.005+0000 7f69eb59e700 1 -- 172.21.15.146:0/3644709189 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69ec0bbf90 con 0x7f69ec14f700 2021-01-27T09:44:54.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.005+0000 7f69da7fc700 1 -- 172.21.15.146:0/3644709189 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f69e0010070 con 0x7f69ec14f700 2021-01-27T09:44:54.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.009+0000 7f69da7fc700 1 --2- 172.21.15.146:0/3644709189 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f69c80561e0 0x7f69c80586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.009+0000 7f69da7fc700 1 -- 172.21.15.146:0/3644709189 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f69e006eb70 con 0x7f69ec14f700 2021-01-27T09:44:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.009+0000 7f69ea59c700 1 --2- 172.21.15.146:0/3644709189 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f69c80561e0 0x7f69c80586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.009+0000 7f69ea59c700 1 --2- 172.21.15.146:0/3644709189 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f69c80561e0 0x7f69c80586a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f69ec0bb200 tx=0x7f69dc007ab0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:54.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.013+0000 7f69da7fc700 1 -- 172.21.15.146:0/3644709189 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f69e0044220 con 0x7f69ec14f700 2021-01-27T09:44:54.158 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.153+0000 7f69eb59e700 1 -- 172.21.15.146:0/3644709189 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f69ec063de0 con 0x7f69ec14f700 2021-01-27T09:44:54.159 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.157+0000 7f69da7fc700 1 -- 172.21.15.146:0/3644709189 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+10 (secure 0 0 0) 0x7f69e0047840 con 0x7f69ec14f700 2021-01-27T09:44:54.159 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:44:54.161 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.157+0000 7f69eb59e700 1 -- 172.21.15.146:0/3644709189 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f69c80561e0 msgr2=0x7f69c80586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:54.161 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.157+0000 7f69eb59e700 1 --2- 172.21.15.146:0/3644709189 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f69c80561e0 0x7f69c80586a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f69ec0bb200 tx=0x7f69dc007ab0).stop 2021-01-27T09:44:54.161 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.157+0000 7f69eb59e700 1 -- 172.21.15.146:0/3644709189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69ec14f700 msgr2=0x7f69ec0ba920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:54.162 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.157+0000 7f69eb59e700 1 --2- 172.21.15.146:0/3644709189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69ec14f700 0x7f69ec0ba920 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f69e000c770 tx=0x7f69e0007b00).stop 2021-01-27T09:44:54.162 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.157+0000 7f69eb59e700 1 -- 172.21.15.146:0/3644709189 shutdown_connections 2021-01-27T09:44:54.162 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.157+0000 7f69eb59e700 1 --2- 172.21.15.146:0/3644709189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69ec1527b0 0x7f69ec14d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.162 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.157+0000 7f69eb59e700 1 --2- 172.21.15.146:0/3644709189 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f69c80561e0 0x7f69c80586a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.163 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.157+0000 7f69eb59e700 1 --2- 172.21.15.146:0/3644709189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69ec14f700 0x7f69ec0ba920 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.163 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.157+0000 7f69eb59e700 1 --2- 172.21.15.146:0/3644709189 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69ec0bcb30 0x7f69ec0acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.164 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.157+0000 7f69eb59e700 1 -- 172.21.15.146:0/3644709189 >> 172.21.15.146:0/3644709189 conn(0x7f69ec069ba0 msgr2=0x7f69ec066820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:54.165 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.157+0000 7f69eb59e700 1 -- 172.21.15.146:0/3644709189 shutdown_connections 2021-01-27T09:44:54.165 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.157+0000 7f69eb59e700 1 -- 172.21.15.146:0/3644709189 wait complete. 2021-01-27T09:44:54.187 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2021-01-27T09:44:54.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.361+0000 7f0134da2700 1 Processor -- start 2021-01-27T09:44:54.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.361+0000 7f0134da2700 1 -- start start 2021-01-27T09:44:54.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.361+0000 7f0134da2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0130151670 0x7f01300bd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:54.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.361+0000 7f0134da2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f01300bc440 0x7f0130151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:54.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.361+0000 7f0134da2700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01300b9920 con 0x7f01300bbef0 2021-01-27T09:44:54.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.361+0000 7f0134da2700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01300bfd00 con 0x7f0130151670 2021-01-27T09:44:54.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.361+0000 7f0134da2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0130065c50 con 0x7f01300bc440 2021-01-27T09:44:54.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.361+0000 7f012f7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0130151670 0x7f01300bd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:54.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.361+0000 7f012ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f01300bc440 0x7f0130151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:54.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.361+0000 7f012effd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f01300bbef0 0x7f0130062c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:34226/0 (socket says 172.21.15.146:34226) 2021-01-27T09:44:54.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.361+0000 7f012effd700 1 -- 172.21.15.146:0/3656543682 learned_addr learned my addr 172.21.15.146:0/3656543682 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:54.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.365+0000 7f012f7fe700 1 -- 172.21.15.146:0/3656543682 >> v2:172.21.15.146:3300/0 conn(0x7f01300bc440 msgr2=0x7f0130151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:54.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.365+0000 7f012f7fe700 1 --2- 172.21.15.146:0/3656543682 >> v2:172.21.15.146:3300/0 conn(0x7f01300bc440 0x7f0130151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.365+0000 7f012e7fc700 1 -- 172.21.15.146:0/3656543682 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205242223 0 0) 0x7f01300b9920 con 0x7f01300bbef0 2021-01-27T09:44:54.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.365+0000 7f012f7fe700 1 -- 172.21.15.146:0/3656543682 >> v1:172.21.15.78:6789/0 conn(0x7f01300bbef0 legacy=0x7f0130062c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:54.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.365+0000 7f012f7fe700 1 -- 172.21.15.146:0/3656543682 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01300bd540 con 0x7f0130151670 2021-01-27T09:44:54.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.365+0000 7f012f7fe700 1 --2- 172.21.15.146:0/3656543682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0130151670 0x7f01300bd940 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f0130067700 tx=0x7f0120006e20).ready entity=mon.0 client_cookie=6a33a66e211a1afa server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:54.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.365+0000 7f012e7fc700 1 -- 172.21.15.146:0/3656543682 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012000be80 con 0x7f0130151670 2021-01-27T09:44:54.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.365+0000 7f012e7fc700 1 -- 172.21.15.146:0/3656543682 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0120009870 con 0x7f0130151670 2021-01-27T09:44:54.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.365+0000 7f012e7fc700 1 -- 172.21.15.146:0/3656543682 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0120009bf0 con 0x7f0130151670 2021-01-27T09:44:54.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.365+0000 7f0134da2700 1 -- 172.21.15.146:0/3656543682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0130151670 msgr2=0x7f01300bd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:54.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.365+0000 7f0134da2700 1 --2- 172.21.15.146:0/3656543682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0130151670 0x7f01300bd940 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f0130067700 tx=0x7f0120006e20).stop 2021-01-27T09:44:54.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.365+0000 7f0134da2700 1 -- 172.21.15.146:0/3656543682 shutdown_connections 2021-01-27T09:44:54.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.365+0000 7f0134da2700 1 --2- 172.21.15.146:0/3656543682 >> v2:172.21.15.146:3300/0 conn(0x7f01300bc440 0x7f0130151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.365+0000 7f0134da2700 1 --2- 172.21.15.146:0/3656543682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0130151670 0x7f01300bd940 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.365+0000 7f0134da2700 1 -- 172.21.15.146:0/3656543682 >> 172.21.15.146:0/3656543682 conn(0x7f0130064240 msgr2=0x7f0130069110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:54.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.365+0000 7f0134da2700 1 -- 172.21.15.146:0/3656543682 shutdown_connections 2021-01-27T09:44:54.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.365+0000 7f0134da2700 1 -- 172.21.15.146:0/3656543682 wait complete. 2021-01-27T09:44:54.373 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.369+0000 7f0134da2700 1 Processor -- start 2021-01-27T09:44:54.373 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.369+0000 7f0134da2700 1 -- start start 2021-01-27T09:44:54.375 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.373+0000 7f0134da2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01300bbef0 0x7f01300a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:54.375 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.373+0000 7f0134da2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01300bc440 0x7f01300a71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:54.375 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.373+0000 7f0134da2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0130151670 0x7f013014c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:54.375 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.373+0000 7f0134da2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013015d2d0 con 0x7f0130151670 2021-01-27T09:44:54.376 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.373+0000 7f0134da2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0130150990 con 0x7f01300bbef0 2021-01-27T09:44:54.376 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.373+0000 7f0134da2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01300a63b0 con 0x7f01300bc440 2021-01-27T09:44:54.376 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.373+0000 7f012f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01300bbef0 0x7f01300a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:54.376 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.373+0000 7f012f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01300bbef0 0x7f01300a3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46626/0 (socket says 172.21.15.146:46626) 2021-01-27T09:44:54.376 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.373+0000 7f012ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0130151670 0x7f013014c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:54.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.373+0000 7f012f7fe700 1 -- 172.21.15.146:0/4175895424 learned_addr learned my addr 172.21.15.146:0/4175895424 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:54.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.373+0000 7f012effd700 1 --2- 172.21.15.146:0/4175895424 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01300bc440 0x7f01300a71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:54.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.373+0000 7f012f7fe700 1 -- 172.21.15.146:0/4175895424 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01300bc440 msgr2=0x7f01300a71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:54.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.373+0000 7f012f7fe700 1 --2- 172.21.15.146:0/4175895424 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01300bc440 0x7f01300a71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.373+0000 7f012f7fe700 1 -- 172.21.15.146:0/4175895424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0130151670 msgr2=0x7f013014c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:54.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.373+0000 7f012f7fe700 1 --2- 172.21.15.146:0/4175895424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0130151670 0x7f013014c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.373+0000 7f012f7fe700 1 -- 172.21.15.146:0/4175895424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01300a6650 con 0x7f01300bbef0 2021-01-27T09:44:54.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.373+0000 7f012ffff700 1 --2- 172.21.15.146:0/4175895424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0130151670 0x7f013014c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:54.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.373+0000 7f012f7fe700 1 --2- 172.21.15.146:0/4175895424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01300bbef0 0x7f01300a3910 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f01300615e0 tx=0x7f0120016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:54.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.373+0000 7f01177fe700 1 -- 172.21.15.146:0/4175895424 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0120011b40 con 0x7f01300bbef0 2021-01-27T09:44:54.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.373+0000 7f01177fe700 1 -- 172.21.15.146:0/4175895424 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0120011ca0 con 0x7f01300bbef0 2021-01-27T09:44:54.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.373+0000 7f0134da2700 1 -- 172.21.15.146:0/4175895424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01300a68f0 con 0x7f01300bbef0 2021-01-27T09:44:54.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.373+0000 7f01177fe700 1 -- 172.21.15.146:0/4175895424 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012001d640 con 0x7f01300bbef0 2021-01-27T09:44:54.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.373+0000 7f0134da2700 1 -- 172.21.15.146:0/4175895424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01300a76c0 con 0x7f01300bbef0 2021-01-27T09:44:54.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.377+0000 7f0134da2700 1 -- 172.21.15.146:0/4175895424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f013005c520 con 0x7f01300bbef0 2021-01-27T09:44:54.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.377+0000 7f01177fe700 1 -- 172.21.15.146:0/4175895424 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f0120024030 con 0x7f01300bbef0 2021-01-27T09:44:54.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.377+0000 7f01177fe700 1 --2- 172.21.15.146:0/4175895424 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f01100561e0 0x7f01100586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:54.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.377+0000 7f01177fe700 1 -- 172.21.15.146:0/4175895424 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f0120070470 con 0x7f01300bbef0 2021-01-27T09:44:54.384 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.377+0000 7f012effd700 1 --2- 172.21.15.146:0/4175895424 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f01100561e0 0x7f01100586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:54.384 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.381+0000 7f012effd700 1 --2- 172.21.15.146:0/4175895424 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f01100561e0 0x7f01100586a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f0124007fd0 tx=0x7f0124007c50).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:54.388 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.385+0000 7f01177fe700 1 -- 172.21.15.146:0/4175895424 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f0120045bd0 con 0x7f01300bbef0 2021-01-27T09:44:54.531 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.529+0000 7f0134da2700 1 -- 172.21.15.146:0/4175895424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f01300a6a80 con 0x7f01300bbef0 2021-01-27T09:44:54.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.529+0000 7f01177fe700 1 -- 172.21.15.146:0/4175895424 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+10 (secure 0 0 0) 0x7f0120022020 con 0x7f01300bbef0 2021-01-27T09:44:54.532 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:44:54.534 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.533+0000 7f0134da2700 1 -- 172.21.15.146:0/4175895424 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f01100561e0 msgr2=0x7f01100586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:54.535 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.533+0000 7f0134da2700 1 --2- 172.21.15.146:0/4175895424 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f01100561e0 0x7f01100586a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f0124007fd0 tx=0x7f0124007c50).stop 2021-01-27T09:44:54.535 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.533+0000 7f0134da2700 1 -- 172.21.15.146:0/4175895424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01300bbef0 msgr2=0x7f01300a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:54.535 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.533+0000 7f0134da2700 1 --2- 172.21.15.146:0/4175895424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01300bbef0 0x7f01300a3910 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f01300615e0 tx=0x7f0120016000).stop 2021-01-27T09:44:54.535 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.533+0000 7f0134da2700 1 -- 172.21.15.146:0/4175895424 shutdown_connections 2021-01-27T09:44:54.536 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.533+0000 7f0134da2700 1 --2- 172.21.15.146:0/4175895424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0130151670 0x7f013014c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.536 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.533+0000 7f0134da2700 1 --2- 172.21.15.146:0/4175895424 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01300bc440 0x7f01300a71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.536 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.533+0000 7f0134da2700 1 --2- 172.21.15.146:0/4175895424 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f01100561e0 0x7f01100586a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.536 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.533+0000 7f0134da2700 1 --2- 172.21.15.146:0/4175895424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01300bbef0 0x7f01300a3910 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.536 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.533+0000 7f0134da2700 1 -- 172.21.15.146:0/4175895424 >> 172.21.15.146:0/4175895424 conn(0x7f0130064240 msgr2=0x7f01300bebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:54.537 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.533+0000 7f0134da2700 1 -- 172.21.15.146:0/4175895424 shutdown_connections 2021-01-27T09:44:54.537 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.533+0000 7f0134da2700 1 -- 172.21.15.146:0/4175895424 wait complete. 2021-01-27T09:44:54.563 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-01-27T09:44:54.563 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2021-01-27T09:44:54.564 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2021-01-27T09:44:54.726 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.721+0000 7f5933127700 1 Processor -- start 2021-01-27T09:44:54.726 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.725+0000 7f5933127700 1 -- start start 2021-01-27T09:44:54.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.725+0000 7f5933127700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f592c0692b0 0x7f592c14ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:54.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.725+0000 7f5933127700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f592c0b8a20 0x7f592c0b95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:54.729 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.725+0000 7f5933127700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592c061f00 con 0x7f592c069690 2021-01-27T09:44:54.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.725+0000 7f5933127700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c14ba40 con 0x7f592c0b8a20 2021-01-27T09:44:54.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.725+0000 7f5933127700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c14adc0 con 0x7f592c0692b0 2021-01-27T09:44:54.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.725+0000 7f5930ec3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f592c0692b0 0x7f592c14ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:54.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.725+0000 7f5930ec3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f592c0692b0 0x7f592c14ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46634/0 (socket says 172.21.15.146:46634) 2021-01-27T09:44:54.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.725+0000 7f5930ec3700 1 -- 172.21.15.146:0/1119374426 learned_addr learned my addr 172.21.15.146:0/1119374426 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:54.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.725+0000 7f592bfff700 1 --2- 172.21.15.146:0/1119374426 >> v2:172.21.15.78:3300/0 conn(0x7f592c0b8a20 0x7f592c0b95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:54.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.729+0000 7f5930ec3700 1 -- 172.21.15.146:0/1119374426 >> v2:172.21.15.78:3300/0 conn(0x7f592c0b8a20 msgr2=0x7f592c0b95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:54.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.729+0000 7f5930ec3700 1 --2- 172.21.15.146:0/1119374426 >> v2:172.21.15.78:3300/0 conn(0x7f592c0b8a20 0x7f592c0b95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.729+0000 7f5930ec3700 1 -- 172.21.15.146:0/1119374426 >> v1:172.21.15.146:6789/0 conn(0x7f592c069690 legacy=0x7f592c144540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:54.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.729+0000 7f5930ec3700 1 -- 172.21.15.146:0/1119374426 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c14b060 con 0x7f592c0692b0 2021-01-27T09:44:54.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.729+0000 7f592bfff700 1 --2- 172.21.15.146:0/1119374426 >> v2:172.21.15.78:3300/0 conn(0x7f592c0b8a20 0x7f592c0b95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:54.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.729+0000 7f5930ec3700 1 --2- 172.21.15.146:0/1119374426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f592c0692b0 0x7f592c14ea30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f592c066cb0 tx=0x7f5920006ee0).ready entity=mon.1 client_cookie=b7bf15d5e56b9b87 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:54.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.729+0000 7f592b7fe700 1 -- 172.21.15.146:0/1119374426 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59200098d0 con 0x7f592c0692b0 2021-01-27T09:44:54.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.729+0000 7f592b7fe700 1 -- 172.21.15.146:0/1119374426 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5920009a30 con 0x7f592c0692b0 2021-01-27T09:44:54.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.729+0000 7f592b7fe700 1 -- 172.21.15.146:0/1119374426 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920009db0 con 0x7f592c0692b0 2021-01-27T09:44:54.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.729+0000 7f5933127700 1 -- 172.21.15.146:0/1119374426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f592c0692b0 msgr2=0x7f592c14ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:54.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.729+0000 7f5933127700 1 --2- 172.21.15.146:0/1119374426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f592c0692b0 0x7f592c14ea30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f592c066cb0 tx=0x7f5920006ee0).stop 2021-01-27T09:44:54.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.729+0000 7f5933127700 1 -- 172.21.15.146:0/1119374426 shutdown_connections 2021-01-27T09:44:54.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.729+0000 7f5933127700 1 --2- 172.21.15.146:0/1119374426 >> v2:172.21.15.78:3300/0 conn(0x7f592c0b8a20 0x7f592c0b95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.729+0000 7f5933127700 1 --2- 172.21.15.146:0/1119374426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f592c0692b0 0x7f592c14ea30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.729+0000 7f5933127700 1 -- 172.21.15.146:0/1119374426 >> 172.21.15.146:0/1119374426 conn(0x7f592c067150 msgr2=0x7f592c067b40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:54.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.729+0000 7f5933127700 1 -- 172.21.15.146:0/1119374426 shutdown_connections 2021-01-27T09:44:54.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.729+0000 7f5933127700 1 -- 172.21.15.146:0/1119374426 wait complete. 2021-01-27T09:44:54.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.733+0000 7f5933127700 1 Processor -- start 2021-01-27T09:44:54.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.733+0000 7f5933127700 1 -- start start 2021-01-27T09:44:54.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.733+0000 7f5933127700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f592c0692b0 0x7f592c0beae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:54.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.733+0000 7f5933127700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f592c069690 0x7f592c1659d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:54.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.733+0000 7f5933127700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f592c0b8a20 0x7f592c0bc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:54.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.733+0000 7f5933127700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c0bcd00 con 0x7f592c069690 2021-01-27T09:44:54.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.733+0000 7f5933127700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c14c240 con 0x7f592c0b8a20 2021-01-27T09:44:54.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.733+0000 7f5933127700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592c0be450 con 0x7f592c0692b0 2021-01-27T09:44:54.740 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.733+0000 7f5930ec3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f592c0692b0 0x7f592c0beae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:54.740 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.733+0000 7f59316c4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f592c0b8a20 0x7f592c0bc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:54.740 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.733+0000 7f5930ec3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f592c0692b0 0x7f592c0beae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36126/0 (socket says 172.21.15.146:36126) 2021-01-27T09:44:54.740 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.733+0000 7f5930ec3700 1 -- 172.21.15.146:0/1031931503 learned_addr learned my addr 172.21.15.146:0/1031931503 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:54.741 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.733+0000 7f592bfff700 1 --2- 172.21.15.146:0/1031931503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f592c069690 0x7f592c1659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:54.741 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.733+0000 7f5930ec3700 1 -- 172.21.15.146:0/1031931503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f592c0b8a20 msgr2=0x7f592c0bc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:54.741 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.733+0000 7f5930ec3700 1 --2- 172.21.15.146:0/1031931503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f592c0b8a20 0x7f592c0bc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.741 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.733+0000 7f5930ec3700 1 -- 172.21.15.146:0/1031931503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f592c069690 msgr2=0x7f592c1659d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:54.741 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.733+0000 7f5930ec3700 1 --2- 172.21.15.146:0/1031931503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f592c069690 0x7f592c1659d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.742 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.737+0000 7f5930ec3700 1 -- 172.21.15.146:0/1031931503 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c0be6f0 con 0x7f592c0692b0 2021-01-27T09:44:54.742 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.737+0000 7f59316c4700 1 --2- 172.21.15.146:0/1031931503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f592c0b8a20 0x7f592c0bc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:54.742 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.737+0000 7f5930ec3700 1 --2- 172.21.15.146:0/1031931503 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f592c0692b0 0x7f592c0beae0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f59200093a0 tx=0x7f5920016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:54.743 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.737+0000 7f5928ff9700 1 -- 172.21.15.146:0/1031931503 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920012bf0 con 0x7f592c0692b0 2021-01-27T09:44:54.744 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.737+0000 7f5928ff9700 1 -- 172.21.15.146:0/1031931503 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5920012d50 con 0x7f592c0692b0 2021-01-27T09:44:54.744 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.737+0000 7f5928ff9700 1 -- 172.21.15.146:0/1031931503 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592001c650 con 0x7f592c0692b0 2021-01-27T09:44:54.744 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.737+0000 7f5933127700 1 -- 172.21.15.146:0/1031931503 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592c164ff0 con 0x7f592c0692b0 2021-01-27T09:44:54.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.737+0000 7f5933127700 1 -- 172.21.15.146:0/1031931503 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592c165530 con 0x7f592c0692b0 2021-01-27T09:44:54.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.737+0000 7f5933127700 1 -- 172.21.15.146:0/1031931503 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f592c044ee0 con 0x7f592c0692b0 2021-01-27T09:44:54.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.741+0000 7f5928ff9700 1 -- 172.21.15.146:0/1031931503 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f592000f070 con 0x7f592c0692b0 2021-01-27T09:44:54.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.741+0000 7f5928ff9700 1 --2- 172.21.15.146:0/1031931503 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f590c0561e0 0x7f590c0586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:54.746 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.741+0000 7f5928ff9700 1 -- 172.21.15.146:0/1031931503 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f59200708e0 con 0x7f592c0692b0 2021-01-27T09:44:54.746 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.741+0000 7f592bfff700 1 --2- 172.21.15.146:0/1031931503 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f590c0561e0 0x7f590c0586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:54.746 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.741+0000 7f592bfff700 1 --2- 172.21.15.146:0/1031931503 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f590c0561e0 0x7f590c0586a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f592c13b3c0 tx=0x7f5918006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:54.751 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.749+0000 7f5928ff9700 1 -- 172.21.15.146:0/1031931503 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f5920045f90 con 0x7f592c0692b0 2021-01-27T09:44:54.922 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.921+0000 7f5933127700 1 -- 172.21.15.146:0/1031931503 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f592c0b8780 con 0x7f592c0692b0 2021-01-27T09:44:54.929 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.929+0000 7f5928ff9700 1 -- 172.21.15.146:0/1031931503 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+134202 (secure 0 0 0) 0x7f59200495b0 con 0x7f592c0692b0 2021-01-27T09:44:54.931 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:44:54.934 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.929+0000 7f5933127700 1 -- 172.21.15.146:0/1031931503 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f590c0561e0 msgr2=0x7f590c0586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:54.934 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.929+0000 7f5933127700 1 --2- 172.21.15.146:0/1031931503 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f590c0561e0 0x7f590c0586a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f592c13b3c0 tx=0x7f5918006e20).stop 2021-01-27T09:44:54.934 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.929+0000 7f5933127700 1 -- 172.21.15.146:0/1031931503 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f592c0692b0 msgr2=0x7f592c0beae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:54.934 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.929+0000 7f5933127700 1 --2- 172.21.15.146:0/1031931503 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f592c0692b0 0x7f592c0beae0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f59200093a0 tx=0x7f5920016000).stop 2021-01-27T09:44:54.936 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.929+0000 7f5933127700 1 -- 172.21.15.146:0/1031931503 shutdown_connections 2021-01-27T09:44:54.936 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.929+0000 7f5933127700 1 --2- 172.21.15.146:0/1031931503 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f590c0561e0 0x7f590c0586a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.937 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.929+0000 7f5933127700 1 --2- 172.21.15.146:0/1031931503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f592c0b8a20 0x7f592c0bc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.937 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.929+0000 7f5933127700 1 --2- 172.21.15.146:0/1031931503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f592c069690 0x7f592c1659d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.938 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.929+0000 7f5933127700 1 --2- 172.21.15.146:0/1031931503 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f592c0692b0 0x7f592c0beae0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:54.938 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.929+0000 7f5933127700 1 -- 172.21.15.146:0/1031931503 >> 172.21.15.146:0/1031931503 conn(0x7f592c067150 msgr2=0x7f592c14f390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:54.939 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.933+0000 7f5933127700 1 -- 172.21.15.146:0/1031931503 shutdown_connections 2021-01-27T09:44:54.939 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:54.933+0000 7f5933127700 1 -- 172.21.15.146:0/1031931503 wait complete. 2021-01-27T09:44:54.963 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":5,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":15486},{"type":"v1","addr":"172.21.15.78:6833","nonce":15486}]},"active_addr":"172.21.15.78:6833/15486","active_change":"2021-01-27T09:44:18.422853+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[{"gid":4106,"name":"y","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":247350387}]},{"addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":2687507956}]},{"addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":1905844903}]}]}} 2021-01-27T09:44:54.972 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2021-01-27T09:44:54.973 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2021-01-27T09:44:54.974 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-01-27T09:44:55.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.133+0000 7f535182d700 1 Processor -- start 2021-01-27T09:44:55.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.133+0000 7f535182d700 1 -- start start 2021-01-27T09:44:55.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.133+0000 7f535182d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f534c0692b0 0x7f534c0bcc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:55.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.133+0000 7f535182d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f534c14c1e0 0x7f534c0bd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:55.137 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.133+0000 7f535182d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f534c152ec0 con 0x7f534c069690 2021-01-27T09:44:55.137 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.133+0000 7f535182d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534c0be1b0 con 0x7f534c0692b0 2021-01-27T09:44:55.137 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.133+0000 7f535182d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c0be450 con 0x7f534c14c1e0 2021-01-27T09:44:55.138 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.133+0000 7f534bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f534c069690 0x7f534c14bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46220/0 (socket says 172.21.15.146:46220) 2021-01-27T09:44:55.138 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.133+0000 7f534bfff700 1 -- 172.21.15.146:0/1465458806 learned_addr learned my addr 172.21.15.146:0/1465458806 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:55.139 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.133+0000 7f535082b700 1 --2- 172.21.15.146:0/1465458806 >> v2:172.21.15.78:3300/0 conn(0x7f534c0692b0 0x7f534c0bcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:55.139 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.133+0000 7f535102c700 1 --2- 172.21.15.146:0/1465458806 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f534c14c1e0 0x7f534c0bd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:55.139 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.133+0000 7f534b7fe700 1 -- 172.21.15.146:0/1465458806 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153817301 0 0) 0x7f534c152ec0 con 0x7f534c069690 2021-01-27T09:44:55.139 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.133+0000 7f534b7fe700 1 -- 172.21.15.146:0/1465458806 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5330003270 con 0x7f534c069690 2021-01-27T09:44:55.140 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.137+0000 7f535082b700 1 -- 172.21.15.146:0/1465458806 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f534c14c1e0 msgr2=0x7f534c0bd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:55.140 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.137+0000 7f535082b700 1 --2- 172.21.15.146:0/1465458806 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f534c14c1e0 0x7f534c0bd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:55.140 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.137+0000 7f535082b700 1 -- 172.21.15.146:0/1465458806 >> v1:172.21.15.146:6789/0 conn(0x7f534c069690 legacy=0x7f534c14bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:55.140 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.137+0000 7f535082b700 1 -- 172.21.15.146:0/1465458806 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c0be6f0 con 0x7f534c0692b0 2021-01-27T09:44:55.140 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.137+0000 7f535082b700 1 --2- 172.21.15.146:0/1465458806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f534c0692b0 0x7f534c0bcc20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f534000b9c0 tx=0x7f5340006e20).ready entity=mon.0 client_cookie=9dd4f419987b934 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:55.142 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.137+0000 7f534b7fe700 1 -- 172.21.15.146:0/1465458806 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340009600 con 0x7f534c0692b0 2021-01-27T09:44:55.142 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.137+0000 7f534b7fe700 1 -- 172.21.15.146:0/1465458806 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5340009760 con 0x7f534c0692b0 2021-01-27T09:44:55.142 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.137+0000 7f534b7fe700 1 -- 172.21.15.146:0/1465458806 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340009ae0 con 0x7f534c0692b0 2021-01-27T09:44:55.142 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.137+0000 7f535182d700 1 -- 172.21.15.146:0/1465458806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f534c0692b0 msgr2=0x7f534c0bcc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:55.143 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.137+0000 7f535182d700 1 --2- 172.21.15.146:0/1465458806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f534c0692b0 0x7f534c0bcc20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f534000b9c0 tx=0x7f5340006e20).stop 2021-01-27T09:44:55.143 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.137+0000 7f535182d700 1 -- 172.21.15.146:0/1465458806 shutdown_connections 2021-01-27T09:44:55.143 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.137+0000 7f535182d700 1 --2- 172.21.15.146:0/1465458806 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f534c14c1e0 0x7f534c0bd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:55.143 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.137+0000 7f535182d700 1 --2- 172.21.15.146:0/1465458806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f534c0692b0 0x7f534c0bcc20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:55.143 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.137+0000 7f535182d700 1 -- 172.21.15.146:0/1465458806 >> 172.21.15.146:0/1465458806 conn(0x7f534c064240 msgr2=0x7f534c0601f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:55.144 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.137+0000 7f535182d700 1 -- 172.21.15.146:0/1465458806 shutdown_connections 2021-01-27T09:44:55.144 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.137+0000 7f535182d700 1 -- 172.21.15.146:0/1465458806 wait complete. 2021-01-27T09:44:55.144 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.141+0000 7f535182d700 1 Processor -- start 2021-01-27T09:44:55.146 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.141+0000 7f535182d700 1 -- start start 2021-01-27T09:44:55.146 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.141+0000 7f535182d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f534c0692b0 0x7f534c150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:55.146 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.141+0000 7f535182d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f534c069690 0x7f534c145050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:55.147 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.141+0000 7f535182d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f534c14c1e0 0x7f534c0bac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:55.147 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.141+0000 7f535182d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c152660 con 0x7f534c069690 2021-01-27T09:44:55.147 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.141+0000 7f535182d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c155850 con 0x7f534c14c1e0 2021-01-27T09:44:55.147 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.141+0000 7f535182d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c152890 con 0x7f534c0692b0 2021-01-27T09:44:55.147 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.141+0000 7f535082b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f534c0692b0 0x7f534c150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:55.148 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.141+0000 7f535082b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f534c0692b0 0x7f534c150780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36140/0 (socket says 172.21.15.146:36140) 2021-01-27T09:44:55.148 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.141+0000 7f535082b700 1 -- 172.21.15.146:0/3731353267 learned_addr learned my addr 172.21.15.146:0/3731353267 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:55.148 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.141+0000 7f535102c700 1 --2- 172.21.15.146:0/3731353267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f534c14c1e0 0x7f534c0bac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:55.148 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.141+0000 7f534bfff700 1 --2- 172.21.15.146:0/3731353267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f534c069690 0x7f534c145050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:55.149 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.141+0000 7f535102c700 1 -- 172.21.15.146:0/3731353267 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f534c0692b0 msgr2=0x7f534c150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:55.149 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.141+0000 7f535102c700 1 --2- 172.21.15.146:0/3731353267 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f534c0692b0 0x7f534c150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:55.149 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.141+0000 7f535102c700 1 -- 172.21.15.146:0/3731353267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f534c069690 msgr2=0x7f534c145050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:55.149 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.141+0000 7f535102c700 1 --2- 172.21.15.146:0/3731353267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f534c069690 0x7f534c145050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:55.149 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.141+0000 7f535102c700 1 -- 172.21.15.146:0/3731353267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c152b30 con 0x7f534c14c1e0 2021-01-27T09:44:55.150 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.141+0000 7f535102c700 1 --2- 172.21.15.146:0/3731353267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f534c14c1e0 0x7f534c0bac50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f534400ebd0 tx=0x7f5344009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:55.150 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.141+0000 7f5348ff9700 1 -- 172.21.15.146:0/3731353267 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534400c920 con 0x7f534c14c1e0 2021-01-27T09:44:55.150 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.141+0000 7f5348ff9700 1 -- 172.21.15.146:0/3731353267 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534400ca80 con 0x7f534c14c1e0 2021-01-27T09:44:55.150 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.141+0000 7f535182d700 1 -- 172.21.15.146:0/3731353267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534c155070 con 0x7f534c14c1e0 2021-01-27T09:44:55.150 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.145+0000 7f5348ff9700 1 -- 172.21.15.146:0/3731353267 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534400ce20 con 0x7f534c14c1e0 2021-01-27T09:44:55.151 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.145+0000 7f535182d700 1 -- 172.21.15.146:0/3731353267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534c1555b0 con 0x7f534c14c1e0 2021-01-27T09:44:55.152 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.145+0000 7f535182d700 1 -- 172.21.15.146:0/3731353267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534c063d90 con 0x7f534c14c1e0 2021-01-27T09:44:55.152 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.145+0000 7f5348ff9700 1 -- 172.21.15.146:0/3731353267 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f5344022070 con 0x7f534c14c1e0 2021-01-27T09:44:55.152 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.149+0000 7f5348ff9700 1 --2- 172.21.15.146:0/3731353267 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f532c056210 0x7f532c0586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:55.152 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.149+0000 7f5348ff9700 1 -- 172.21.15.146:0/3731353267 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f534406fa10 con 0x7f534c14c1e0 2021-01-27T09:44:55.152 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.149+0000 7f535082b700 1 --2- 172.21.15.146:0/3731353267 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f532c056210 0x7f532c0586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:55.153 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.149+0000 7f535082b700 1 --2- 172.21.15.146:0/3731353267 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f532c056210 0x7f532c0586d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f5340009fd0 tx=0x7f5340016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:55.155 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.153+0000 7f5348ff9700 1 -- 172.21.15.146:0/3731353267 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f53440450c0 con 0x7f534c14c1e0 2021-01-27T09:44:55.294 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.293+0000 7f535182d700 1 -- 172.21.15.146:0/3731353267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f534c152440 con 0x7f534c14c1e0 2021-01-27T09:44:55.296 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.293+0000 7f5348ff9700 1 -- 172.21.15.146:0/3731353267 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18638 (secure 0 0 0) 0x7f5344016070 con 0x7f534c14c1e0 2021-01-27T09:44:55.297 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:44:55.297 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":26,"fsid":"968a1bec-aac5-444e-b70f-7770587be945","created":"2021-01-27T09:44:13.797940+0000","modified":"2021-01-27T09:44:33.763400+0000","last_up_change":"2021-01-27T09:44:23.479967+0000","last_in_change":"2021-01-27T09:44:23.479967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T09:44:18.497521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-27T09:44:24.550303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-27T09:44:27.607542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-27T09:44:28.331389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-01-27T09:44:31.378452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25441909-a40b-4d82-828d-326685513ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":14470},{"type":"v1","addr":"172.21.15.146:6801","nonce":14470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":14470},{"type":"v1","addr":"172.21.15.146:6803","nonce":14470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":14470},{"type":"v1","addr":"172.21.15.146:6810","nonce":14470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":14470},{"type":"v1","addr":"172.21.15.146:6807","nonce":14470}]},"public_addr":"172.21.15.146:6801/14470","cluster_addr":"172.21.15.146:6803/14470","heartbeat_back_addr":"172.21.15.146:6810/14470","heartbeat_front_addr":"172.21.15.146:6807/14470","state":["exists","up"]},{"osd":1,"uuid":"825bbc51-2ffe-4612-a300-00960e48be02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":14472},{"type":"v1","addr":"172.21.15.146:6817","nonce":14472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":14472},{"type":"v1","addr":"172.21.15.146:6819","nonce":14472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":14472},{"type":"v1","addr":"172.21.15.146:6827","nonce":14472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":14472},{"type":"v1","addr":"172.21.15.146:6823","nonce":14472}]},"public_addr":"172.21.15.146:6817/14472","cluster_addr":"172.21.15.146:6819/14472","heartbeat_back_addr":"172.21.15.146:6827/14472","heartbeat_front_addr":"172.21.15.146:6823/14472","state":["exists","up"]},{"osd":2,"uuid":"e568b97a-8e71-4ab9-bd64-056892110b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":14474},{"type":"v1","addr":"172.21.15.146:6822","nonce":14474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":14474},{"type":"v1","addr":"172.21.15.146:6826","nonce":14474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":14474},{"type":"v1","addr":"172.21.15.146:6831","nonce":14474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":14474},{"type":"v1","addr":"172.21.15.146:6829","nonce":14474}]},"public_addr":"172.21.15.146:6822/14474","cluster_addr":"172.21.15.146:6826/14474","heartbeat_back_addr":"172.21.15.146:6831/14474","heartbeat_front_addr":"172.21.15.146:6829/14474","state":["exists","up"]},{"osd":3,"uuid":"f5d50f63-f74a-4aea-a62d-51c38db4d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":14471},{"type":"v1","addr":"172.21.15.146:6806","nonce":14471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":14471},{"type":"v1","addr":"172.21.15.146:6811","nonce":14471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":14471},{"type":"v1","addr":"172.21.15.146:6815","nonce":14471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":14471},{"type":"v1","addr":"172.21.15.146:6813","nonce":14471}]},"public_addr":"172.21.15.146:6806/14471","cluster_addr":"172.21.15.146:6811/14471","heartbeat_back_addr":"172.21.15.146:6815/14471","heartbeat_front_addr":"172.21.15.146:6813/14471","state":["exists","up"]},{"osd":4,"uuid":"782458d7-6f52-48f4-9466-67b61ef27016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":15826},{"type":"v1","addr":"172.21.15.78:6817","nonce":15826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":15826},{"type":"v1","addr":"172.21.15.78:6819","nonce":15826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":15826},{"type":"v1","addr":"172.21.15.78:6823","nonce":15826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":15826},{"type":"v1","addr":"172.21.15.78:6821","nonce":15826}]},"public_addr":"172.21.15.78:6817/15826","cluster_addr":"172.21.15.78:6819/15826","heartbeat_back_addr":"172.21.15.78:6823/15826","heartbeat_front_addr":"172.21.15.78:6821/15826","state":["exists","up"]},{"osd":5,"uuid":"1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":15827},{"type":"v1","addr":"172.21.15.78:6801","nonce":15827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":15827},{"type":"v1","addr":"172.21.15.78:6803","nonce":15827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":15827},{"type":"v1","addr":"172.21.15.78:6807","nonce":15827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":15827},{"type":"v1","addr":"172.21.15.78:6805","nonce":15827}]},"public_addr":"172.21.15.78:6801/15827","cluster_addr":"172.21.15.78:6803/15827","heartbeat_back_addr":"172.21.15.78:6807/15827","heartbeat_front_addr":"172.21.15.78:6805/15827","state":["exists","up"]},{"osd":6,"uuid":"4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":15825},{"type":"v1","addr":"172.21.15.78:6809","nonce":15825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":15825},{"type":"v1","addr":"172.21.15.78:6811","nonce":15825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":15825},{"type":"v1","addr":"172.21.15.78:6815","nonce":15825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":15825},{"type":"v1","addr":"172.21.15.78:6813","nonce":15825}]},"public_addr":"172.21.15.78:6809/15825","cluster_addr":"172.21.15.78:6811/15825","heartbeat_back_addr":"172.21.15.78:6815/15825","heartbeat_front_addr":"172.21.15.78:6813/15825","state":["exists","up"]},{"osd":7,"uuid":"851aeaf3-bcdc-4ac6-b578-c42e1bf87c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":15828},{"type":"v1","addr":"172.21.15.78:6825","nonce":15828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":15828},{"type":"v1","addr":"172.21.15.78:6827","nonce":15828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":15828},{"type":"v1","addr":"172.21.15.78:6831","nonce":15828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":15828},{"type":"v1","addr":"172.21.15.78:6829","nonce":15828}]},"public_addr":"172.21.15.78:6825/15828","cluster_addr":"172.21.15.78:6827/15828","heartbeat_back_addr":"172.21.15.78:6831/15828","heartbeat_front_addr":"172.21.15.78:6829/15828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.573930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.718144+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.641838+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.551598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.374444+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.171108+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.360910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.356020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:44:55.298 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.297+0000 7f535182d700 1 -- 172.21.15.146:0/3731353267 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f532c056210 msgr2=0x7f532c0586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:55.299 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.297+0000 7f535182d700 1 --2- 172.21.15.146:0/3731353267 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f532c056210 0x7f532c0586d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f5340009fd0 tx=0x7f5340016000).stop 2021-01-27T09:44:55.299 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.297+0000 7f535182d700 1 -- 172.21.15.146:0/3731353267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f534c14c1e0 msgr2=0x7f534c0bac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:55.299 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.297+0000 7f535182d700 1 --2- 172.21.15.146:0/3731353267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f534c14c1e0 0x7f534c0bac50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f534400ebd0 tx=0x7f5344009220).stop 2021-01-27T09:44:55.300 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.297+0000 7f535182d700 1 -- 172.21.15.146:0/3731353267 shutdown_connections 2021-01-27T09:44:55.300 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.297+0000 7f535182d700 1 --2- 172.21.15.146:0/3731353267 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f532c056210 0x7f532c0586d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:55.300 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.297+0000 7f535182d700 1 --2- 172.21.15.146:0/3731353267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f534c14c1e0 0x7f534c0bac50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:55.300 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.297+0000 7f535182d700 1 --2- 172.21.15.146:0/3731353267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f534c069690 0x7f534c145050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:55.301 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.297+0000 7f535182d700 1 --2- 172.21.15.146:0/3731353267 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f534c0692b0 0x7f534c150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:55.301 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.297+0000 7f535182d700 1 -- 172.21.15.146:0/3731353267 >> 172.21.15.146:0/3731353267 conn(0x7f534c064240 msgr2=0x7f534c146f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:55.301 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.297+0000 7f535182d700 1 -- 172.21.15.146:0/3731353267 shutdown_connections 2021-01-27T09:44:55.302 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.297+0000 7f535182d700 1 -- 172.21.15.146:0/3731353267 wait complete. 2021-01-27T09:44:55.326 INFO:tasks.ceph.ceph_manager.ceph:all up! 2021-01-27T09:44:55.327 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-01-27T09:44:55.495 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.493+0000 7fcf368f0700 1 Processor -- start 2021-01-27T09:44:55.496 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.493+0000 7fcf368f0700 1 -- start start 2021-01-27T09:44:55.497 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.493+0000 7fcf368f0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcf300b9a90 0x7fcf300be0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:55.497 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.493+0000 7fcf368f0700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcf300b9e70 0x7fcf300be5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:55.497 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.493+0000 7fcf368f0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf300698b0 con 0x7fcf300bcf70 2021-01-27T09:44:55.497 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.493+0000 7fcf368f0700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3014bc80 con 0x7fcf300b9a90 2021-01-27T09:44:55.498 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.493+0000 7fcf368f0700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300beab0 con 0x7fcf300b9e70 2021-01-27T09:44:55.499 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.493+0000 7fcf2ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcf300b9a90 0x7fcf300be0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:55.499 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.493+0000 7fcf2ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcf300b9a90 0x7fcf300be0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:49538/0 (socket says 172.21.15.146:49538) 2021-01-27T09:44:55.499 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.493+0000 7fcf2ffff700 1 -- 172.21.15.146:0/547107610 learned_addr learned my addr 172.21.15.146:0/547107610 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:55.499 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.493+0000 7fcf2f7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcf300b9e70 0x7fcf300be5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:55.500 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.497+0000 7fcf2ffff700 1 -- 172.21.15.146:0/547107610 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcf300b9e70 msgr2=0x7fcf300be5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:55.500 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.497+0000 7fcf2ffff700 1 --2- 172.21.15.146:0/547107610 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcf300b9e70 0x7fcf300be5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:55.500 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.497+0000 7fcf2effd700 1 -- 172.21.15.146:0/547107610 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923391770 0 0) 0x7fcf300698b0 con 0x7fcf300bcf70 2021-01-27T09:44:55.500 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.497+0000 7fcf2ffff700 1 -- 172.21.15.146:0/547107610 >> v1:172.21.15.146:6789/0 conn(0x7fcf300bcf70 legacy=0x7fcf300bd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:55.501 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.497+0000 7fcf2ffff700 1 -- 172.21.15.146:0/547107610 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3014be70 con 0x7fcf300b9a90 2021-01-27T09:44:55.501 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.497+0000 7fcf2f7fe700 1 --2- 172.21.15.146:0/547107610 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcf300b9e70 0x7fcf300be5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:55.502 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.497+0000 7fcf2ffff700 1 --2- 172.21.15.146:0/547107610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf300b9a90 0x7fcf300be0d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fcf2000ba50 tx=0x7fcf20006ee0).ready entity=mon.0 client_cookie=52d913a507ce7846 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:55.502 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.497+0000 7fcf2effd700 1 -- 172.21.15.146:0/547107610 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20009890 con 0x7fcf300b9a90 2021-01-27T09:44:55.502 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.497+0000 7fcf2effd700 1 -- 172.21.15.146:0/547107610 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf200099f0 con 0x7fcf300b9a90 2021-01-27T09:44:55.503 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.497+0000 7fcf2effd700 1 -- 172.21.15.146:0/547107610 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20009d70 con 0x7fcf300b9a90 2021-01-27T09:44:55.503 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.497+0000 7fcf368f0700 1 -- 172.21.15.146:0/547107610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf300b9a90 msgr2=0x7fcf300be0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:55.503 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.497+0000 7fcf368f0700 1 --2- 172.21.15.146:0/547107610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf300b9a90 0x7fcf300be0d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fcf2000ba50 tx=0x7fcf20006ee0).stop 2021-01-27T09:44:55.504 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.497+0000 7fcf368f0700 1 -- 172.21.15.146:0/547107610 shutdown_connections 2021-01-27T09:44:55.504 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.497+0000 7fcf368f0700 1 --2- 172.21.15.146:0/547107610 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcf300b9e70 0x7fcf300be5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:55.504 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.497+0000 7fcf368f0700 1 --2- 172.21.15.146:0/547107610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf300b9a90 0x7fcf300be0d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:55.505 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.497+0000 7fcf368f0700 1 -- 172.21.15.146:0/547107610 >> 172.21.15.146:0/547107610 conn(0x7fcf30069110 msgr2=0x7fcf30067e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:55.505 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.497+0000 7fcf368f0700 1 -- 172.21.15.146:0/547107610 shutdown_connections 2021-01-27T09:44:55.505 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.497+0000 7fcf368f0700 1 -- 172.21.15.146:0/547107610 wait complete. 2021-01-27T09:44:55.506 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.501+0000 7fcf368f0700 1 Processor -- start 2021-01-27T09:44:55.506 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.501+0000 7fcf368f0700 1 -- start start 2021-01-27T09:44:55.507 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.501+0000 7fcf368f0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf300b9a90 0x7fcf301511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:55.507 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.501+0000 7fcf368f0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf300b9e70 0x7fcf3015f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:55.507 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.501+0000 7fcf368f0700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcf300bcf70 0x7fcf3012c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:55.507 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.501+0000 7fcf368f0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf30151750 con 0x7fcf300b9e70 2021-01-27T09:44:55.508 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.501+0000 7fcf368f0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf301519f0 con 0x7fcf300b9a90 2021-01-27T09:44:55.508 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.501+0000 7fcf368f0700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf30151c90 con 0x7fcf300bcf70 2021-01-27T09:44:55.508 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.505+0000 7fcf2f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf300b9e70 0x7fcf3015f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:55.508 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.505+0000 7fcf2f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf300b9e70 0x7fcf3015f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:49542/0 (socket says 172.21.15.146:49542) 2021-01-27T09:44:55.509 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.505+0000 7fcf2f7fe700 1 -- 172.21.15.146:0/753616605 learned_addr learned my addr 172.21.15.146:0/753616605 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:55.509 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.505+0000 7fcf34e8d700 1 --2- 172.21.15.146:0/753616605 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcf300bcf70 0x7fcf3012c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:55.509 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.505+0000 7fcf2ffff700 1 --2- 172.21.15.146:0/753616605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf300b9a90 0x7fcf301511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:55.510 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.505+0000 7fcf2f7fe700 1 -- 172.21.15.146:0/753616605 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcf300bcf70 msgr2=0x7fcf3012c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:55.511 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.505+0000 7fcf2f7fe700 1 --2- 172.21.15.146:0/753616605 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcf300bcf70 0x7fcf3012c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:55.511 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.505+0000 7fcf2f7fe700 1 -- 172.21.15.146:0/753616605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf300b9a90 msgr2=0x7fcf301511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:55.511 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.505+0000 7fcf2f7fe700 1 --2- 172.21.15.146:0/753616605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf300b9a90 0x7fcf301511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:55.511 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.505+0000 7fcf2f7fe700 1 -- 172.21.15.146:0/753616605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3015e900 con 0x7fcf300b9e70 2021-01-27T09:44:55.512 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.505+0000 7fcf2ffff700 1 --2- 172.21.15.146:0/753616605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf300b9a90 0x7fcf301511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:55.512 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.505+0000 7fcf2f7fe700 1 --2- 172.21.15.146:0/753616605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf300b9e70 0x7fcf3015f040 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fcf2400ef20 tx=0x7fcf24006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:55.512 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.505+0000 7fcf17fff700 1 -- 172.21.15.146:0/753616605 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2400cbc0 con 0x7fcf300b9e70 2021-01-27T09:44:55.512 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.505+0000 7fcf17fff700 1 -- 172.21.15.146:0/753616605 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2400cd20 con 0x7fcf300b9e70 2021-01-27T09:44:55.512 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.505+0000 7fcf368f0700 1 -- 172.21.15.146:0/753616605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3015eba0 con 0x7fcf300b9e70 2021-01-27T09:44:55.513 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.505+0000 7fcf17fff700 1 -- 172.21.15.146:0/753616605 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf24012600 con 0x7fcf300b9e70 2021-01-27T09:44:55.513 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.505+0000 7fcf368f0700 1 -- 172.21.15.146:0/753616605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3015f530 con 0x7fcf300b9e70 2021-01-27T09:44:55.513 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.505+0000 7fcf368f0700 1 -- 172.21.15.146:0/753616605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf30151e50 con 0x7fcf300b9e70 2021-01-27T09:44:55.514 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.509+0000 7fcf17fff700 1 -- 172.21.15.146:0/753616605 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fcf24012970 con 0x7fcf300b9e70 2021-01-27T09:44:55.514 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.509+0000 7fcf17fff700 1 --2- 172.21.15.146:0/753616605 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcf10056210 0x7fcf100586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:55.514 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.509+0000 7fcf17fff700 1 -- 172.21.15.146:0/753616605 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fcf2406fe50 con 0x7fcf300b9e70 2021-01-27T09:44:55.514 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.509+0000 7fcf2ffff700 1 --2- 172.21.15.146:0/753616605 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcf10056210 0x7fcf100586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:55.515 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.513+0000 7fcf2ffff700 1 --2- 172.21.15.146:0/753616605 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcf10056210 0x7fcf100586d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fcf20006f20 tx=0x7fcf20016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:55.522 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.521+0000 7fcf17fff700 1 -- 172.21.15.146:0/753616605 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fcf24045470 con 0x7fcf300b9e70 2021-01-27T09:44:55.667 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.665+0000 7fcf368f0700 1 -- 172.21.15.146:0/753616605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf30044ee0 con 0x7fcf300b9e70 2021-01-27T09:44:55.670 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.665+0000 7fcf17fff700 1 -- 172.21.15.146:0/753616605 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18638 (secure 0 0 0) 0x7fcf24048a90 con 0x7fcf300b9e70 2021-01-27T09:44:55.670 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:44:55.671 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":26,"fsid":"968a1bec-aac5-444e-b70f-7770587be945","created":"2021-01-27T09:44:13.797940+0000","modified":"2021-01-27T09:44:33.763400+0000","last_up_change":"2021-01-27T09:44:23.479967+0000","last_in_change":"2021-01-27T09:44:23.479967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T09:44:18.497521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-27T09:44:24.550303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-27T09:44:27.607542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-27T09:44:28.331389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-01-27T09:44:31.378452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25441909-a40b-4d82-828d-326685513ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":14470},{"type":"v1","addr":"172.21.15.146:6801","nonce":14470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":14470},{"type":"v1","addr":"172.21.15.146:6803","nonce":14470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":14470},{"type":"v1","addr":"172.21.15.146:6810","nonce":14470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":14470},{"type":"v1","addr":"172.21.15.146:6807","nonce":14470}]},"public_addr":"172.21.15.146:6801/14470","cluster_addr":"172.21.15.146:6803/14470","heartbeat_back_addr":"172.21.15.146:6810/14470","heartbeat_front_addr":"172.21.15.146:6807/14470","state":["exists","up"]},{"osd":1,"uuid":"825bbc51-2ffe-4612-a300-00960e48be02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":14472},{"type":"v1","addr":"172.21.15.146:6817","nonce":14472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":14472},{"type":"v1","addr":"172.21.15.146:6819","nonce":14472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":14472},{"type":"v1","addr":"172.21.15.146:6827","nonce":14472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":14472},{"type":"v1","addr":"172.21.15.146:6823","nonce":14472}]},"public_addr":"172.21.15.146:6817/14472","cluster_addr":"172.21.15.146:6819/14472","heartbeat_back_addr":"172.21.15.146:6827/14472","heartbeat_front_addr":"172.21.15.146:6823/14472","state":["exists","up"]},{"osd":2,"uuid":"e568b97a-8e71-4ab9-bd64-056892110b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":14474},{"type":"v1","addr":"172.21.15.146:6822","nonce":14474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":14474},{"type":"v1","addr":"172.21.15.146:6826","nonce":14474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":14474},{"type":"v1","addr":"172.21.15.146:6831","nonce":14474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":14474},{"type":"v1","addr":"172.21.15.146:6829","nonce":14474}]},"public_addr":"172.21.15.146:6822/14474","cluster_addr":"172.21.15.146:6826/14474","heartbeat_back_addr":"172.21.15.146:6831/14474","heartbeat_front_addr":"172.21.15.146:6829/14474","state":["exists","up"]},{"osd":3,"uuid":"f5d50f63-f74a-4aea-a62d-51c38db4d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":14471},{"type":"v1","addr":"172.21.15.146:6806","nonce":14471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":14471},{"type":"v1","addr":"172.21.15.146:6811","nonce":14471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":14471},{"type":"v1","addr":"172.21.15.146:6815","nonce":14471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":14471},{"type":"v1","addr":"172.21.15.146:6813","nonce":14471}]},"public_addr":"172.21.15.146:6806/14471","cluster_addr":"172.21.15.146:6811/14471","heartbeat_back_addr":"172.21.15.146:6815/14471","heartbeat_front_addr":"172.21.15.146:6813/14471","state":["exists","up"]},{"osd":4,"uuid":"782458d7-6f52-48f4-9466-67b61ef27016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":15826},{"type":"v1","addr":"172.21.15.78:6817","nonce":15826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":15826},{"type":"v1","addr":"172.21.15.78:6819","nonce":15826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":15826},{"type":"v1","addr":"172.21.15.78:6823","nonce":15826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":15826},{"type":"v1","addr":"172.21.15.78:6821","nonce":15826}]},"public_addr":"172.21.15.78:6817/15826","cluster_addr":"172.21.15.78:6819/15826","heartbeat_back_addr":"172.21.15.78:6823/15826","heartbeat_front_addr":"172.21.15.78:6821/15826","state":["exists","up"]},{"osd":5,"uuid":"1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":15827},{"type":"v1","addr":"172.21.15.78:6801","nonce":15827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":15827},{"type":"v1","addr":"172.21.15.78:6803","nonce":15827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":15827},{"type":"v1","addr":"172.21.15.78:6807","nonce":15827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":15827},{"type":"v1","addr":"172.21.15.78:6805","nonce":15827}]},"public_addr":"172.21.15.78:6801/15827","cluster_addr":"172.21.15.78:6803/15827","heartbeat_back_addr":"172.21.15.78:6807/15827","heartbeat_front_addr":"172.21.15.78:6805/15827","state":["exists","up"]},{"osd":6,"uuid":"4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":15825},{"type":"v1","addr":"172.21.15.78:6809","nonce":15825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":15825},{"type":"v1","addr":"172.21.15.78:6811","nonce":15825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":15825},{"type":"v1","addr":"172.21.15.78:6815","nonce":15825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":15825},{"type":"v1","addr":"172.21.15.78:6813","nonce":15825}]},"public_addr":"172.21.15.78:6809/15825","cluster_addr":"172.21.15.78:6811/15825","heartbeat_back_addr":"172.21.15.78:6815/15825","heartbeat_front_addr":"172.21.15.78:6813/15825","state":["exists","up"]},{"osd":7,"uuid":"851aeaf3-bcdc-4ac6-b578-c42e1bf87c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":15828},{"type":"v1","addr":"172.21.15.78:6825","nonce":15828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":15828},{"type":"v1","addr":"172.21.15.78:6827","nonce":15828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":15828},{"type":"v1","addr":"172.21.15.78:6831","nonce":15828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":15828},{"type":"v1","addr":"172.21.15.78:6829","nonce":15828}]},"public_addr":"172.21.15.78:6825/15828","cluster_addr":"172.21.15.78:6827/15828","heartbeat_back_addr":"172.21.15.78:6831/15828","heartbeat_front_addr":"172.21.15.78:6829/15828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.573930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.718144+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.641838+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.551598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.374444+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.171108+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.360910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.356020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:44:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.669+0000 7fcf368f0700 1 -- 172.21.15.146:0/753616605 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcf10056210 msgr2=0x7fcf100586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.669+0000 7fcf368f0700 1 --2- 172.21.15.146:0/753616605 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcf10056210 0x7fcf100586d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fcf20006f20 tx=0x7fcf20016000).stop 2021-01-27T09:44:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.669+0000 7fcf368f0700 1 -- 172.21.15.146:0/753616605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf300b9e70 msgr2=0x7fcf3015f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.669+0000 7fcf368f0700 1 --2- 172.21.15.146:0/753616605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf300b9e70 0x7fcf3015f040 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fcf2400ef20 tx=0x7fcf24006e20).stop 2021-01-27T09:44:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.673+0000 7fcf368f0700 1 -- 172.21.15.146:0/753616605 shutdown_connections 2021-01-27T09:44:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.673+0000 7fcf368f0700 1 --2- 172.21.15.146:0/753616605 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcf300bcf70 0x7fcf3012c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.673+0000 7fcf368f0700 1 --2- 172.21.15.146:0/753616605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf300b9e70 0x7fcf3015f040 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:55.676 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.673+0000 7fcf368f0700 1 --2- 172.21.15.146:0/753616605 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcf10056210 0x7fcf100586d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:55.676 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.673+0000 7fcf368f0700 1 --2- 172.21.15.146:0/753616605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf300b9a90 0x7fcf301511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:55.676 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.673+0000 7fcf368f0700 1 -- 172.21.15.146:0/753616605 >> 172.21.15.146:0/753616605 conn(0x7fcf30069110 msgr2=0x7fcf300b66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:55.676 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.673+0000 7fcf368f0700 1 -- 172.21.15.146:0/753616605 shutdown_connections 2021-01-27T09:44:55.677 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.673+0000 7fcf368f0700 1 -- 172.21.15.146:0/753616605 wait complete. 2021-01-27T09:44:55.702 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2021-01-27T09:44:55.862 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.857+0000 7f248f183700 1 Processor -- start 2021-01-27T09:44:55.862 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.857+0000 7f248f183700 1 -- start start 2021-01-27T09:44:55.863 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.861+0000 7f248f183700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24880b9850 0x7f248814c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.861+0000 7f248f183700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24880b86e0 con 0x7f24880ba840 2021-01-27T09:44:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.861+0000 7f248f183700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24880b8980 con 0x7f24880ba460 2021-01-27T09:44:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.861+0000 7f248f183700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248814bbc0 con 0x7f24880b9850 2021-01-27T09:44:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.861+0000 7f248e181700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f24880ba460 0x7f2488063880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46250/0 (socket says 172.21.15.146:46250) 2021-01-27T09:44:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.861+0000 7f248d980700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f24880ba840 0x7f2488062c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:34282/0 (socket says 172.21.15.146:34282) 2021-01-27T09:44:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.861+0000 7f248d980700 1 -- 172.21.15.146:0/1704679163 learned_addr learned my addr 172.21.15.146:0/1704679163 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:55.866 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.861+0000 7f248e982700 1 --2- 172.21.15.146:0/1704679163 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24880b9850 0x7f248814c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:55.867 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.861+0000 7f248d17f700 1 -- 172.21.15.146:0/1704679163 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936569220 0 0) 0x7f24880b86e0 con 0x7f24880ba840 2021-01-27T09:44:55.867 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.861+0000 7f248d17f700 1 -- 172.21.15.146:0/1704679163 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2470003270 con 0x7f24880ba840 2021-01-27T09:44:55.867 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.861+0000 7f248e982700 1 -- 172.21.15.146:0/1704679163 >> v1:172.21.15.146:6789/0 conn(0x7f24880ba460 legacy=0x7f2488063880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:55.867 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.861+0000 7f248e982700 1 -- 172.21.15.146:0/1704679163 >> v1:172.21.15.78:6789/0 conn(0x7f24880ba840 legacy=0x7f2488062c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:55.867 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.861+0000 7f248e982700 1 -- 172.21.15.146:0/1704679163 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248814bdb0 con 0x7f24880b9850 2021-01-27T09:44:55.868 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.865+0000 7f248e982700 1 --2- 172.21.15.146:0/1704679163 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24880b9850 0x7f248814c790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2480009cf0 tx=0x7f2480009220).ready entity=mon.2 client_cookie=479d8c3b524e0a1c server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:55.868 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.865+0000 7f248d17f700 1 -- 172.21.15.146:0/1704679163 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248000bad0 con 0x7f24880b9850 2021-01-27T09:44:55.868 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.865+0000 7f248d17f700 1 -- 172.21.15.146:0/1704679163 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248000bc30 con 0x7f24880b9850 2021-01-27T09:44:55.868 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.865+0000 7f248d17f700 1 -- 172.21.15.146:0/1704679163 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2480011400 con 0x7f24880b9850 2021-01-27T09:44:55.869 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.865+0000 7f248f183700 1 -- 172.21.15.146:0/1704679163 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24880b9850 msgr2=0x7f248814c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:55.869 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.865+0000 7f248f183700 1 --2- 172.21.15.146:0/1704679163 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24880b9850 0x7f248814c790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2480009cf0 tx=0x7f2480009220).stop 2021-01-27T09:44:55.870 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.865+0000 7f248f183700 1 -- 172.21.15.146:0/1704679163 shutdown_connections 2021-01-27T09:44:55.870 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.865+0000 7f248f183700 1 --2- 172.21.15.146:0/1704679163 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24880b9850 0x7f248814c790 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:55.870 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.865+0000 7f248f183700 1 -- 172.21.15.146:0/1704679163 >> 172.21.15.146:0/1704679163 conn(0x7f2488067e60 msgr2=0x7f2488064240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:55.870 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.865+0000 7f248f183700 1 -- 172.21.15.146:0/1704679163 shutdown_connections 2021-01-27T09:44:55.871 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.865+0000 7f248f183700 1 -- 172.21.15.146:0/1704679163 wait complete. 2021-01-27T09:44:55.871 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.869+0000 7f248f183700 1 Processor -- start 2021-01-27T09:44:55.872 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.869+0000 7f248f183700 1 -- start start 2021-01-27T09:44:55.873 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.869+0000 7f248f183700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24880b9850 0x7f24880a0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:55.874 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.869+0000 7f248f183700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24880ba460 0x7f248815ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:55.874 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.869+0000 7f248f183700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24880ba840 0x7f24880be2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:55.874 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.869+0000 7f248f183700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24880a02c0 con 0x7f24880ba460 2021-01-27T09:44:55.874 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.869+0000 7f248f183700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248815bf50 con 0x7f24880b9850 2021-01-27T09:44:55.874 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.869+0000 7f248f183700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24880bc5a0 con 0x7f24880ba840 2021-01-27T09:44:55.875 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.869+0000 7f248e181700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24880b9850 0x7f24880a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:55.875 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.869+0000 7f248e181700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24880b9850 0x7f24880a0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46690/0 (socket says 172.21.15.146:46690) 2021-01-27T09:44:55.875 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.869+0000 7f248e181700 1 -- 172.21.15.146:0/3477420397 learned_addr learned my addr 172.21.15.146:0/3477420397 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:55.875 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.869+0000 7f248e982700 1 --2- 172.21.15.146:0/3477420397 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24880ba840 0x7f24880be2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:55.877 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.873+0000 7f248d980700 1 --2- 172.21.15.146:0/3477420397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24880ba460 0x7f248815ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:55.877 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.873+0000 7f248e181700 1 -- 172.21.15.146:0/3477420397 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24880ba840 msgr2=0x7f24880be2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:55.877 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.873+0000 7f248e181700 1 --2- 172.21.15.146:0/3477420397 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24880ba840 0x7f24880be2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:55.877 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.873+0000 7f248e181700 1 -- 172.21.15.146:0/3477420397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24880ba460 msgr2=0x7f248815ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:55.878 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.873+0000 7f248e181700 1 --2- 172.21.15.146:0/3477420397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24880ba460 0x7f248815ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:55.878 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.873+0000 7f248e181700 1 -- 172.21.15.146:0/3477420397 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248809e840 con 0x7f24880b9850 2021-01-27T09:44:55.878 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.873+0000 7f248e181700 1 --2- 172.21.15.146:0/3477420397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24880b9850 0x7f24880a0720 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f248400c710 tx=0x7f2484007c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:55.878 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.873+0000 7f24767fc700 1 -- 172.21.15.146:0/3477420397 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24840072e0 con 0x7f24880b9850 2021-01-27T09:44:55.879 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.873+0000 7f24767fc700 1 -- 172.21.15.146:0/3477420397 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2484007440 con 0x7f24880b9850 2021-01-27T09:44:55.879 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.873+0000 7f24767fc700 1 -- 172.21.15.146:0/3477420397 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2484005770 con 0x7f24880b9850 2021-01-27T09:44:55.879 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.873+0000 7f248f183700 1 -- 172.21.15.146:0/3477420397 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f248809eae0 con 0x7f24880b9850 2021-01-27T09:44:55.879 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.873+0000 7f248f183700 1 -- 172.21.15.146:0/3477420397 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24880be7b0 con 0x7f24880b9850 2021-01-27T09:44:55.879 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.873+0000 7f248f183700 1 -- 172.21.15.146:0/3477420397 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f248809ef80 con 0x7f24880b9850 2021-01-27T09:44:55.881 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.873+0000 7f24767fc700 1 -- 172.21.15.146:0/3477420397 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f2484010070 con 0x7f24880b9850 2021-01-27T09:44:55.881 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.877+0000 7f24767fc700 1 --2- 172.21.15.146:0/3477420397 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2468056210 0x7f24680586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:55.881 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.877+0000 7f24767fc700 1 -- 172.21.15.146:0/3477420397 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f248406ebe0 con 0x7f24880b9850 2021-01-27T09:44:55.881 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.877+0000 7f24767fc700 1 --2- 172.21.15.146:0/3477420397 >> [v2:172.21.15.146:6800/14470,v1:172.21.15.146:6801/14470] conn(0x7f246805e400 0x7f24680608a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:55.881 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.877+0000 7f24767fc700 1 -- 172.21.15.146:0/3477420397 --> [v2:172.21.15.146:6800/14470,v1:172.21.15.146:6801/14470] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2468060f20 con 0x7f246805e400 2021-01-27T09:44:55.882 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.877+0000 7f24767fc700 1 -- 172.21.15.146:0/3477420397 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2484071250 con 0x7f24880b9850 2021-01-27T09:44:55.882 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.877+0000 7f248d980700 1 --2- 172.21.15.146:0/3477420397 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2468056210 0x7f24680586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:55.882 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.877+0000 7f248e982700 1 --2- 172.21.15.146:0/3477420397 >> [v2:172.21.15.146:6800/14470,v1:172.21.15.146:6801/14470] conn(0x7f246805e400 0x7f24680608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:55.882 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.877+0000 7f248d980700 1 --2- 172.21.15.146:0/3477420397 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2468056210 0x7f24680586d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f2478007fd0 tx=0x7f2478009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:55.883 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.877+0000 7f248e982700 1 --2- 172.21.15.146:0/3477420397 >> [v2:172.21.15.146:6800/14470,v1:172.21.15.146:6801/14470] conn(0x7f246805e400 0x7f24680608a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:55.883 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.877+0000 7f24767fc700 1 -- 172.21.15.146:0/3477420397 <== osd.0 v2:172.21.15.146:6800/14470 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f2468060f20 con 0x7f246805e400 2021-01-27T09:44:55.898 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.897+0000 7f248f183700 1 -- 172.21.15.146:0/3477420397 --> [v2:172.21.15.146:6800/14470,v1:172.21.15.146:6801/14470] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f24880bc350 con 0x7f246805e400 2021-01-27T09:44:55.900 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.897+0000 7f24767fc700 1 -- 172.21.15.146:0/3477420397 <== osd.0 v2:172.21.15.146:6800/14470 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f24880bc350 con 0x7f246805e400 2021-01-27T09:44:55.901 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.897+0000 7f248f183700 1 -- 172.21.15.146:0/3477420397 >> [v2:172.21.15.146:6800/14470,v1:172.21.15.146:6801/14470] conn(0x7f246805e400 msgr2=0x7f24680608a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:55.901 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.897+0000 7f248f183700 1 --2- 172.21.15.146:0/3477420397 >> [v2:172.21.15.146:6800/14470,v1:172.21.15.146:6801/14470] conn(0x7f246805e400 0x7f24680608a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:55.901 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.897+0000 7f248f183700 1 -- 172.21.15.146:0/3477420397 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2468056210 msgr2=0x7f24680586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:55.901 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.897+0000 7f248f183700 1 --2- 172.21.15.146:0/3477420397 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2468056210 0x7f24680586d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f2478007fd0 tx=0x7f2478009040).stop 2021-01-27T09:44:55.902 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.897+0000 7f248f183700 1 -- 172.21.15.146:0/3477420397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24880b9850 msgr2=0x7f24880a0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:55.902 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.897+0000 7f248f183700 1 --2- 172.21.15.146:0/3477420397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24880b9850 0x7f24880a0720 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f248400c710 tx=0x7f2484007c70).stop 2021-01-27T09:44:55.902 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.897+0000 7f248e982700 1 -- 172.21.15.146:0/3477420397 reap_dead start 2021-01-27T09:44:55.902 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.897+0000 7f248f183700 1 -- 172.21.15.146:0/3477420397 shutdown_connections 2021-01-27T09:44:55.903 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.897+0000 7f248f183700 1 -- 172.21.15.146:0/3477420397 >> 172.21.15.146:0/3477420397 conn(0x7f2488067e60 msgr2=0x7f24880b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:55.903 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.897+0000 7f248f183700 1 -- 172.21.15.146:0/3477420397 shutdown_connections 2021-01-27T09:44:55.903 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:55.897+0000 7f248f183700 1 -- 172.21.15.146:0/3477420397 wait complete. 2021-01-27T09:44:55.925 INFO:teuthology.orchestra.run.smithi146.stdout:64424509449 2021-01-27T09:44:55.925 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2021-01-27T09:44:56.088 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.085+0000 7f654b32f700 1 Processor -- start 2021-01-27T09:44:56.089 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.085+0000 7f654b32f700 1 -- start start 2021-01-27T09:44:56.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.089+0000 7f654b32f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f654414e910 0x7f65440698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.089+0000 7f654b32f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6544065280 0x7f65441478c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.089+0000 7f654b32f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6544069d90 con 0x7f6544064ea0 2021-01-27T09:44:56.093 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.089+0000 7f654b32f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65440c5250 con 0x7f6544065280 2021-01-27T09:44:56.093 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.089+0000 7f654b32f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65441515f0 con 0x7f654414e910 2021-01-27T09:44:56.093 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.089+0000 7f654a32d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6544064ea0 0x7f654414e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46272/0 (socket says 172.21.15.146:46272) 2021-01-27T09:44:56.093 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.089+0000 7f654a32d700 1 -- 172.21.15.146:0/2128802901 learned_addr learned my addr 172.21.15.146:0/2128802901 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:56.094 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.089+0000 7f6549b2c700 1 --2- 172.21.15.146:0/2128802901 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f654414e910 0x7f65440698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.094 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.089+0000 7f654ab2e700 1 --2- 172.21.15.146:0/2128802901 >> v2:172.21.15.78:3300/0 conn(0x7f6544065280 0x7f65441478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.095 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.089+0000 7f654932b700 1 -- 172.21.15.146:0/2128802901 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 466052656 0 0) 0x7f6544069d90 con 0x7f6544064ea0 2021-01-27T09:44:56.095 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.089+0000 7f654932b700 1 -- 172.21.15.146:0/2128802901 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f652c003270 con 0x7f6544064ea0 2021-01-27T09:44:56.096 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.089+0000 7f6549b2c700 1 -- 172.21.15.146:0/2128802901 >> v2:172.21.15.78:3300/0 conn(0x7f6544065280 msgr2=0x7f65441478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:56.096 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.089+0000 7f6549b2c700 1 --2- 172.21.15.146:0/2128802901 >> v2:172.21.15.78:3300/0 conn(0x7f6544065280 0x7f65441478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:56.096 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.089+0000 7f6549b2c700 1 -- 172.21.15.146:0/2128802901 >> v1:172.21.15.146:6789/0 conn(0x7f6544064ea0 legacy=0x7f654414e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.096 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.089+0000 7f6549b2c700 1 -- 172.21.15.146:0/2128802901 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6544151890 con 0x7f654414e910 2021-01-27T09:44:56.097 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.089+0000 7f6549b2c700 1 --2- 172.21.15.146:0/2128802901 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f654414e910 0x7f65440698a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f653400b9c0 tx=0x7f6534006e20).ready entity=mon.2 client_cookie=6c822a8ef96931e2 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:56.097 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.093+0000 7f654932b700 1 -- 172.21.15.146:0/2128802901 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534009650 con 0x7f654414e910 2021-01-27T09:44:56.097 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.093+0000 7f654932b700 1 -- 172.21.15.146:0/2128802901 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65340097b0 con 0x7f654414e910 2021-01-27T09:44:56.098 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.093+0000 7f654932b700 1 -- 172.21.15.146:0/2128802901 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534009b30 con 0x7f654414e910 2021-01-27T09:44:56.098 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.093+0000 7f654b32f700 1 -- 172.21.15.146:0/2128802901 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f654414e910 msgr2=0x7f65440698a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.098 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.093+0000 7f654b32f700 1 --2- 172.21.15.146:0/2128802901 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f654414e910 0x7f65440698a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f653400b9c0 tx=0x7f6534006e20).stop 2021-01-27T09:44:56.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.093+0000 7f654b32f700 1 -- 172.21.15.146:0/2128802901 shutdown_connections 2021-01-27T09:44:56.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.093+0000 7f654b32f700 1 --2- 172.21.15.146:0/2128802901 >> v2:172.21.15.78:3300/0 conn(0x7f6544065280 0x7f65441478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:56.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.093+0000 7f654b32f700 1 --2- 172.21.15.146:0/2128802901 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f654414e910 0x7f65440698a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:56.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.093+0000 7f654b32f700 1 -- 172.21.15.146:0/2128802901 >> 172.21.15.146:0/2128802901 conn(0x7f6544067d30 msgr2=0x7f6544068140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:56.100 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.093+0000 7f654b32f700 1 -- 172.21.15.146:0/2128802901 shutdown_connections 2021-01-27T09:44:56.100 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.093+0000 7f654b32f700 1 -- 172.21.15.146:0/2128802901 wait complete. 2021-01-27T09:44:56.100 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.097+0000 7f654b32f700 1 Processor -- start 2021-01-27T09:44:56.100 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.097+0000 7f654b32f700 1 -- start start 2021-01-27T09:44:56.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.097+0000 7f654b32f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6544064ea0 0x7f654414d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.097+0000 7f654b32f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6544065280 0x7f6544149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.097+0000 7f654b32f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f654414e910 0x7f654415d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.097+0000 7f654b32f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6544149b60 con 0x7f6544065280 2021-01-27T09:44:56.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.097+0000 7f654b32f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65441613c0 con 0x7f6544064ea0 2021-01-27T09:44:56.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.097+0000 7f654b32f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6544161660 con 0x7f654414e910 2021-01-27T09:44:56.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.097+0000 7f654a32d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6544064ea0 0x7f654414d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.104 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.097+0000 7f6549b2c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6544065280 0x7f6544149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.104 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.097+0000 7f654a32d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6544064ea0 0x7f654414d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46706/0 (socket says 172.21.15.146:46706) 2021-01-27T09:44:56.104 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.097+0000 7f654ab2e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f654414e910 0x7f654415d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.104 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.097+0000 7f654a32d700 1 -- 172.21.15.146:0/3362415202 learned_addr learned my addr 172.21.15.146:0/3362415202 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:56.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.101+0000 7f654ab2e700 1 -- 172.21.15.146:0/3362415202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6544064ea0 msgr2=0x7f654414d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.101+0000 7f654ab2e700 1 --2- 172.21.15.146:0/3362415202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6544064ea0 0x7f654414d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:56.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.101+0000 7f654ab2e700 1 -- 172.21.15.146:0/3362415202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6544065280 msgr2=0x7f6544149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.101+0000 7f654ab2e700 1 --2- 172.21.15.146:0/3362415202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6544065280 0x7f6544149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:56.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.101+0000 7f654ab2e700 1 -- 172.21.15.146:0/3362415202 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654414f0e0 con 0x7f654414e910 2021-01-27T09:44:56.106 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.101+0000 7f6549b2c700 1 --2- 172.21.15.146:0/3362415202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6544065280 0x7f6544149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:56.107 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.101+0000 7f654ab2e700 1 --2- 172.21.15.146:0/3362415202 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f654414e910 0x7f654415d2e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f653c00ed10 tx=0x7f653c009220).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:56.107 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.101+0000 7f65327fc700 1 -- 172.21.15.146:0/3362415202 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c00ee70 con 0x7f654414e910 2021-01-27T09:44:56.107 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.101+0000 7f65327fc700 1 -- 172.21.15.146:0/3362415202 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653c00cbc0 con 0x7f654414e910 2021-01-27T09:44:56.108 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.101+0000 7f654b32f700 1 -- 172.21.15.146:0/3362415202 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654414f380 con 0x7f654414e910 2021-01-27T09:44:56.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.101+0000 7f65327fc700 1 -- 172.21.15.146:0/3362415202 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c0123f0 con 0x7f654414e910 2021-01-27T09:44:56.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.101+0000 7f654b32f700 1 -- 172.21.15.146:0/3362415202 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65440c0210 con 0x7f654414e910 2021-01-27T09:44:56.110 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.101+0000 7f654b32f700 1 -- 172.21.15.146:0/3362415202 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f65440c0460 con 0x7f654414e910 2021-01-27T09:44:56.110 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.105+0000 7f65327fc700 1 -- 172.21.15.146:0/3362415202 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f653c022070 con 0x7f654414e910 2021-01-27T09:44:56.112 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.105+0000 7f65327fc700 1 --2- 172.21.15.146:0/3362415202 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6524056260 0x7f6524058720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.105+0000 7f65327fc700 1 -- 172.21.15.146:0/3362415202 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f653c070160 con 0x7f654414e910 2021-01-27T09:44:56.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.105+0000 7f654a32d700 1 --2- 172.21.15.146:0/3362415202 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6524056260 0x7f6524058720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.105+0000 7f65327fc700 1 --2- 172.21.15.146:0/3362415202 >> [v2:172.21.15.146:6816/14472,v1:172.21.15.146:6817/14472] conn(0x7f652405e4d0 0x7f6524060970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.105+0000 7f65327fc700 1 -- 172.21.15.146:0/3362415202 --> [v2:172.21.15.146:6816/14472,v1:172.21.15.146:6817/14472] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6524060ff0 con 0x7f652405e4d0 2021-01-27T09:44:56.114 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.105+0000 7f65327fc700 1 -- 172.21.15.146:0/3362415202 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f653c070560 con 0x7f654414e910 2021-01-27T09:44:56.114 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.105+0000 7f6549b2c700 1 --2- 172.21.15.146:0/3362415202 >> [v2:172.21.15.146:6816/14472,v1:172.21.15.146:6817/14472] conn(0x7f652405e4d0 0x7f6524060970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.114 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.105+0000 7f654a32d700 1 --2- 172.21.15.146:0/3362415202 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6524056260 0x7f6524058720 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f6540007620 tx=0x7f6540007ad0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:56.114 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.109+0000 7f6549b2c700 1 --2- 172.21.15.146:0/3362415202 >> [v2:172.21.15.146:6816/14472,v1:172.21.15.146:6817/14472] conn(0x7f652405e4d0 0x7f6524060970 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:56.114 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.109+0000 7f65327fc700 1 -- 172.21.15.146:0/3362415202 <== osd.1 v2:172.21.15.146:6816/14472 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f6524060ff0 con 0x7f652405e4d0 2021-01-27T09:44:56.129 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.125+0000 7f654b32f700 1 -- 172.21.15.146:0/3362415202 --> [v2:172.21.15.146:6816/14472,v1:172.21.15.146:6817/14472] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f65440c4a30 con 0x7f652405e4d0 2021-01-27T09:44:56.130 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.125+0000 7f65327fc700 1 -- 172.21.15.146:0/3362415202 <== osd.1 v2:172.21.15.146:6816/14472 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f65440c4a30 con 0x7f652405e4d0 2021-01-27T09:44:56.131 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.129+0000 7f654b32f700 1 -- 172.21.15.146:0/3362415202 >> [v2:172.21.15.146:6816/14472,v1:172.21.15.146:6817/14472] conn(0x7f652405e4d0 msgr2=0x7f6524060970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.131 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.129+0000 7f654b32f700 1 --2- 172.21.15.146:0/3362415202 >> [v2:172.21.15.146:6816/14472,v1:172.21.15.146:6817/14472] conn(0x7f652405e4d0 0x7f6524060970 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:56.131 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.129+0000 7f654b32f700 1 -- 172.21.15.146:0/3362415202 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6524056260 msgr2=0x7f6524058720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.131 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.129+0000 7f654b32f700 1 --2- 172.21.15.146:0/3362415202 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6524056260 0x7f6524058720 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f6540007620 tx=0x7f6540007ad0).stop 2021-01-27T09:44:56.132 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.129+0000 7f654b32f700 1 -- 172.21.15.146:0/3362415202 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f654414e910 msgr2=0x7f654415d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.132 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.129+0000 7f654b32f700 1 --2- 172.21.15.146:0/3362415202 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f654414e910 0x7f654415d2e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f653c00ed10 tx=0x7f653c009220).stop 2021-01-27T09:44:56.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.129+0000 7f654ab2e700 1 -- 172.21.15.146:0/3362415202 reap_dead start 2021-01-27T09:44:56.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.129+0000 7f654b32f700 1 -- 172.21.15.146:0/3362415202 shutdown_connections 2021-01-27T09:44:56.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.129+0000 7f654b32f700 1 -- 172.21.15.146:0/3362415202 >> 172.21.15.146:0/3362415202 conn(0x7f6544067d30 msgr2=0x7f65441461d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:56.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.129+0000 7f654b32f700 1 -- 172.21.15.146:0/3362415202 shutdown_connections 2021-01-27T09:44:56.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.129+0000 7f654b32f700 1 -- 172.21.15.146:0/3362415202 wait complete. 2021-01-27T09:44:56.156 INFO:teuthology.orchestra.run.smithi146.stdout:64424509449 2021-01-27T09:44:56.156 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2021-01-27T09:44:56.326 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.321+0000 7f67bda11700 1 Processor -- start 2021-01-27T09:44:56.326 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.325+0000 7f67bda11700 1 -- start start 2021-01-27T09:44:56.327 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.325+0000 7f67bda11700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f67b8065040 0x7f67b814ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.328 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.325+0000 7f67bda11700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f67b80649c0 0x7f67b80bd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.328 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.325+0000 7f67bda11700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b8067040 con 0x7f67b8065420 2021-01-27T09:44:56.328 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.325+0000 7f67bda11700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b80672e0 con 0x7f67b8065040 2021-01-27T09:44:56.328 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.325+0000 7f67bda11700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b8067580 con 0x7f67b80649c0 2021-01-27T09:44:56.334 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.325+0000 7f67b7fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f67b8065420 0x7f67b814b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:34322/0 (socket says 172.21.15.146:34322) 2021-01-27T09:44:56.334 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.325+0000 7f67b7fff700 1 -- 172.21.15.146:0/602481412 learned_addr learned my addr 172.21.15.146:0/602481412 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:56.334 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.325+0000 7f67b67fc700 1 --2- 172.21.15.146:0/602481412 >> v2:172.21.15.146:3300/0 conn(0x7f67b80649c0 0x7f67b80bd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.335 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.325+0000 7f67b6ffd700 1 --2- 172.21.15.146:0/602481412 >> v2:172.21.15.78:3300/0 conn(0x7f67b8065040 0x7f67b814ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.335 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.325+0000 7f67b5ffb700 1 -- 172.21.15.146:0/602481412 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510480876 0 0) 0x7f67b8067040 con 0x7f67b8065420 2021-01-27T09:44:56.335 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.325+0000 7f67b5ffb700 1 -- 172.21.15.146:0/602481412 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67a4003270 con 0x7f67b8065420 2021-01-27T09:44:56.335 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.325+0000 7f67b5ffb700 1 -- 172.21.15.146:0/602481412 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1410295216 0 0) 0x7f67a4003270 con 0x7f67b8065420 2021-01-27T09:44:56.336 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.325+0000 7f67b5ffb700 1 -- 172.21.15.146:0/602481412 >> v2:172.21.15.146:3300/0 conn(0x7f67b80649c0 msgr2=0x7f67b80bd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:56.336 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.325+0000 7f67b5ffb700 1 --2- 172.21.15.146:0/602481412 >> v2:172.21.15.146:3300/0 conn(0x7f67b80649c0 0x7f67b80bd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:56.336 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.325+0000 7f67b5ffb700 1 -- 172.21.15.146:0/602481412 >> v2:172.21.15.78:3300/0 conn(0x7f67b8065040 msgr2=0x7f67b814ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:56.336 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.325+0000 7f67b5ffb700 1 --2- 172.21.15.146:0/602481412 >> v2:172.21.15.78:3300/0 conn(0x7f67b8065040 0x7f67b814ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:56.337 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.325+0000 7f67b5ffb700 1 -- 172.21.15.146:0/602481412 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b8067820 con 0x7f67b8065420 2021-01-27T09:44:56.337 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.325+0000 7f67b5ffb700 1 -- 172.21.15.146:0/602481412 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3890990827 0 0) 0x7f67b00018a0 con 0x7f67b8065420 2021-01-27T09:44:56.339 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.325+0000 7f67b5ffb700 1 -- 172.21.15.146:0/602481412 >> v1:172.21.15.78:6789/0 conn(0x7f67b8065420 legacy=0x7f67b814b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.339 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67b5ffb700 1 --2- 172.21.15.146:0/602481412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67a4003830 0x7f67a4003c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.340 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67b5ffb700 1 --2- 172.21.15.146:0/602481412 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67a4004510 0x7f67a4004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.340 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67b5ffb700 1 --2- 172.21.15.146:0/602481412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67a4004e80 0x7f67a400b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.340 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67b5ffb700 1 -- 172.21.15.146:0/602481412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b80672e0 con 0x7f67a4003830 2021-01-27T09:44:56.341 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67b5ffb700 1 -- 172.21.15.146:0/602481412 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b8067580 con 0x7f67a4004e80 2021-01-27T09:44:56.341 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67b5ffb700 1 -- 172.21.15.146:0/602481412 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a400bc50 con 0x7f67a4004510 2021-01-27T09:44:56.342 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67b67fc700 1 --2- 172.21.15.146:0/602481412 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67a4004510 0x7f67a4004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.342 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67b7fff700 1 --2- 172.21.15.146:0/602481412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67a4004e80 0x7f67a400b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.342 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67b6ffd700 1 --2- 172.21.15.146:0/602481412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67a4003830 0x7f67a4003c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67b67fc700 1 -- 172.21.15.146:0/602481412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67a4004e80 msgr2=0x7f67a400b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67b67fc700 1 --2- 172.21.15.146:0/602481412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67a4004e80 0x7f67a400b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67b67fc700 1 -- 172.21.15.146:0/602481412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67a4003830 msgr2=0x7f67a4003c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:56.344 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67b67fc700 1 --2- 172.21.15.146:0/602481412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67a4003830 0x7f67a4003c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:56.344 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67b67fc700 1 -- 172.21.15.146:0/602481412 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a4003270 con 0x7f67a4004510 2021-01-27T09:44:56.345 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67b7fff700 1 -- 172.21.15.146:0/602481412 reap_dead start 2021-01-27T09:44:56.345 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67b67fc700 1 --2- 172.21.15.146:0/602481412 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67a4004510 0x7f67a4004990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f67ac00bc30 tx=0x7f67ac006e20).ready entity=mon.2 client_cookie=9fe19f5babc69423 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:56.345 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67b5ffb700 1 -- 172.21.15.146:0/602481412 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac00b310 con 0x7f67a4004510 2021-01-27T09:44:56.346 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67b5ffb700 1 -- 172.21.15.146:0/602481412 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ac00e9a0 con 0x7f67a4004510 2021-01-27T09:44:56.346 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67b5ffb700 1 -- 172.21.15.146:0/602481412 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac00ed20 con 0x7f67a4004510 2021-01-27T09:44:56.346 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67bda11700 1 -- 172.21.15.146:0/602481412 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67a4004510 msgr2=0x7f67a4004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.347 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67bda11700 1 --2- 172.21.15.146:0/602481412 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67a4004510 0x7f67a4004990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f67ac00bc30 tx=0x7f67ac006e20).stop 2021-01-27T09:44:56.347 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67bda11700 1 -- 172.21.15.146:0/602481412 shutdown_connections 2021-01-27T09:44:56.347 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67bda11700 1 --2- 172.21.15.146:0/602481412 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67a4004510 0x7f67a4004990 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:56.348 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67bda11700 1 -- 172.21.15.146:0/602481412 >> 172.21.15.146:0/602481412 conn(0x7f67b8060e60 msgr2=0x7f67b8061270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:56.348 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67bda11700 1 -- 172.21.15.146:0/602481412 shutdown_connections 2021-01-27T09:44:56.349 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.329+0000 7f67bda11700 1 -- 172.21.15.146:0/602481412 wait complete. 2021-01-27T09:44:56.352 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.333+0000 7f67bda11700 1 Processor -- start 2021-01-27T09:44:56.353 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.333+0000 7f67bda11700 1 -- start start 2021-01-27T09:44:56.353 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.337+0000 7f67bda11700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67a4004510 0x7f67b8147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.353 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.337+0000 7f67bda11700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67b8147f30 0x7f67b814bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.354 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.337+0000 7f67bda11700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67b80bca90 0x7f67b814c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.354 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.337+0000 7f67bda11700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b814c760 con 0x7f67b8147f30 2021-01-27T09:44:56.355 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.337+0000 7f67bda11700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b81611d0 con 0x7f67b80bca90 2021-01-27T09:44:56.355 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.337+0000 7f67bda11700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b8161470 con 0x7f67a4004510 2021-01-27T09:44:56.355 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.337+0000 7f67b7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67b80bca90 0x7f67b814c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.337+0000 7f67b67fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67b8147f30 0x7f67b814bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.337+0000 7f67b6ffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67a4004510 0x7f67b8147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.357 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.337+0000 7f67b7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67b80bca90 0x7f67b814c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46732/0 (socket says 172.21.15.146:46732) 2021-01-27T09:44:56.357 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.337+0000 7f67b7fff700 1 -- 172.21.15.146:0/1717099486 learned_addr learned my addr 172.21.15.146:0/1717099486 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:56.358 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.337+0000 7f67b67fc700 1 -- 172.21.15.146:0/1717099486 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67a4004510 msgr2=0x7f67b8147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.358 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.337+0000 7f67b67fc700 1 --2- 172.21.15.146:0/1717099486 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67a4004510 0x7f67b8147a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:56.358 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.337+0000 7f67b67fc700 1 -- 172.21.15.146:0/1717099486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67b80bca90 msgr2=0x7f67b814c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.337+0000 7f67b67fc700 1 --2- 172.21.15.146:0/1717099486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67b80bca90 0x7f67b814c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.337+0000 7f67b67fc700 1 -- 172.21.15.146:0/1717099486 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b80a44a0 con 0x7f67b8147f30 2021-01-27T09:44:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.337+0000 7f67b7fff700 1 --2- 172.21.15.146:0/1717099486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67b80bca90 0x7f67b814c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.337+0000 7f67b67fc700 1 --2- 172.21.15.146:0/1717099486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67b8147f30 0x7f67b814bd80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f67ac016000 tx=0x7f67ac019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.337+0000 7f679effd700 1 -- 172.21.15.146:0/1717099486 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac012d40 con 0x7f67b8147f30 2021-01-27T09:44:56.360 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.337+0000 7f679effd700 1 -- 172.21.15.146:0/1717099486 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ac021070 con 0x7f67b8147f30 2021-01-27T09:44:56.361 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.337+0000 7f67bda11700 1 -- 172.21.15.146:0/1717099486 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b80a4740 con 0x7f67b8147f30 2021-01-27T09:44:56.361 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.337+0000 7f679effd700 1 -- 172.21.15.146:0/1717099486 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac01c430 con 0x7f67b8147f30 2021-01-27T09:44:56.361 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.337+0000 7f67bda11700 1 -- 172.21.15.146:0/1717099486 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b814a0a0 con 0x7f67b8147f30 2021-01-27T09:44:56.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.341+0000 7f67bda11700 1 -- 172.21.15.146:0/1717099486 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f67b80a4320 con 0x7f67b8147f30 2021-01-27T09:44:56.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.341+0000 7f679effd700 1 -- 172.21.15.146:0/1717099486 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f67ac01c7e0 con 0x7f67b8147f30 2021-01-27T09:44:56.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.345+0000 7f679effd700 1 --2- 172.21.15.146:0/1717099486 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6798056210 0x7f67980586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.345+0000 7f679effd700 1 -- 172.21.15.146:0/1717099486 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f67ac0713e0 con 0x7f67b8147f30 2021-01-27T09:44:56.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.345+0000 7f67b6ffd700 1 --2- 172.21.15.146:0/1717099486 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6798056210 0x7f67980586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.345+0000 7f679effd700 1 --2- 172.21.15.146:0/1717099486 >> [v2:172.21.15.146:6820/14474,v1:172.21.15.146:6822/14474] conn(0x7f679805e400 0x7f67980608a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.345+0000 7f679effd700 1 -- 172.21.15.146:0/1717099486 --> [v2:172.21.15.146:6820/14474,v1:172.21.15.146:6822/14474] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6798060f20 con 0x7f679805e400 2021-01-27T09:44:56.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.345+0000 7f679effd700 1 -- 172.21.15.146:0/1717099486 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67ac071760 con 0x7f67b8147f30 2021-01-27T09:44:56.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.345+0000 7f67b7fff700 1 --2- 172.21.15.146:0/1717099486 >> [v2:172.21.15.146:6820/14474,v1:172.21.15.146:6822/14474] conn(0x7f679805e400 0x7f67980608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.345+0000 7f67b6ffd700 1 --2- 172.21.15.146:0/1717099486 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6798056210 0x7f67980586d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f67b805cb00 tx=0x7f67a8006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:56.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.345+0000 7f67b7fff700 1 --2- 172.21.15.146:0/1717099486 >> [v2:172.21.15.146:6820/14474,v1:172.21.15.146:6822/14474] conn(0x7f679805e400 0x7f67980608a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:56.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.349+0000 7f679effd700 1 -- 172.21.15.146:0/1717099486 <== osd.2 v2:172.21.15.146:6820/14474 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f6798060f20 con 0x7f679805e400 2021-01-27T09:44:56.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.365+0000 7f67bda11700 1 -- 172.21.15.146:0/1717099486 --> [v2:172.21.15.146:6820/14474,v1:172.21.15.146:6822/14474] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f67b8044ee0 con 0x7f679805e400 2021-01-27T09:44:56.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.365+0000 7f679effd700 1 -- 172.21.15.146:0/1717099486 <== osd.2 v2:172.21.15.146:6820/14474 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f67b8044ee0 con 0x7f679805e400 2021-01-27T09:44:56.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.365+0000 7f67bda11700 1 -- 172.21.15.146:0/1717099486 >> [v2:172.21.15.146:6820/14474,v1:172.21.15.146:6822/14474] conn(0x7f679805e400 msgr2=0x7f67980608a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.365+0000 7f67bda11700 1 --2- 172.21.15.146:0/1717099486 >> [v2:172.21.15.146:6820/14474,v1:172.21.15.146:6822/14474] conn(0x7f679805e400 0x7f67980608a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:56.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.365+0000 7f67bda11700 1 -- 172.21.15.146:0/1717099486 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6798056210 msgr2=0x7f67980586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.365+0000 7f67bda11700 1 --2- 172.21.15.146:0/1717099486 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6798056210 0x7f67980586d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f67b805cb00 tx=0x7f67a8006e20).stop 2021-01-27T09:44:56.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.365+0000 7f67bda11700 1 -- 172.21.15.146:0/1717099486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67b8147f30 msgr2=0x7f67b814bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.365+0000 7f67bda11700 1 --2- 172.21.15.146:0/1717099486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67b8147f30 0x7f67b814bd80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f67ac016000 tx=0x7f67ac019000).stop 2021-01-27T09:44:56.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.365+0000 7f67b7fff700 1 -- 172.21.15.146:0/1717099486 reap_dead start 2021-01-27T09:44:56.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.365+0000 7f67bda11700 1 -- 172.21.15.146:0/1717099486 shutdown_connections 2021-01-27T09:44:56.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.365+0000 7f67bda11700 1 -- 172.21.15.146:0/1717099486 >> 172.21.15.146:0/1717099486 conn(0x7f67b8060e60 msgr2=0x7f67b80614f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:56.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.365+0000 7f67bda11700 1 -- 172.21.15.146:0/1717099486 shutdown_connections 2021-01-27T09:44:56.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.365+0000 7f67bda11700 1 -- 172.21.15.146:0/1717099486 wait complete. 2021-01-27T09:44:56.391 INFO:teuthology.orchestra.run.smithi146.stdout:64424509449 2021-01-27T09:44:56.391 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2021-01-27T09:44:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.549+0000 7f751733a700 1 Processor -- start 2021-01-27T09:44:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.549+0000 7f751733a700 1 -- start start 2021-01-27T09:44:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.549+0000 7f751733a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f75100682b0 0x7f75101442c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.549+0000 7f751733a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75100b9bb0 con 0x7f7510060020 2021-01-27T09:44:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.549+0000 7f751733a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75100b9e50 con 0x7f7510067ed0 2021-01-27T09:44:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.549+0000 7f751733a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751014b810 con 0x7f75100682b0 2021-01-27T09:44:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.549+0000 7f7516b39700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f75100682b0 0x7f75101442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.549+0000 7f7516338700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7510067ed0 0x7f751014e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46310/0 (socket says 172.21.15.146:46310) 2021-01-27T09:44:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.549+0000 7f7516338700 1 -- 172.21.15.146:0/1210025730 learned_addr learned my addr 172.21.15.146:0/1210025730 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:56.555 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.553+0000 7f7516b39700 1 -- 172.21.15.146:0/1210025730 >> v1:172.21.15.146:6789/0 conn(0x7f7510067ed0 legacy=0x7f751014e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.555 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.553+0000 7f7516b39700 1 -- 172.21.15.146:0/1210025730 >> v1:172.21.15.78:6789/0 conn(0x7f7510060020 legacy=0x7f75100bcba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.553+0000 7f7516b39700 1 -- 172.21.15.146:0/1210025730 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75100ba0f0 con 0x7f75100682b0 2021-01-27T09:44:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.553+0000 7f7516b39700 1 --2- 172.21.15.146:0/1210025730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75100682b0 0x7f75101442c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f751014b950 tx=0x7f7508009220).ready entity=mon.1 client_cookie=13925a4c0c8353b2 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.553+0000 7f7515336700 1 -- 172.21.15.146:0/1210025730 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7508009ea0 con 0x7f75100682b0 2021-01-27T09:44:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.553+0000 7f7515336700 1 -- 172.21.15.146:0/1210025730 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750800bc80 con 0x7f75100682b0 2021-01-27T09:44:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.553+0000 7f7515336700 1 -- 172.21.15.146:0/1210025730 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7508010470 con 0x7f75100682b0 2021-01-27T09:44:56.557 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.553+0000 7f751733a700 1 -- 172.21.15.146:0/1210025730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75100682b0 msgr2=0x7f75101442c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.557 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.553+0000 7f751733a700 1 --2- 172.21.15.146:0/1210025730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75100682b0 0x7f75101442c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f751014b950 tx=0x7f7508009220).stop 2021-01-27T09:44:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.553+0000 7f751733a700 1 -- 172.21.15.146:0/1210025730 shutdown_connections 2021-01-27T09:44:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.553+0000 7f751733a700 1 --2- 172.21.15.146:0/1210025730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75100682b0 0x7f75101442c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.553+0000 7f751733a700 1 -- 172.21.15.146:0/1210025730 >> 172.21.15.146:0/1210025730 conn(0x7f75100bf4c0 msgr2=0x7f7510069110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.553+0000 7f751733a700 1 -- 172.21.15.146:0/1210025730 shutdown_connections 2021-01-27T09:44:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.553+0000 7f751733a700 1 -- 172.21.15.146:0/1210025730 wait complete. 2021-01-27T09:44:56.561 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.557+0000 7f751733a700 1 Processor -- start 2021-01-27T09:44:56.561 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.557+0000 7f751733a700 1 -- start start 2021-01-27T09:44:56.563 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.561+0000 7f751733a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7510060020 0x7f75100b8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.563 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.561+0000 7f751733a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7510067ed0 0x7f751015d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.563 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.561+0000 7f751733a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f75100682b0 0x7f7510153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.563 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.561+0000 7f751733a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75100bb030 con 0x7f7510060020 2021-01-27T09:44:56.564 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.561+0000 7f751733a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75100bb2d0 con 0x7f7510067ed0 2021-01-27T09:44:56.564 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.561+0000 7f751733a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7510148890 con 0x7f75100682b0 2021-01-27T09:44:56.564 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.561+0000 7f7515b37700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7510067ed0 0x7f751015d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.564 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.561+0000 7f7515b37700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7510067ed0 0x7f751015d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46746/0 (socket says 172.21.15.146:46746) 2021-01-27T09:44:56.565 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.561+0000 7f7515b37700 1 -- 172.21.15.146:0/3823556817 learned_addr learned my addr 172.21.15.146:0/3823556817 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:56.565 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.561+0000 7f7516338700 1 --2- 172.21.15.146:0/3823556817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7510060020 0x7f75100b8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.566 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.561+0000 7f7516b39700 1 --2- 172.21.15.146:0/3823556817 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f75100682b0 0x7f7510153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.566 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.561+0000 7f7515b37700 1 -- 172.21.15.146:0/3823556817 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f75100682b0 msgr2=0x7f7510153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.567 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.561+0000 7f7515b37700 1 --2- 172.21.15.146:0/3823556817 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f75100682b0 0x7f7510153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:56.567 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.561+0000 7f7515b37700 1 -- 172.21.15.146:0/3823556817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7510060020 msgr2=0x7f75100b8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.567 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.561+0000 7f7515b37700 1 --2- 172.21.15.146:0/3823556817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7510060020 0x7f75100b8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:56.567 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.561+0000 7f7515b37700 1 -- 172.21.15.146:0/3823556817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7510148b30 con 0x7f7510067ed0 2021-01-27T09:44:56.567 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.561+0000 7f7515b37700 1 --2- 172.21.15.146:0/3823556817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7510067ed0 0x7f751015d380 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f750000c710 tx=0x7f7500007c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:56.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.561+0000 7f74fe7fc700 1 -- 172.21.15.146:0/3823556817 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7500007020 con 0x7f7510067ed0 2021-01-27T09:44:56.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.561+0000 7f74fe7fc700 1 -- 172.21.15.146:0/3823556817 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7500007180 con 0x7f7510067ed0 2021-01-27T09:44:56.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.561+0000 7f74fe7fc700 1 -- 172.21.15.146:0/3823556817 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7500006520 con 0x7f7510067ed0 2021-01-27T09:44:56.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.561+0000 7f751733a700 1 -- 172.21.15.146:0/3823556817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7510148dd0 con 0x7f7510067ed0 2021-01-27T09:44:56.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.561+0000 7f751733a700 1 -- 172.21.15.146:0/3823556817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7510153950 con 0x7f7510067ed0 2021-01-27T09:44:56.569 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.565+0000 7f751733a700 1 -- 172.21.15.146:0/3823556817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7510148710 con 0x7f7510067ed0 2021-01-27T09:44:56.570 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.565+0000 7f74fe7fc700 1 -- 172.21.15.146:0/3823556817 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f7500010070 con 0x7f7510067ed0 2021-01-27T09:44:56.570 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.565+0000 7f74fe7fc700 1 --2- 172.21.15.146:0/3823556817 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f74f00561e0 0x7f74f00586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.570 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.565+0000 7f74fe7fc700 1 -- 172.21.15.146:0/3823556817 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f750006e8a0 con 0x7f7510067ed0 2021-01-27T09:44:56.570 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.565+0000 7f74fe7fc700 1 --2- 172.21.15.146:0/3823556817 >> [v2:172.21.15.146:6804/14471,v1:172.21.15.146:6806/14471] conn(0x7f74f005e3d0 0x7f74f0060870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.571 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.565+0000 7f74fe7fc700 1 -- 172.21.15.146:0/3823556817 --> [v2:172.21.15.146:6804/14471,v1:172.21.15.146:6806/14471] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f74f0060ef0 con 0x7f74f005e3d0 2021-01-27T09:44:56.571 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.565+0000 7f74fe7fc700 1 -- 172.21.15.146:0/3823556817 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7500073220 con 0x7f7510067ed0 2021-01-27T09:44:56.571 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.565+0000 7f7516338700 1 --2- 172.21.15.146:0/3823556817 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f74f00561e0 0x7f74f00586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.571 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.565+0000 7f7516b39700 1 --2- 172.21.15.146:0/3823556817 >> [v2:172.21.15.146:6804/14471,v1:172.21.15.146:6806/14471] conn(0x7f74f005e3d0 0x7f74f0060870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.572 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.569+0000 7f7516338700 1 --2- 172.21.15.146:0/3823556817 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f74f00561e0 0x7f74f00586a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f750c004610 tx=0x7f750c007bb0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:56.572 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.569+0000 7f7516b39700 1 --2- 172.21.15.146:0/3823556817 >> [v2:172.21.15.146:6804/14471,v1:172.21.15.146:6806/14471] conn(0x7f74f005e3d0 0x7f74f0060870 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:56.572 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.569+0000 7f74fe7fc700 1 -- 172.21.15.146:0/3823556817 <== osd.3 v2:172.21.15.146:6804/14471 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f74f0060ef0 con 0x7f74f005e3d0 2021-01-27T09:44:56.590 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.589+0000 7f751733a700 1 -- 172.21.15.146:0/3823556817 --> [v2:172.21.15.146:6804/14471,v1:172.21.15.146:6806/14471] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7510149530 con 0x7f74f005e3d0 2021-01-27T09:44:56.592 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.589+0000 7f74fe7fc700 1 -- 172.21.15.146:0/3823556817 <== osd.3 v2:172.21.15.146:6804/14471 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7510149530 con 0x7f74f005e3d0 2021-01-27T09:44:56.593 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.589+0000 7f751733a700 1 -- 172.21.15.146:0/3823556817 >> [v2:172.21.15.146:6804/14471,v1:172.21.15.146:6806/14471] conn(0x7f74f005e3d0 msgr2=0x7f74f0060870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.593 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.589+0000 7f751733a700 1 --2- 172.21.15.146:0/3823556817 >> [v2:172.21.15.146:6804/14471,v1:172.21.15.146:6806/14471] conn(0x7f74f005e3d0 0x7f74f0060870 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:56.593 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.589+0000 7f751733a700 1 -- 172.21.15.146:0/3823556817 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f74f00561e0 msgr2=0x7f74f00586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.593 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.589+0000 7f751733a700 1 --2- 172.21.15.146:0/3823556817 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f74f00561e0 0x7f74f00586a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f750c004610 tx=0x7f750c007bb0).stop 2021-01-27T09:44:56.594 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.589+0000 7f751733a700 1 -- 172.21.15.146:0/3823556817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7510067ed0 msgr2=0x7f751015d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.594 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.589+0000 7f751733a700 1 --2- 172.21.15.146:0/3823556817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7510067ed0 0x7f751015d380 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f750000c710 tx=0x7f7500007c80).stop 2021-01-27T09:44:56.594 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.589+0000 7f7516b39700 1 -- 172.21.15.146:0/3823556817 reap_dead start 2021-01-27T09:44:56.594 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.589+0000 7f751733a700 1 -- 172.21.15.146:0/3823556817 shutdown_connections 2021-01-27T09:44:56.594 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.589+0000 7f751733a700 1 -- 172.21.15.146:0/3823556817 >> 172.21.15.146:0/3823556817 conn(0x7f75100bf4c0 msgr2=0x7f7510146920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:56.595 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.589+0000 7f751733a700 1 -- 172.21.15.146:0/3823556817 shutdown_connections 2021-01-27T09:44:56.595 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.589+0000 7f751733a700 1 -- 172.21.15.146:0/3823556817 wait complete. 2021-01-27T09:44:56.618 INFO:teuthology.orchestra.run.smithi146.stdout:64424509449 2021-01-27T09:44:56.619 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2021-01-27T09:44:56.781 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.777+0000 7f69a359e700 1 Processor -- start 2021-01-27T09:44:56.781 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.777+0000 7f69a359e700 1 -- start start 2021-01-27T09:44:56.783 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.781+0000 7f69a359e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69a4067ed0 0x7f69a4067560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.784 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.781+0000 7f69a359e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f69a40682b0 0x7f69a40be070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.784 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.781+0000 7f69a359e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a414f1c0 con 0x7f69a40be560 2021-01-27T09:44:56.784 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.781+0000 7f69a359e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a414f460 con 0x7f69a40682b0 2021-01-27T09:44:56.784 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.781+0000 7f69a359e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a414f700 con 0x7f69a4067ed0 2021-01-27T09:44:56.785 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.781+0000 7f69a259c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69a4067ed0 0x7f69a4067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.785 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.781+0000 7f6999d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f69a40682b0 0x7f69a40be070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.785 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.781+0000 7f69a259c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69a4067ed0 0x7f69a4067560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36240/0 (socket says 172.21.15.146:36240) 2021-01-27T09:44:56.785 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.781+0000 7f69a259c700 1 -- 172.21.15.146:0/417520604 learned_addr learned my addr 172.21.15.146:0/417520604 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:56.787 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.781+0000 7f69a259c700 1 -- 172.21.15.146:0/417520604 >> v2:172.21.15.78:3300/0 conn(0x7f69a40682b0 msgr2=0x7f69a40be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:56.787 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.781+0000 7f69a259c700 1 --2- 172.21.15.146:0/417520604 >> v2:172.21.15.78:3300/0 conn(0x7f69a40682b0 0x7f69a40be070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:56.787 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.781+0000 7f69a259c700 1 -- 172.21.15.146:0/417520604 >> v1:172.21.15.78:6789/0 conn(0x7f69a40be560 legacy=0x7f69a414bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.788 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.781+0000 7f69a1d9b700 1 -- 172.21.15.146:0/417520604 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079456129 0 0) 0x7f69a414f1c0 con 0x7f69a40be560 2021-01-27T09:44:56.788 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.781+0000 7f69a259c700 1 -- 172.21.15.146:0/417520604 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a414f9a0 con 0x7f69a4067ed0 2021-01-27T09:44:56.788 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.781+0000 7f6999d9b700 1 --2- 172.21.15.146:0/417520604 >> v2:172.21.15.78:3300/0 conn(0x7f69a40682b0 0x7f69a40be070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:56.788 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.781+0000 7f69a259c700 1 --2- 172.21.15.146:0/417520604 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69a4067ed0 0x7f69a4067560 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f699400ba20 tx=0x7f6994006ee0).ready entity=mon.2 client_cookie=86369bc73d8231bc server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:56.789 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.781+0000 7f69a1d9b700 1 -- 172.21.15.146:0/417520604 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69940098d0 con 0x7f69a4067ed0 2021-01-27T09:44:56.789 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.781+0000 7f69a1d9b700 1 -- 172.21.15.146:0/417520604 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6994009a30 con 0x7f69a4067ed0 2021-01-27T09:44:56.789 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.781+0000 7f69a1d9b700 1 -- 172.21.15.146:0/417520604 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6994009db0 con 0x7f69a4067ed0 2021-01-27T09:44:56.790 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.785+0000 7f69a359e700 1 -- 172.21.15.146:0/417520604 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69a4067ed0 msgr2=0x7f69a4067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.785+0000 7f69a359e700 1 --2- 172.21.15.146:0/417520604 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69a4067ed0 0x7f69a4067560 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f699400ba20 tx=0x7f6994006ee0).stop 2021-01-27T09:44:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.785+0000 7f69a359e700 1 -- 172.21.15.146:0/417520604 shutdown_connections 2021-01-27T09:44:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.785+0000 7f69a359e700 1 --2- 172.21.15.146:0/417520604 >> v2:172.21.15.78:3300/0 conn(0x7f69a40682b0 0x7f69a40be070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.785+0000 7f69a359e700 1 --2- 172.21.15.146:0/417520604 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69a4067ed0 0x7f69a4067560 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:56.792 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.785+0000 7f69a359e700 1 -- 172.21.15.146:0/417520604 >> 172.21.15.146:0/417520604 conn(0x7f69a40bf4c0 msgr2=0x7f69a4069110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:56.792 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.785+0000 7f69a359e700 1 -- 172.21.15.146:0/417520604 shutdown_connections 2021-01-27T09:44:56.792 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.785+0000 7f69a359e700 1 -- 172.21.15.146:0/417520604 wait complete. 2021-01-27T09:44:56.795 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.785+0000 7f69a359e700 1 Processor -- start 2021-01-27T09:44:56.795 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.785+0000 7f69a359e700 1 -- start start 2021-01-27T09:44:56.795 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f69a359e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69a4067ed0 0x7f69a4151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f69a359e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69a40682b0 0x7f69a4160860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f69a359e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69a40be560 0x7f69a4160d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f69a359e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a4139c90 con 0x7f69a40be560 2021-01-27T09:44:56.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f69a359e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a4161240 con 0x7f69a4067ed0 2021-01-27T09:44:56.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f69a359e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a413a580 con 0x7f69a40682b0 2021-01-27T09:44:56.797 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f69a259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69a4067ed0 0x7f69a4151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.797 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f69a2d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69a40be560 0x7f69a4160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.797 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f69a259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69a4067ed0 0x7f69a4151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46760/0 (socket says 172.21.15.146:46760) 2021-01-27T09:44:56.797 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f69a259c700 1 -- 172.21.15.146:0/647119788 learned_addr learned my addr 172.21.15.146:0/647119788 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:56.797 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f6999d9b700 1 --2- 172.21.15.146:0/647119788 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69a40682b0 0x7f69a4160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.798 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f69a2d9d700 1 -- 172.21.15.146:0/647119788 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69a40682b0 msgr2=0x7f69a4160860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.798 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f69a2d9d700 1 --2- 172.21.15.146:0/647119788 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69a40682b0 0x7f69a4160860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:56.798 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f69a2d9d700 1 -- 172.21.15.146:0/647119788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69a4067ed0 msgr2=0x7f69a4151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:56.798 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f69a2d9d700 1 --2- 172.21.15.146:0/647119788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69a4067ed0 0x7f69a4151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:56.798 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f69a2d9d700 1 -- 172.21.15.146:0/647119788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a413a7e0 con 0x7f69a40be560 2021-01-27T09:44:56.799 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f69a259c700 1 --2- 172.21.15.146:0/647119788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69a4067ed0 0x7f69a4151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:56.799 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f69a2d9d700 1 --2- 172.21.15.146:0/647119788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69a40be560 0x7f69a4160d50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f699c0012e0 tx=0x7f699c007f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:56.799 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f699affd700 1 -- 172.21.15.146:0/647119788 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c00a5f0 con 0x7f69a40be560 2021-01-27T09:44:56.799 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f699affd700 1 -- 172.21.15.146:0/647119788 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699c00a750 con 0x7f69a40be560 2021-01-27T09:44:56.800 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f69a359e700 1 -- 172.21.15.146:0/647119788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a413aa80 con 0x7f69a40be560 2021-01-27T09:44:56.800 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f699affd700 1 -- 172.21.15.146:0/647119788 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c00ab10 con 0x7f69a40be560 2021-01-27T09:44:56.800 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f69a359e700 1 -- 172.21.15.146:0/647119788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a414ebf0 con 0x7f69a40be560 2021-01-27T09:44:56.800 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.789+0000 7f69a359e700 1 -- 172.21.15.146:0/647119788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f69a406a190 con 0x7f69a40be560 2021-01-27T09:44:56.802 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.793+0000 7f699affd700 1 -- 172.21.15.146:0/647119788 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f699c019030 con 0x7f69a40be560 2021-01-27T09:44:56.802 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.793+0000 7f699affd700 1 --2- 172.21.15.146:0/647119788 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f69880561e0 0x7f69880586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.802 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.793+0000 7f699affd700 1 -- 172.21.15.146:0/647119788 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f699c003030 con 0x7f69a40be560 2021-01-27T09:44:56.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.793+0000 7f699affd700 1 --2- 172.21.15.146:0/647119788 >> [v2:172.21.15.78:6816/15826,v1:172.21.15.78:6817/15826] conn(0x7f698805e3d0 0x7f6988060870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:56.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.793+0000 7f69a259c700 1 --2- 172.21.15.146:0/647119788 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f69880561e0 0x7f69880586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.793+0000 7f699affd700 1 -- 172.21.15.146:0/647119788 --> [v2:172.21.15.78:6816/15826,v1:172.21.15.78:6817/15826] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6988060ef0 con 0x7f698805e3d0 2021-01-27T09:44:56.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.793+0000 7f699affd700 1 -- 172.21.15.146:0/647119788 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f699c06f840 con 0x7f69a40be560 2021-01-27T09:44:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.797+0000 7f6999d9b700 1 --2- 172.21.15.146:0/647119788 >> [v2:172.21.15.78:6816/15826,v1:172.21.15.78:6817/15826] conn(0x7f698805e3d0 0x7f6988060870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.797+0000 7f69a259c700 1 --2- 172.21.15.146:0/647119788 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f69880561e0 0x7f69880586a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f699400b1d0 tx=0x7f6994016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.797+0000 7f6999d9b700 1 --2- 172.21.15.146:0/647119788 >> [v2:172.21.15.78:6816/15826,v1:172.21.15.78:6817/15826] conn(0x7f698805e3d0 0x7f6988060870 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.797+0000 7f699affd700 1 -- 172.21.15.146:0/647119788 <== osd.4 v2:172.21.15.78:6816/15826 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f6988060ef0 con 0x7f698805e3d0 2021-01-27T09:44:56.817 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:56.813+0000 7f69a359e700 1 -- 172.21.15.146:0/647119788 --> [v2:172.21.15.78:6816/15826,v1:172.21.15.78:6817/15826] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f69a4044680 con 0x7f698805e3d0 2021-01-27T09:44:57.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.013+0000 7f699affd700 1 -- 172.21.15.146:0/647119788 <== osd.4 v2:172.21.15.78:6816/15826 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f69a4044680 con 0x7f698805e3d0 2021-01-27T09:44:57.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.017+0000 7f69a359e700 1 -- 172.21.15.146:0/647119788 >> [v2:172.21.15.78:6816/15826,v1:172.21.15.78:6817/15826] conn(0x7f698805e3d0 msgr2=0x7f6988060870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.017+0000 7f69a359e700 1 --2- 172.21.15.146:0/647119788 >> [v2:172.21.15.78:6816/15826,v1:172.21.15.78:6817/15826] conn(0x7f698805e3d0 0x7f6988060870 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.019 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.017+0000 7f69a359e700 1 -- 172.21.15.146:0/647119788 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f69880561e0 msgr2=0x7f69880586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.019 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.017+0000 7f69a359e700 1 --2- 172.21.15.146:0/647119788 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f69880561e0 0x7f69880586a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f699400b1d0 tx=0x7f6994016000).stop 2021-01-27T09:44:57.019 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.017+0000 7f69a359e700 1 -- 172.21.15.146:0/647119788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69a40be560 msgr2=0x7f69a4160d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.017+0000 7f69a359e700 1 --2- 172.21.15.146:0/647119788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69a40be560 0x7f69a4160d50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f699c0012e0 tx=0x7f699c007f20).stop 2021-01-27T09:44:57.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.017+0000 7f69a2d9d700 1 -- 172.21.15.146:0/647119788 reap_dead start 2021-01-27T09:44:57.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.017+0000 7f69a359e700 1 -- 172.21.15.146:0/647119788 shutdown_connections 2021-01-27T09:44:57.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.017+0000 7f69a359e700 1 -- 172.21.15.146:0/647119788 >> 172.21.15.146:0/647119788 conn(0x7f69a40bf4c0 msgr2=0x7f69a4066ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:57.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.017+0000 7f69a359e700 1 -- 172.21.15.146:0/647119788 shutdown_connections 2021-01-27T09:44:57.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.017+0000 7f69a359e700 1 -- 172.21.15.146:0/647119788 wait complete. 2021-01-27T09:44:57.047 INFO:teuthology.orchestra.run.smithi146.stdout:60129542152 2021-01-27T09:44:57.048 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2021-01-27T09:44:57.218 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.213+0000 7ffaa9574700 1 Processor -- start 2021-01-27T09:44:57.219 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.217+0000 7ffaa9574700 1 -- start start 2021-01-27T09:44:57.219 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.217+0000 7ffaa9574700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffaa40a8110 0x7ffaa40baa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.220 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.217+0000 7ffaa9574700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffaa414aaf0 0x7ffaa414eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.220 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.217+0000 7ffaa9574700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa414ba90 con 0x7ffaa40a84f0 2021-01-27T09:44:57.220 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.217+0000 7ffaa9574700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa4066770 con 0x7ffaa40a8110 2021-01-27T09:44:57.220 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.217+0000 7ffaa9574700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa40b6f10 con 0x7ffaa414aaf0 2021-01-27T09:44:57.221 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.217+0000 7ffaa27fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ffaa40a84f0 0x7ffaa4066050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46342/0 (socket says 172.21.15.146:46342) 2021-01-27T09:44:57.222 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.217+0000 7ffaa27fc700 1 -- 172.21.15.146:0/3376386583 learned_addr learned my addr 172.21.15.146:0/3376386583 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:57.222 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.217+0000 7ffaa3fff700 1 --2- 172.21.15.146:0/3376386583 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffaa414aaf0 0x7ffaa414eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.222 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.217+0000 7ffaa2ffd700 1 --2- 172.21.15.146:0/3376386583 >> v2:172.21.15.146:3300/0 conn(0x7ffaa40a8110 0x7ffaa40baa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.222 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.217+0000 7ffaa1ffb700 1 -- 172.21.15.146:0/3376386583 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403745136 0 0) 0x7ffaa414ba90 con 0x7ffaa40a84f0 2021-01-27T09:44:57.222 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.217+0000 7ffaa1ffb700 1 -- 172.21.15.146:0/3376386583 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa90003270 con 0x7ffaa40a84f0 2021-01-27T09:44:57.223 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.217+0000 7ffaa3fff700 1 -- 172.21.15.146:0/3376386583 >> v2:172.21.15.146:3300/0 conn(0x7ffaa40a8110 msgr2=0x7ffaa40baa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:57.223 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.217+0000 7ffaa3fff700 1 --2- 172.21.15.146:0/3376386583 >> v2:172.21.15.146:3300/0 conn(0x7ffaa40a8110 0x7ffaa40baa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.223 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.217+0000 7ffaa3fff700 1 -- 172.21.15.146:0/3376386583 >> v1:172.21.15.146:6789/0 conn(0x7ffaa40a84f0 legacy=0x7ffaa4066050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.223 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.217+0000 7ffaa3fff700 1 -- 172.21.15.146:0/3376386583 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa40b6ce0 con 0x7ffaa414aaf0 2021-01-27T09:44:57.224 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.217+0000 7ffaa2ffd700 1 --2- 172.21.15.146:0/3376386583 >> v2:172.21.15.146:3300/0 conn(0x7ffaa40a8110 0x7ffaa40baa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:44:57.225 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.221+0000 7ffaa3fff700 1 --2- 172.21.15.146:0/3376386583 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffaa414aaf0 0x7ffaa414eb40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7ffa9c009cc0 tx=0x7ffa9c009220).ready entity=mon.2 client_cookie=b71c30d3db25624c server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:57.225 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.221+0000 7ffaa1ffb700 1 -- 172.21.15.146:0/3376386583 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c00ba10 con 0x7ffaa414aaf0 2021-01-27T09:44:57.226 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.221+0000 7ffaa1ffb700 1 -- 172.21.15.146:0/3376386583 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c00bb70 con 0x7ffaa414aaf0 2021-01-27T09:44:57.226 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.221+0000 7ffaa1ffb700 1 -- 172.21.15.146:0/3376386583 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c011400 con 0x7ffaa414aaf0 2021-01-27T09:44:57.226 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.221+0000 7ffaa9574700 1 -- 172.21.15.146:0/3376386583 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffaa414aaf0 msgr2=0x7ffaa414eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.226 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.221+0000 7ffaa9574700 1 --2- 172.21.15.146:0/3376386583 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffaa414aaf0 0x7ffaa414eb40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7ffa9c009cc0 tx=0x7ffa9c009220).stop 2021-01-27T09:44:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.221+0000 7ffaa9574700 1 -- 172.21.15.146:0/3376386583 shutdown_connections 2021-01-27T09:44:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.221+0000 7ffaa9574700 1 --2- 172.21.15.146:0/3376386583 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffaa414aaf0 0x7ffaa414eb40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.221+0000 7ffaa9574700 1 --2- 172.21.15.146:0/3376386583 >> v2:172.21.15.146:3300/0 conn(0x7ffaa40a8110 0x7ffaa40baa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.221+0000 7ffaa9574700 1 -- 172.21.15.146:0/3376386583 >> 172.21.15.146:0/3376386583 conn(0x7ffaa40634c0 msgr2=0x7ffaa40638a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.221+0000 7ffaa9574700 1 -- 172.21.15.146:0/3376386583 shutdown_connections 2021-01-27T09:44:57.228 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.221+0000 7ffaa9574700 1 -- 172.21.15.146:0/3376386583 wait complete. 2021-01-27T09:44:57.228 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.225+0000 7ffaa9574700 1 Processor -- start 2021-01-27T09:44:57.229 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.225+0000 7ffaa9574700 1 -- start start 2021-01-27T09:44:57.229 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.225+0000 7ffaa9574700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffaa40a8110 0x7ffaa4064610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.229 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.225+0000 7ffaa9574700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa40a84f0 0x7ffaa415aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.229 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.225+0000 7ffaa9574700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaa414aaf0 0x7ffaa415b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.230 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.225+0000 7ffaa9574700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa415b8d0 con 0x7ffaa414aaf0 2021-01-27T09:44:57.230 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.225+0000 7ffaa9574700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa414c880 con 0x7ffaa40a84f0 2021-01-27T09:44:57.230 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.225+0000 7ffaa9574700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa4144350 con 0x7ffaa40a8110 2021-01-27T09:44:57.232 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.225+0000 7ffaa27fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa40a84f0 0x7ffaa415aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.232 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.225+0000 7ffaa2ffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffaa40a8110 0x7ffaa4064610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.232 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.225+0000 7ffaa27fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa40a84f0 0x7ffaa415aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46780/0 (socket says 172.21.15.146:46780) 2021-01-27T09:44:57.232 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.225+0000 7ffaa27fc700 1 -- 172.21.15.146:0/4037872730 learned_addr learned my addr 172.21.15.146:0/4037872730 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:57.233 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.225+0000 7ffaa3fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaa414aaf0 0x7ffaa415b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.233 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.229+0000 7ffaa27fc700 1 -- 172.21.15.146:0/4037872730 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffaa40a8110 msgr2=0x7ffaa4064610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.233 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.229+0000 7ffaa27fc700 1 --2- 172.21.15.146:0/4037872730 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffaa40a8110 0x7ffaa4064610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.234 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.229+0000 7ffaa27fc700 1 -- 172.21.15.146:0/4037872730 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaa414aaf0 msgr2=0x7ffaa415b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.234 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.229+0000 7ffaa27fc700 1 --2- 172.21.15.146:0/4037872730 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaa414aaf0 0x7ffaa415b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.234 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.229+0000 7ffaa27fc700 1 -- 172.21.15.146:0/4037872730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa4144640 con 0x7ffaa40a84f0 2021-01-27T09:44:57.235 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.229+0000 7ffaa27fc700 1 --2- 172.21.15.146:0/4037872730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa40a84f0 0x7ffaa415aef0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7ffa9800c720 tx=0x7ffa98007ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:57.235 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.229+0000 7ffa8affd700 1 -- 172.21.15.146:0/4037872730 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa980072e0 con 0x7ffaa40a84f0 2021-01-27T09:44:57.235 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.229+0000 7ffa8affd700 1 -- 172.21.15.146:0/4037872730 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa98007440 con 0x7ffaa40a84f0 2021-01-27T09:44:57.235 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.229+0000 7ffa8affd700 1 -- 172.21.15.146:0/4037872730 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa98005830 con 0x7ffaa40a84f0 2021-01-27T09:44:57.235 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.229+0000 7ffaa9574700 1 -- 172.21.15.146:0/4037872730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa41448e0 con 0x7ffaa40a84f0 2021-01-27T09:44:57.236 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.229+0000 7ffaa9574700 1 -- 172.21.15.146:0/4037872730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa40bef10 con 0x7ffaa40a84f0 2021-01-27T09:44:57.237 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.229+0000 7ffaa9574700 1 -- 172.21.15.146:0/4037872730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffaa40653c0 con 0x7ffaa40a84f0 2021-01-27T09:44:57.237 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.233+0000 7ffa8affd700 1 -- 172.21.15.146:0/4037872730 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7ffa98010070 con 0x7ffaa40a84f0 2021-01-27T09:44:57.237 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.233+0000 7ffa8affd700 1 --2- 172.21.15.146:0/4037872730 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ffa840561e0 0x7ffa840586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.238 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.233+0000 7ffa8affd700 1 -- 172.21.15.146:0/4037872730 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7ffa9806ecd0 con 0x7ffaa40a84f0 2021-01-27T09:44:57.238 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.233+0000 7ffa8affd700 1 --2- 172.21.15.146:0/4037872730 >> [v2:172.21.15.78:6800/15827,v1:172.21.15.78:6801/15827] conn(0x7ffa8405e3d0 0x7ffa84060870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.238 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.233+0000 7ffaa2ffd700 1 --2- 172.21.15.146:0/4037872730 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ffa840561e0 0x7ffa840586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.238 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.233+0000 7ffa8affd700 1 -- 172.21.15.146:0/4037872730 --> [v2:172.21.15.78:6800/15827,v1:172.21.15.78:6801/15827] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa84060ef0 con 0x7ffa8405e3d0 2021-01-27T09:44:57.239 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.233+0000 7ffa8affd700 1 -- 172.21.15.146:0/4037872730 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa980712c0 con 0x7ffaa40a84f0 2021-01-27T09:44:57.239 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.233+0000 7ffaa3fff700 1 --2- 172.21.15.146:0/4037872730 >> [v2:172.21.15.78:6800/15827,v1:172.21.15.78:6801/15827] conn(0x7ffa8405e3d0 0x7ffa84060870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.239 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.233+0000 7ffaa2ffd700 1 --2- 172.21.15.146:0/4037872730 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ffa840561e0 0x7ffa840586a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7ffa9400aa50 tx=0x7ffa94008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:57.239 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.233+0000 7ffaa3fff700 1 --2- 172.21.15.146:0/4037872730 >> [v2:172.21.15.78:6800/15827,v1:172.21.15.78:6801/15827] conn(0x7ffa8405e3d0 0x7ffa84060870 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:57.240 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.237+0000 7ffa8affd700 1 -- 172.21.15.146:0/4037872730 <== osd.5 v2:172.21.15.78:6800/15827 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7ffa84060ef0 con 0x7ffa8405e3d0 2021-01-27T09:44:57.255 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.253+0000 7ffaa9574700 1 -- 172.21.15.146:0/4037872730 --> [v2:172.21.15.78:6800/15827,v1:172.21.15.78:6801/15827] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffaa4044ee0 con 0x7ffa8405e3d0 2021-01-27T09:44:57.256 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.253+0000 7ffa8affd700 1 -- 172.21.15.146:0/4037872730 <== osd.5 v2:172.21.15.78:6800/15827 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffaa4044ee0 con 0x7ffa8405e3d0 2021-01-27T09:44:57.258 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.253+0000 7ffaa9574700 1 -- 172.21.15.146:0/4037872730 >> [v2:172.21.15.78:6800/15827,v1:172.21.15.78:6801/15827] conn(0x7ffa8405e3d0 msgr2=0x7ffa84060870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.258 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.253+0000 7ffaa9574700 1 --2- 172.21.15.146:0/4037872730 >> [v2:172.21.15.78:6800/15827,v1:172.21.15.78:6801/15827] conn(0x7ffa8405e3d0 0x7ffa84060870 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.258 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.253+0000 7ffaa9574700 1 -- 172.21.15.146:0/4037872730 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ffa840561e0 msgr2=0x7ffa840586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.258 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.253+0000 7ffaa9574700 1 --2- 172.21.15.146:0/4037872730 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ffa840561e0 0x7ffa840586a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7ffa9400aa50 tx=0x7ffa94008040).stop 2021-01-27T09:44:57.259 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.253+0000 7ffaa9574700 1 -- 172.21.15.146:0/4037872730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa40a84f0 msgr2=0x7ffaa415aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.259 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.253+0000 7ffaa9574700 1 --2- 172.21.15.146:0/4037872730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa40a84f0 0x7ffaa415aef0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7ffa9800c720 tx=0x7ffa98007ad0).stop 2021-01-27T09:44:57.259 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.253+0000 7ffaa3fff700 1 -- 172.21.15.146:0/4037872730 reap_dead start 2021-01-27T09:44:57.259 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.253+0000 7ffaa9574700 1 -- 172.21.15.146:0/4037872730 shutdown_connections 2021-01-27T09:44:57.259 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.253+0000 7ffaa9574700 1 -- 172.21.15.146:0/4037872730 >> 172.21.15.146:0/4037872730 conn(0x7ffaa40634c0 msgr2=0x7ffaa40601e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:57.260 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.253+0000 7ffaa9574700 1 -- 172.21.15.146:0/4037872730 shutdown_connections 2021-01-27T09:44:57.260 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.253+0000 7ffaa9574700 1 -- 172.21.15.146:0/4037872730 wait complete. 2021-01-27T09:44:57.279 INFO:teuthology.orchestra.run.smithi146.stdout:60129542152 2021-01-27T09:44:57.279 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2021-01-27T09:44:57.446 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.445+0000 7fc91a901700 1 Processor -- start 2021-01-27T09:44:57.447 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.445+0000 7fc91a901700 1 -- start start 2021-01-27T09:44:57.448 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.445+0000 7fc91a901700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc90c036840 0x7fc90c04f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.449 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.445+0000 7fc91a901700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc90c04a490 con 0x7fc90c00fff0 2021-01-27T09:44:57.449 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.445+0000 7fc91a901700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc90c04a6c0 con 0x7fc90c00fc10 2021-01-27T09:44:57.449 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.445+0000 7fc91a901700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c04a960 con 0x7fc90c036840 2021-01-27T09:44:57.450 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.445+0000 7fc9198ff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc90c00fc10 0x7fc90c036120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46358/0 (socket says 172.21.15.146:46358) 2021-01-27T09:44:57.450 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.445+0000 7fc9198ff700 1 -- 172.21.15.146:0/3826813100 learned_addr learned my addr 172.21.15.146:0/3826813100 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:57.450 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.445+0000 7fc9190fe700 1 --2- 172.21.15.146:0/3826813100 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc90c036840 0x7fc90c04f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.450 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.445+0000 7fc9188fd700 1 -- 172.21.15.146:0/3826813100 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797177250 0 0) 0x7fc90c04a6c0 con 0x7fc90c00fc10 2021-01-27T09:44:57.451 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.445+0000 7fc9188fd700 1 -- 172.21.15.146:0/3826813100 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8fc003270 con 0x7fc90c00fc10 2021-01-27T09:44:57.454 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.445+0000 7fc9188fd700 1 -- 172.21.15.146:0/3826813100 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629728545 0 0) 0x7fc90c04a490 con 0x7fc90c00fff0 2021-01-27T09:44:57.454 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.445+0000 7fc9188fd700 1 -- 172.21.15.146:0/3826813100 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc90c04a6c0 con 0x7fc90c00fff0 2021-01-27T09:44:57.455 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.445+0000 7fc9188fd700 1 -- 172.21.15.146:0/3826813100 <== mon.1 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1538721262 0 0) 0x7fc8fc003270 con 0x7fc90c00fc10 2021-01-27T09:44:57.455 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.445+0000 7fc9188fd700 1 -- 172.21.15.146:0/3826813100 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc90c036840 msgr2=0x7fc90c04f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:57.455 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.445+0000 7fc9188fd700 1 --2- 172.21.15.146:0/3826813100 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc90c036840 0x7fc90c04f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.455 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.445+0000 7fc9188fd700 1 -- 172.21.15.146:0/3826813100 >> v1:172.21.15.78:6789/0 conn(0x7fc90c00fff0 legacy=0x7fc90c0e7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.456 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.445+0000 7fc9188fd700 1 -- 172.21.15.146:0/3826813100 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c04ecc0 con 0x7fc90c00fc10 2021-01-27T09:44:57.456 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.445+0000 7fc9188fd700 1 -- 172.21.15.146:0/3826813100 <== mon.1 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3890990827 0 0) 0x7fc910001520 con 0x7fc90c00fc10 2021-01-27T09:44:57.456 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.445+0000 7fc9188fd700 1 -- 172.21.15.146:0/3826813100 >> v1:172.21.15.146:6789/0 conn(0x7fc90c00fc10 legacy=0x7fc90c036120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.456 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc9188fd700 1 --2- 172.21.15.146:0/3826813100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8fc0038f0 0x7fc8fc003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.457 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc9188fd700 1 --2- 172.21.15.146:0/3826813100 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc90c036840 0x7fc8fc004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.457 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc9188fd700 1 --2- 172.21.15.146:0/3826813100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8fc004a00 0x7fc8fc004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.457 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc9188fd700 1 -- 172.21.15.146:0/3826813100 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c04a960 con 0x7fc8fc004a00 2021-01-27T09:44:57.457 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc9188fd700 1 -- 172.21.15.146:0/3826813100 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc005370 con 0x7fc8fc0038f0 2021-01-27T09:44:57.458 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc9188fd700 1 -- 172.21.15.146:0/3826813100 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc00b760 con 0x7fc90c036840 2021-01-27T09:44:57.459 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc9190fe700 1 --2- 172.21.15.146:0/3826813100 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc90c036840 0x7fc8fc004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.459 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc9198ff700 1 --2- 172.21.15.146:0/3826813100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8fc0038f0 0x7fc8fc003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.459 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc91a100700 1 --2- 172.21.15.146:0/3826813100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8fc004a00 0x7fc8fc004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.459 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc9190fe700 1 -- 172.21.15.146:0/3826813100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8fc0038f0 msgr2=0x7fc8fc003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:57.460 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc9190fe700 1 --2- 172.21.15.146:0/3826813100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8fc0038f0 0x7fc8fc003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.460 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc9190fe700 1 -- 172.21.15.146:0/3826813100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8fc004a00 msgr2=0x7fc8fc004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:57.460 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc9190fe700 1 --2- 172.21.15.146:0/3826813100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8fc004a00 0x7fc8fc004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.460 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc9190fe700 1 -- 172.21.15.146:0/3826813100 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8fc003270 con 0x7fc90c036840 2021-01-27T09:44:57.461 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc9190fe700 1 --2- 172.21.15.146:0/3826813100 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc90c036840 0x7fc8fc004510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fc90400bc00 tx=0x7fc904006e20).ready entity=mon.2 client_cookie=6c18ec7f803b527b server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:57.461 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc9188fd700 1 -- 172.21.15.146:0/3826813100 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90400b330 con 0x7fc90c036840 2021-01-27T09:44:57.461 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc9188fd700 1 -- 172.21.15.146:0/3826813100 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90400e9a0 con 0x7fc90c036840 2021-01-27T09:44:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc9188fd700 1 -- 172.21.15.146:0/3826813100 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90400ed20 con 0x7fc90c036840 2021-01-27T09:44:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc91a901700 1 -- 172.21.15.146:0/3826813100 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc90c036840 msgr2=0x7fc8fc004510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc91a901700 1 --2- 172.21.15.146:0/3826813100 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc90c036840 0x7fc8fc004510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fc90400bc00 tx=0x7fc904006e20).stop 2021-01-27T09:44:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc91a100700 1 -- 172.21.15.146:0/3826813100 reap_dead start 2021-01-27T09:44:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc91a901700 1 -- 172.21.15.146:0/3826813100 shutdown_connections 2021-01-27T09:44:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc91a901700 1 -- 172.21.15.146:0/3826813100 >> 172.21.15.146:0/3826813100 conn(0x7fc90c00e990 msgr2=0x7fc90c053c10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc91a901700 1 -- 172.21.15.146:0/3826813100 shutdown_connections 2021-01-27T09:44:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.449+0000 7fc91a901700 1 -- 172.21.15.146:0/3826813100 wait complete. 2021-01-27T09:44:57.466 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.453+0000 7fc91a901700 1 Processor -- start 2021-01-27T09:44:57.467 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.453+0000 7fc91a901700 1 -- start start 2021-01-27T09:44:57.467 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.453+0000 7fc91a901700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc90c0f0290 0x7fc90c0f0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.467 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.453+0000 7fc91a901700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc90c04e060 0x7fc90c0e07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.467 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.453+0000 7fc91a901700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc90c035a20 0x7fc90c0e0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.468 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.453+0000 7fc91a901700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c0f0b60 con 0x7fc90c04e060 2021-01-27T09:44:57.468 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.453+0000 7fc91a901700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c0d9ac0 con 0x7fc90c035a20 2021-01-27T09:44:57.468 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.453+0000 7fc91a901700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c0e11b0 con 0x7fc90c0f0290 2021-01-27T09:44:57.468 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.453+0000 7fc9190fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc90c04e060 0x7fc90c0e07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.469 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.453+0000 7fc91a100700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc90c035a20 0x7fc90c0e0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.469 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.453+0000 7fc9190fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc90c04e060 0x7fc90c0e07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:49674/0 (socket says 172.21.15.146:49674) 2021-01-27T09:44:57.469 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.453+0000 7fc9190fe700 1 -- 172.21.15.146:0/774879396 learned_addr learned my addr 172.21.15.146:0/774879396 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:57.469 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.453+0000 7fc9198ff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc90c0f0290 0x7fc90c0f0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.470 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.457+0000 7fc9190fe700 1 -- 172.21.15.146:0/774879396 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc90c0f0290 msgr2=0x7fc90c0f0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.470 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.457+0000 7fc9190fe700 1 --2- 172.21.15.146:0/774879396 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc90c0f0290 0x7fc90c0f0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.470 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.457+0000 7fc9190fe700 1 -- 172.21.15.146:0/774879396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc90c035a20 msgr2=0x7fc90c0e0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.470 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.457+0000 7fc9190fe700 1 --2- 172.21.15.146:0/774879396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc90c035a20 0x7fc90c0e0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.470 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.457+0000 7fc9190fe700 1 -- 172.21.15.146:0/774879396 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c036f20 con 0x7fc90c04e060 2021-01-27T09:44:57.471 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.457+0000 7fc9190fe700 1 --2- 172.21.15.146:0/774879396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc90c04e060 0x7fc90c0e07d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fc8fc00b8a0 tx=0x7fc904018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:57.471 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.457+0000 7fc901ffb700 1 -- 172.21.15.146:0/774879396 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc904013d60 con 0x7fc90c04e060 2021-01-27T09:44:57.471 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.457+0000 7fc901ffb700 1 -- 172.21.15.146:0/774879396 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90401e420 con 0x7fc90c04e060 2021-01-27T09:44:57.472 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.457+0000 7fc91a901700 1 -- 172.21.15.146:0/774879396 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc90c037150 con 0x7fc90c04e060 2021-01-27T09:44:57.472 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.457+0000 7fc901ffb700 1 -- 172.21.15.146:0/774879396 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90401e7a0 con 0x7fc90c04e060 2021-01-27T09:44:57.472 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.457+0000 7fc91a901700 1 -- 172.21.15.146:0/774879396 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc90c0e0330 con 0x7fc90c04e060 2021-01-27T09:44:57.472 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.457+0000 7fc91a901700 1 -- 172.21.15.146:0/774879396 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc90c0f0f50 con 0x7fc90c04e060 2021-01-27T09:44:57.473 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.461+0000 7fc901ffb700 1 -- 172.21.15.146:0/774879396 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fc90401eb90 con 0x7fc90c04e060 2021-01-27T09:44:57.473 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.461+0000 7fc901ffb700 1 --2- 172.21.15.146:0/774879396 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc8f40561e0 0x7fc8f40586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.473 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.461+0000 7fc901ffb700 1 -- 172.21.15.146:0/774879396 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fc904071ae0 con 0x7fc90c04e060 2021-01-27T09:44:57.473 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.461+0000 7fc901ffb700 1 --2- 172.21.15.146:0/774879396 >> [v2:172.21.15.78:6808/15825,v1:172.21.15.78:6809/15825] conn(0x7fc8f405e3d0 0x7fc8f4060870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.474 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.461+0000 7fc9198ff700 1 --2- 172.21.15.146:0/774879396 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc8f40561e0 0x7fc8f40586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.474 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.461+0000 7fc901ffb700 1 -- 172.21.15.146:0/774879396 --> [v2:172.21.15.78:6808/15825,v1:172.21.15.78:6809/15825] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc8f4060ef0 con 0x7fc8f405e3d0 2021-01-27T09:44:57.474 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.461+0000 7fc901ffb700 1 -- 172.21.15.146:0/774879396 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc904071e60 con 0x7fc90c04e060 2021-01-27T09:44:57.474 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.461+0000 7fc91a100700 1 --2- 172.21.15.146:0/774879396 >> [v2:172.21.15.78:6808/15825,v1:172.21.15.78:6809/15825] conn(0x7fc8f405e3d0 0x7fc8f4060870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.475 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.461+0000 7fc9198ff700 1 --2- 172.21.15.146:0/774879396 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc8f40561e0 0x7fc8f40586a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fc910007270 tx=0x7fc90c04a850).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:57.475 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.465+0000 7fc91a100700 1 --2- 172.21.15.146:0/774879396 >> [v2:172.21.15.78:6808/15825,v1:172.21.15.78:6809/15825] conn(0x7fc8f405e3d0 0x7fc8f4060870 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:57.475 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.465+0000 7fc901ffb700 1 -- 172.21.15.146:0/774879396 <== osd.6 v2:172.21.15.78:6808/15825 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7fc8f4060ef0 con 0x7fc8f405e3d0 2021-01-27T09:44:57.485 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.481+0000 7fc91a901700 1 -- 172.21.15.146:0/774879396 --> [v2:172.21.15.78:6808/15825,v1:172.21.15.78:6809/15825] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc90c0e0170 con 0x7fc8f405e3d0 2021-01-27T09:44:57.486 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.485+0000 7fc901ffb700 1 -- 172.21.15.146:0/774879396 <== osd.6 v2:172.21.15.78:6808/15825 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc90c0e0170 con 0x7fc8f405e3d0 2021-01-27T09:44:57.487 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.485+0000 7fc91a901700 1 -- 172.21.15.146:0/774879396 >> [v2:172.21.15.78:6808/15825,v1:172.21.15.78:6809/15825] conn(0x7fc8f405e3d0 msgr2=0x7fc8f4060870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.487 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.485+0000 7fc91a901700 1 --2- 172.21.15.146:0/774879396 >> [v2:172.21.15.78:6808/15825,v1:172.21.15.78:6809/15825] conn(0x7fc8f405e3d0 0x7fc8f4060870 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.489 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.485+0000 7fc91a901700 1 -- 172.21.15.146:0/774879396 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc8f40561e0 msgr2=0x7fc8f40586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.489 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.485+0000 7fc91a901700 1 --2- 172.21.15.146:0/774879396 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc8f40561e0 0x7fc8f40586a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fc910007270 tx=0x7fc90c04a850).stop 2021-01-27T09:44:57.489 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.485+0000 7fc91a901700 1 -- 172.21.15.146:0/774879396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc90c04e060 msgr2=0x7fc90c0e07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.489 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.485+0000 7fc91a901700 1 --2- 172.21.15.146:0/774879396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc90c04e060 0x7fc90c0e07d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fc8fc00b8a0 tx=0x7fc904018000).stop 2021-01-27T09:44:57.490 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.485+0000 7fc91a100700 1 -- 172.21.15.146:0/774879396 reap_dead start 2021-01-27T09:44:57.490 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.485+0000 7fc91a901700 1 -- 172.21.15.146:0/774879396 shutdown_connections 2021-01-27T09:44:57.490 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.485+0000 7fc91a901700 1 -- 172.21.15.146:0/774879396 >> 172.21.15.146:0/774879396 conn(0x7fc90c00e990 msgr2=0x7fc90c050530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:57.490 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.485+0000 7fc91a901700 1 -- 172.21.15.146:0/774879396 shutdown_connections 2021-01-27T09:44:57.493 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.493+0000 7fc91a901700 1 -- 172.21.15.146:0/774879396 wait complete. 2021-01-27T09:44:57.518 INFO:teuthology.orchestra.run.smithi146.stdout:60129542152 2021-01-27T09:44:57.519 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2021-01-27T09:44:57.686 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.685+0000 7f2fb4773700 1 Processor -- start 2021-01-27T09:44:57.687 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.685+0000 7f2fb4773700 1 -- start start 2021-01-27T09:44:57.690 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.685+0000 7f2fb4773700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2fac0b8610 0x7f2fac14eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.690 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.685+0000 7f2fb4773700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2fac0be0d0 0x7f2fac0be540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.690 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.685+0000 7f2fb4773700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fac0ba700 con 0x7f2fac0b8230 2021-01-27T09:44:57.690 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.685+0000 7f2fb4773700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fac14f020 con 0x7f2fac0be0d0 2021-01-27T09:44:57.691 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.685+0000 7f2fb4773700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac066280 con 0x7f2fac0b8610 2021-01-27T09:44:57.692 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.689+0000 7f2fb250f700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2fac0b8230 0x7f2fac0b9f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:34414/0 (socket says 172.21.15.146:34414) 2021-01-27T09:44:57.692 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.689+0000 7f2fb250f700 1 -- 172.21.15.146:0/1412903501 learned_addr learned my addr 172.21.15.146:0/1412903501 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:57.692 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.689+0000 7f2fb2d10700 1 --2- 172.21.15.146:0/1412903501 >> v2:172.21.15.78:3300/0 conn(0x7f2fac0be0d0 0x7f2fac0be540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.692 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.689+0000 7f2fb1d0e700 1 --2- 172.21.15.146:0/1412903501 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2fac0b8610 0x7f2fac14eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.693 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.689+0000 7f2fb150d700 1 -- 172.21.15.146:0/1412903501 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2841771965 0 0) 0x7f2fac0ba700 con 0x7f2fac0b8230 2021-01-27T09:44:57.693 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.689+0000 7f2fb150d700 1 -- 172.21.15.146:0/1412903501 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f94003270 con 0x7f2fac0b8230 2021-01-27T09:44:57.693 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.689+0000 7f2fb2d10700 1 -- 172.21.15.146:0/1412903501 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2fac0b8610 msgr2=0x7f2fac14eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:57.693 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.689+0000 7f2fb2d10700 1 --2- 172.21.15.146:0/1412903501 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2fac0b8610 0x7f2fac14eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.693 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.689+0000 7f2fb2d10700 1 -- 172.21.15.146:0/1412903501 >> v1:172.21.15.78:6789/0 conn(0x7f2fac0b8230 legacy=0x7f2fac0b9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.694 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.689+0000 7f2fb2d10700 1 -- 172.21.15.146:0/1412903501 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac14acd0 con 0x7f2fac0be0d0 2021-01-27T09:44:57.694 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.689+0000 7f2fb2d10700 1 --2- 172.21.15.146:0/1412903501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fac0be0d0 0x7f2fac0be540 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f2fa4009cc0 tx=0x7f2fa4009220).ready entity=mon.0 client_cookie=a1fa624972ae7770 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:57.695 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.689+0000 7f2fb150d700 1 -- 172.21.15.146:0/1412903501 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa400b9f0 con 0x7f2fac0be0d0 2021-01-27T09:44:57.695 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.689+0000 7f2fb150d700 1 -- 172.21.15.146:0/1412903501 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa400bb50 con 0x7f2fac0be0d0 2021-01-27T09:44:57.695 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.689+0000 7f2fb150d700 1 -- 172.21.15.146:0/1412903501 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4011400 con 0x7f2fac0be0d0 2021-01-27T09:44:57.695 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.693+0000 7f2fb4773700 1 -- 172.21.15.146:0/1412903501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fac0be0d0 msgr2=0x7f2fac0be540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.696 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.693+0000 7f2fb4773700 1 --2- 172.21.15.146:0/1412903501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fac0be0d0 0x7f2fac0be540 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f2fa4009cc0 tx=0x7f2fa4009220).stop 2021-01-27T09:44:57.696 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.693+0000 7f2fb4773700 1 -- 172.21.15.146:0/1412903501 shutdown_connections 2021-01-27T09:44:57.697 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.693+0000 7f2fb4773700 1 --2- 172.21.15.146:0/1412903501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fac0be0d0 0x7f2fac0be540 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.697 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.693+0000 7f2fb4773700 1 --2- 172.21.15.146:0/1412903501 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2fac0b8610 0x7f2fac14eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.697 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.693+0000 7f2fb4773700 1 -- 172.21.15.146:0/1412903501 >> 172.21.15.146:0/1412903501 conn(0x7f2fac069110 msgr2=0x7f2fac067e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:57.698 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.693+0000 7f2fb4773700 1 -- 172.21.15.146:0/1412903501 shutdown_connections 2021-01-27T09:44:57.698 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.693+0000 7f2fb4773700 1 -- 172.21.15.146:0/1412903501 wait complete. 2021-01-27T09:44:57.699 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.693+0000 7f2fb4773700 1 Processor -- start 2021-01-27T09:44:57.699 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.693+0000 7f2fb4773700 1 -- start start 2021-01-27T09:44:57.700 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2fb4773700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2fac0b8230 0x7f2fac1404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.700 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2fb4773700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fac0b8610 0x7f2fac1440c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.700 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2fb4773700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fac0be0d0 0x7f2fac141460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.700 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2fb4773700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac1409a0 con 0x7f2fac0b8610 2021-01-27T09:44:57.700 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2fb4773700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac14d760 con 0x7f2fac0be0d0 2021-01-27T09:44:57.701 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2fb4773700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac15df60 con 0x7f2fac0b8230 2021-01-27T09:44:57.701 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2fb250f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2fac0b8230 0x7f2fac1404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.701 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2fb1d0e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fac0b8610 0x7f2fac1440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.701 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2fb2d10700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fac0be0d0 0x7f2fac141460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.702 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2fb250f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2fac0b8230 0x7f2fac1404b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36300/0 (socket says 172.21.15.146:36300) 2021-01-27T09:44:57.702 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2fb1d0e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fac0b8610 0x7f2fac1440c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:49690/0 (socket says 172.21.15.146:49690) 2021-01-27T09:44:57.702 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2fb250f700 1 -- 172.21.15.146:0/2846637419 learned_addr learned my addr 172.21.15.146:0/2846637419 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:57.703 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2fb250f700 1 -- 172.21.15.146:0/2846637419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fac0be0d0 msgr2=0x7f2fac141460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.703 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2fb250f700 1 --2- 172.21.15.146:0/2846637419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fac0be0d0 0x7f2fac141460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.704 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2fb250f700 1 -- 172.21.15.146:0/2846637419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fac0b8610 msgr2=0x7f2fac1440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.704 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2fb250f700 1 --2- 172.21.15.146:0/2846637419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fac0b8610 0x7f2fac1440c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.704 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2fb250f700 1 -- 172.21.15.146:0/2846637419 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac15e200 con 0x7f2fac0b8230 2021-01-27T09:44:57.704 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2fb2d10700 1 --2- 172.21.15.146:0/2846637419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fac0be0d0 0x7f2fac141460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:57.705 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2fb250f700 1 --2- 172.21.15.146:0/2846637419 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2fac0b8230 0x7f2fac1404b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f2fa800c710 tx=0x7f2fa8007ad0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:57.705 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2f9a7fc700 1 -- 172.21.15.146:0/2846637419 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa80072e0 con 0x7f2fac0b8230 2021-01-27T09:44:57.705 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2f9a7fc700 1 -- 172.21.15.146:0/2846637419 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa8007440 con 0x7f2fac0b8230 2021-01-27T09:44:57.705 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2fb4773700 1 -- 172.21.15.146:0/2846637419 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fac140e60 con 0x7f2fac0b8230 2021-01-27T09:44:57.705 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2f9a7fc700 1 -- 172.21.15.146:0/2846637419 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa80057d0 con 0x7f2fac0b8230 2021-01-27T09:44:57.706 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.697+0000 7f2fb4773700 1 -- 172.21.15.146:0/2846637419 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fac14d990 con 0x7f2fac0b8230 2021-01-27T09:44:57.706 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.701+0000 7f2fb4773700 1 -- 172.21.15.146:0/2846637419 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2fac044ee0 con 0x7f2fac0b8230 2021-01-27T09:44:57.707 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.701+0000 7f2f9a7fc700 1 -- 172.21.15.146:0/2846637419 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f2fa801a060 con 0x7f2fac0b8230 2021-01-27T09:44:57.707 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.705+0000 7f2f9a7fc700 1 --2- 172.21.15.146:0/2846637419 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2f8c056230 0x7f2f8c0586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.707 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.705+0000 7f2f9a7fc700 1 -- 172.21.15.146:0/2846637419 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f2fa806ef60 con 0x7f2fac0b8230 2021-01-27T09:44:57.708 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.705+0000 7f2fb1d0e700 1 --2- 172.21.15.146:0/2846637419 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2f8c056230 0x7f2f8c0586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.708 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.705+0000 7f2f9a7fc700 1 --2- 172.21.15.146:0/2846637419 >> [v2:172.21.15.78:6824/15828,v1:172.21.15.78:6825/15828] conn(0x7f2f8c05e4a0 0x7f2f8c060940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.708 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.705+0000 7f2f9a7fc700 1 -- 172.21.15.146:0/2846637419 --> [v2:172.21.15.78:6824/15828,v1:172.21.15.78:6825/15828] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2f8c060fc0 con 0x7f2f8c05e4a0 2021-01-27T09:44:57.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.705+0000 7f2f9a7fc700 1 -- 172.21.15.146:0/2846637419 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2fa806f250 con 0x7f2fac0b8230 2021-01-27T09:44:57.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.705+0000 7f2fb2d10700 1 --2- 172.21.15.146:0/2846637419 >> [v2:172.21.15.78:6824/15828,v1:172.21.15.78:6825/15828] conn(0x7f2f8c05e4a0 0x7f2f8c060940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.705+0000 7f2fb1d0e700 1 --2- 172.21.15.146:0/2846637419 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2f8c056230 0x7f2f8c0586f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f2fac0bd4e0 tx=0x7f2f9c006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:57.710 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.705+0000 7f2fb2d10700 1 --2- 172.21.15.146:0/2846637419 >> [v2:172.21.15.78:6824/15828,v1:172.21.15.78:6825/15828] conn(0x7f2f8c05e4a0 0x7f2f8c060940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:57.711 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.709+0000 7f2f9a7fc700 1 -- 172.21.15.146:0/2846637419 <== osd.7 v2:172.21.15.78:6824/15828 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f2f8c060fc0 con 0x7f2f8c05e4a0 2021-01-27T09:44:57.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.729+0000 7f2fb4773700 1 -- 172.21.15.146:0/2846637419 --> [v2:172.21.15.78:6824/15828,v1:172.21.15.78:6825/15828] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2fac05c870 con 0x7f2f8c05e4a0 2021-01-27T09:44:57.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.729+0000 7f2f9a7fc700 1 -- 172.21.15.146:0/2846637419 <== osd.7 v2:172.21.15.78:6824/15828 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2fac05c870 con 0x7f2f8c05e4a0 2021-01-27T09:44:57.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.729+0000 7f2fb4773700 1 -- 172.21.15.146:0/2846637419 >> [v2:172.21.15.78:6824/15828,v1:172.21.15.78:6825/15828] conn(0x7f2f8c05e4a0 msgr2=0x7f2f8c060940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.729+0000 7f2fb4773700 1 --2- 172.21.15.146:0/2846637419 >> [v2:172.21.15.78:6824/15828,v1:172.21.15.78:6825/15828] conn(0x7f2f8c05e4a0 0x7f2f8c060940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.729+0000 7f2fb4773700 1 -- 172.21.15.146:0/2846637419 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2f8c056230 msgr2=0x7f2f8c0586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.729+0000 7f2fb4773700 1 --2- 172.21.15.146:0/2846637419 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2f8c056230 0x7f2f8c0586f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f2fac0bd4e0 tx=0x7f2f9c006e20).stop 2021-01-27T09:44:57.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.729+0000 7f2fb4773700 1 -- 172.21.15.146:0/2846637419 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2fac0b8230 msgr2=0x7f2fac1404b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.729+0000 7f2fb4773700 1 --2- 172.21.15.146:0/2846637419 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2fac0b8230 0x7f2fac1404b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f2fa800c710 tx=0x7f2fa8007ad0).stop 2021-01-27T09:44:57.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.729+0000 7f2fb2d10700 1 -- 172.21.15.146:0/2846637419 reap_dead start 2021-01-27T09:44:57.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.729+0000 7f2fb4773700 1 -- 172.21.15.146:0/2846637419 shutdown_connections 2021-01-27T09:44:57.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.729+0000 7f2fb4773700 1 -- 172.21.15.146:0/2846637419 >> 172.21.15.146:0/2846637419 conn(0x7f2fac069110 msgr2=0x7f2fac067e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:57.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.729+0000 7f2fb4773700 1 -- 172.21.15.146:0/2846637419 shutdown_connections 2021-01-27T09:44:57.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.729+0000 7f2fb4773700 1 -- 172.21.15.146:0/2846637419 wait complete. 2021-01-27T09:44:57.763 INFO:teuthology.orchestra.run.smithi146.stdout:60129542152 2021-01-27T09:44:57.764 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-01-27T09:44:57.939 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.937+0000 7fc0a909b700 1 Processor -- start 2021-01-27T09:44:57.939 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.937+0000 7fc0a909b700 1 -- start start 2021-01-27T09:44:57.942 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.937+0000 7fc0a909b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc0a40bdd30 0x7fc0a4065fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.942 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.937+0000 7fc0a909b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc0a4067830 0x7fc0a40b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.942 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.941+0000 7fc0a909b700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a40b1810 con 0x7fc0a40be110 2021-01-27T09:44:57.942 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.941+0000 7fc0a909b700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a4065a90 con 0x7fc0a4067830 2021-01-27T09:44:57.942 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.941+0000 7fc0a909b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40b3f10 con 0x7fc0a40bdd30 2021-01-27T09:44:57.943 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.941+0000 7fc0a2d9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc0a40bdd30 0x7fc0a4065fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.941+0000 7fc09bfff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc0a4067830 0x7fc0a40b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.941+0000 7fc0a2d9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc0a40bdd30 0x7fc0a4065fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36310/0 (socket says 172.21.15.146:36310) 2021-01-27T09:44:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.941+0000 7fc0a2d9d700 1 -- 172.21.15.146:0/3914986362 learned_addr learned my addr 172.21.15.146:0/3914986362 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.941+0000 7fc0a359e700 1 --1- 172.21.15.146:0/3914986362 >> v1:172.21.15.78:6789/0 conn(0x7fc0a40be110 0x7fc0a414de30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:34434/0 (socket says 172.21.15.146:34434) 2021-01-27T09:44:57.945 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.941+0000 7fc0a2d9d700 1 -- 172.21.15.146:0/3914986362 >> v2:172.21.15.78:3300/0 conn(0x7fc0a4067830 msgr2=0x7fc0a40b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:57.945 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.941+0000 7fc0a2d9d700 1 --2- 172.21.15.146:0/3914986362 >> v2:172.21.15.78:3300/0 conn(0x7fc0a4067830 0x7fc0a40b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.945 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.941+0000 7fc0a2d9d700 1 -- 172.21.15.146:0/3914986362 >> v1:172.21.15.78:6789/0 conn(0x7fc0a40be110 legacy=0x7fc0a414de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.945 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.941+0000 7fc0a2d9d700 1 -- 172.21.15.146:0/3914986362 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a40b41b0 con 0x7fc0a40bdd30 2021-01-27T09:44:57.945 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.941+0000 7fc0a259c700 1 -- 172.21.15.146:0/3914986362 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1616299653 0 0) 0x7fc0a40b1810 con 0x7fc0a40be110 2021-01-27T09:44:57.946 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.941+0000 7fc0a2d9d700 1 --2- 172.21.15.146:0/3914986362 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc0a40bdd30 0x7fc0a4065fa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fc094009d90 tx=0x7fc0940092d0).ready entity=mon.2 client_cookie=b6cabf7e169b9d1c server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:57.947 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.941+0000 7fc0a259c700 1 -- 172.21.15.146:0/3914986362 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09400bb90 con 0x7fc0a40bdd30 2021-01-27T09:44:57.947 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.941+0000 7fc0a259c700 1 -- 172.21.15.146:0/3914986362 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09400bcf0 con 0x7fc0a40bdd30 2021-01-27T09:44:57.947 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.941+0000 7fc0a259c700 1 -- 172.21.15.146:0/3914986362 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc094011610 con 0x7fc0a40bdd30 2021-01-27T09:44:57.947 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.941+0000 7fc0a909b700 1 -- 172.21.15.146:0/3914986362 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc0a40bdd30 msgr2=0x7fc0a4065fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.948 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.941+0000 7fc0a909b700 1 --2- 172.21.15.146:0/3914986362 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc0a40bdd30 0x7fc0a4065fa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fc094009d90 tx=0x7fc0940092d0).stop 2021-01-27T09:44:57.948 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.941+0000 7fc0a909b700 1 -- 172.21.15.146:0/3914986362 shutdown_connections 2021-01-27T09:44:57.948 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.941+0000 7fc0a909b700 1 --2- 172.21.15.146:0/3914986362 >> v2:172.21.15.78:3300/0 conn(0x7fc0a4067830 0x7fc0a40b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.948 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.941+0000 7fc0a909b700 1 --2- 172.21.15.146:0/3914986362 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc0a40bdd30 0x7fc0a4065fa0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.949 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.941+0000 7fc0a909b700 1 -- 172.21.15.146:0/3914986362 >> 172.21.15.146:0/3914986362 conn(0x7fc0a4069110 msgr2=0x7fc0a4060860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:57.949 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.945+0000 7fc0a909b700 1 -- 172.21.15.146:0/3914986362 shutdown_connections 2021-01-27T09:44:57.949 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.945+0000 7fc0a909b700 1 -- 172.21.15.146:0/3914986362 wait complete. 2021-01-27T09:44:57.950 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.945+0000 7fc0a909b700 1 Processor -- start 2021-01-27T09:44:57.950 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.945+0000 7fc0a909b700 1 -- start start 2021-01-27T09:44:57.951 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.949+0000 7fc0a909b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a4067830 0x7fc0a414a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.951 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.949+0000 7fc0a909b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc0a40bdd30 0x7fc0a4160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.951 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.949+0000 7fc0a909b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0a40be110 0x7fc0a41610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.952 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.949+0000 7fc0a909b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a41461d0 con 0x7fc0a40be110 2021-01-27T09:44:57.952 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.949+0000 7fc0a909b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a414b750 con 0x7fc0a4067830 2021-01-27T09:44:57.952 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.949+0000 7fc0a909b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a414b250 con 0x7fc0a40bdd30 2021-01-27T09:44:57.952 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.949+0000 7fc09bfff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc0a40bdd30 0x7fc0a4160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.953 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.949+0000 7fc0a2d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a4067830 0x7fc0a414a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.953 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.949+0000 7fc0a359e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0a40be110 0x7fc0a41610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.953 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.949+0000 7fc09bfff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc0a40bdd30 0x7fc0a4160bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36316/0 (socket says 172.21.15.146:36316) 2021-01-27T09:44:57.953 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.949+0000 7fc09bfff700 1 -- 172.21.15.146:0/389456958 learned_addr learned my addr 172.21.15.146:0/389456958 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:57.954 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.949+0000 7fc0a2d9d700 1 -- 172.21.15.146:0/389456958 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc0a40bdd30 msgr2=0x7fc0a4160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.949+0000 7fc0a2d9d700 1 --2- 172.21.15.146:0/389456958 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc0a40bdd30 0x7fc0a4160bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.949+0000 7fc0a2d9d700 1 -- 172.21.15.146:0/389456958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0a40be110 msgr2=0x7fc0a41610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.949+0000 7fc0a2d9d700 1 --2- 172.21.15.146:0/389456958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0a40be110 0x7fc0a41610c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.949+0000 7fc0a2d9d700 1 -- 172.21.15.146:0/389456958 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a40bbab0 con 0x7fc0a4067830 2021-01-27T09:44:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.949+0000 7fc0a2d9d700 1 --2- 172.21.15.146:0/389456958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a4067830 0x7fc0a414a570 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fc0a405ca30 tx=0x7fc094017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:57.956 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.949+0000 7fc09affd700 1 -- 172.21.15.146:0/389456958 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09400bee0 con 0x7fc0a4067830 2021-01-27T09:44:57.956 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.949+0000 7fc09affd700 1 -- 172.21.15.146:0/389456958 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc094009e20 con 0x7fc0a4067830 2021-01-27T09:44:57.956 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.949+0000 7fc0a909b700 1 -- 172.21.15.146:0/389456958 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a414b4b0 con 0x7fc0a4067830 2021-01-27T09:44:57.956 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.949+0000 7fc09affd700 1 -- 172.21.15.146:0/389456958 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09401b830 con 0x7fc0a4067830 2021-01-27T09:44:57.957 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.949+0000 7fc0a909b700 1 -- 172.21.15.146:0/389456958 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a4148bd0 con 0x7fc0a4067830 2021-01-27T09:44:57.957 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.953+0000 7fc0a909b700 1 -- 172.21.15.146:0/389456958 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a4044ee0 con 0x7fc0a4067830 2021-01-27T09:44:57.957 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.953+0000 7fc09affd700 1 -- 172.21.15.146:0/389456958 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fc09400f070 con 0x7fc0a4067830 2021-01-27T09:44:57.958 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.953+0000 7fc09affd700 1 --2- 172.21.15.146:0/389456958 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc0880561b0 0x7fc088058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:57.958 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.953+0000 7fc09affd700 1 -- 172.21.15.146:0/389456958 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fc094070fe0 con 0x7fc0a4067830 2021-01-27T09:44:57.958 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.953+0000 7fc09bfff700 1 --2- 172.21.15.146:0/389456958 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc0880561b0 0x7fc088058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:57.959 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.957+0000 7fc09bfff700 1 --2- 172.21.15.146:0/389456958 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc0880561b0 0x7fc088058670 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fc0a414e640 tx=0x7fc08c006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:57.963 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:57.961+0000 7fc09affd700 1 -- 172.21.15.146:0/389456958 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fc094046560 con 0x7fc0a4067830 2021-01-27T09:44:58.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.101+0000 7fc0a909b700 1 -- 172.21.15.146:0/389456958 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc0a414a340 con 0x7fc0a4067830 2021-01-27T09:44:58.106 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.105+0000 7fc09affd700 1 -- 172.21.15.146:0/389456958 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc094049b40 con 0x7fc0a4067830 2021-01-27T09:44:58.106 INFO:teuthology.orchestra.run.smithi146.stdout:64424509449 2021-01-27T09:44:58.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.105+0000 7fc0a909b700 1 -- 172.21.15.146:0/389456958 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc0880561b0 msgr2=0x7fc088058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:58.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.105+0000 7fc0a909b700 1 --2- 172.21.15.146:0/389456958 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc0880561b0 0x7fc088058670 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fc0a414e640 tx=0x7fc08c006e20).stop 2021-01-27T09:44:58.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.105+0000 7fc0a909b700 1 -- 172.21.15.146:0/389456958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a4067830 msgr2=0x7fc0a414a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:58.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.105+0000 7fc0a909b700 1 --2- 172.21.15.146:0/389456958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a4067830 0x7fc0a414a570 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fc0a405ca30 tx=0x7fc094017000).stop 2021-01-27T09:44:58.110 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.105+0000 7fc0a909b700 1 -- 172.21.15.146:0/389456958 shutdown_connections 2021-01-27T09:44:58.110 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.105+0000 7fc0a909b700 1 --2- 172.21.15.146:0/389456958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0a40be110 0x7fc0a41610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:58.110 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.105+0000 7fc0a909b700 1 --2- 172.21.15.146:0/389456958 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc0a40bdd30 0x7fc0a4160bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:58.110 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.105+0000 7fc0a909b700 1 --2- 172.21.15.146:0/389456958 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc0880561b0 0x7fc088058670 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:58.111 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.105+0000 7fc0a909b700 1 --2- 172.21.15.146:0/389456958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a4067830 0x7fc0a414a570 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:58.111 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.105+0000 7fc0a909b700 1 -- 172.21.15.146:0/389456958 >> 172.21.15.146:0/389456958 conn(0x7fc0a4069110 msgr2=0x7fc0a4066590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:58.111 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.105+0000 7fc0a909b700 1 -- 172.21.15.146:0/389456958 shutdown_connections 2021-01-27T09:44:58.111 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.105+0000 7fc0a909b700 1 -- 172.21.15.146:0/389456958 wait complete. 2021-01-27T09:44:58.134 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.0 2021-01-27T09:44:58.134 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2021-01-27T09:44:58.295 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.293+0000 7f486e06a700 1 Processor -- start 2021-01-27T09:44:58.295 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.293+0000 7f486e06a700 1 -- start start 2021-01-27T09:44:58.297 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.293+0000 7f486e06a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f486814f4c0 0x7f4868067460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:58.297 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.293+0000 7f486e06a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f48680bcba0 0x7f48680be5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:58.298 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.293+0000 7f486e06a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4868152470 con 0x7f4868151fe0 2021-01-27T09:44:58.298 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.293+0000 7f486e06a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4868152710 con 0x7f48680bcba0 2021-01-27T09:44:58.298 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.293+0000 7f486e06a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48681529b0 con 0x7f486814f4c0 2021-01-27T09:44:58.299 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.297+0000 7f486d869700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f48680bcba0 0x7f48680be5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:58.299 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.297+0000 7f486d869700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f48680bcba0 0x7f48680be5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:49714/0 (socket says 172.21.15.146:49714) 2021-01-27T09:44:58.299 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.297+0000 7f486d068700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f486814f4c0 0x7f4868067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:58.299 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.297+0000 7f486d869700 1 -- 172.21.15.146:0/485895032 learned_addr learned my addr 172.21.15.146:0/485895032 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:58.299 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.297+0000 7f486c867700 1 --1- 172.21.15.146:0/485895032 >> v1:172.21.15.146:6789/0 conn(0x7f4868151fe0 0x7f4868067d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46414/0 (socket says 172.21.15.146:46414) 2021-01-27T09:44:58.301 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.297+0000 7f486d869700 1 -- 172.21.15.146:0/485895032 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f486814f4c0 msgr2=0x7f4868067460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:58.301 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.297+0000 7f486d869700 1 --2- 172.21.15.146:0/485895032 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f486814f4c0 0x7f4868067460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:58.301 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.297+0000 7f486d869700 1 -- 172.21.15.146:0/485895032 >> v1:172.21.15.146:6789/0 conn(0x7f4868151fe0 legacy=0x7f4868067d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:58.301 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.297+0000 7f486d869700 1 -- 172.21.15.146:0/485895032 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4868152c50 con 0x7f48680bcba0 2021-01-27T09:44:58.302 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.297+0000 7f486d068700 1 --2- 172.21.15.146:0/485895032 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f486814f4c0 0x7f4868067460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:58.302 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.297+0000 7f486d869700 1 --2- 172.21.15.146:0/485895032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48680bcba0 0x7f48680be5b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f4860009d90 tx=0x7f48600092d0).ready entity=mon.0 client_cookie=c41cf63a0262346b server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:58.302 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.297+0000 7f4857fff700 1 -- 172.21.15.146:0/485895032 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486000bbf0 con 0x7f48680bcba0 2021-01-27T09:44:58.302 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.297+0000 7f4857fff700 1 -- 172.21.15.146:0/485895032 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486000bd50 con 0x7f48680bcba0 2021-01-27T09:44:58.303 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.297+0000 7f4857fff700 1 -- 172.21.15.146:0/485895032 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860011610 con 0x7f48680bcba0 2021-01-27T09:44:58.303 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.297+0000 7f486e06a700 1 -- 172.21.15.146:0/485895032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48680bcba0 msgr2=0x7f48680be5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:58.303 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.297+0000 7f486e06a700 1 --2- 172.21.15.146:0/485895032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48680bcba0 0x7f48680be5b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f4860009d90 tx=0x7f48600092d0).stop 2021-01-27T09:44:58.303 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.297+0000 7f486e06a700 1 -- 172.21.15.146:0/485895032 shutdown_connections 2021-01-27T09:44:58.303 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.297+0000 7f486e06a700 1 --2- 172.21.15.146:0/485895032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48680bcba0 0x7f48680be5b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:58.304 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.297+0000 7f486e06a700 1 --2- 172.21.15.146:0/485895032 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f486814f4c0 0x7f4868067460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:58.304 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.297+0000 7f486e06a700 1 -- 172.21.15.146:0/485895032 >> 172.21.15.146:0/485895032 conn(0x7f48680bf4c0 msgr2=0x7f4868069110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:58.305 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.301+0000 7f486e06a700 1 -- 172.21.15.146:0/485895032 shutdown_connections 2021-01-27T09:44:58.305 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.301+0000 7f486e06a700 1 -- 172.21.15.146:0/485895032 wait complete. 2021-01-27T09:44:58.305 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.301+0000 7f486e06a700 1 Processor -- start 2021-01-27T09:44:58.305 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.301+0000 7f486e06a700 1 -- start start 2021-01-27T09:44:58.306 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.305+0000 7f486e06a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48680bcba0 0x7f4868165060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:58.307 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.305+0000 7f486e06a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f486814f4c0 0x7f48681418b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:58.307 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.305+0000 7f486e06a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48681572e0 0x7f4868140580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:58.307 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.305+0000 7f486e06a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4868141220 con 0x7f486814f4c0 2021-01-27T09:44:58.307 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.305+0000 7f486e06a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486814ee50 con 0x7f48681572e0 2021-01-27T09:44:58.308 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.305+0000 7f486e06a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486814cdd0 con 0x7f48680bcba0 2021-01-27T09:44:58.308 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.305+0000 7f486d869700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48681572e0 0x7f4868140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:58.308 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.305+0000 7f486d869700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48681572e0 0x7f4868140580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46848/0 (socket says 172.21.15.146:46848) 2021-01-27T09:44:58.308 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.305+0000 7f486d869700 1 -- 172.21.15.146:0/3069397037 learned_addr learned my addr 172.21.15.146:0/3069397037 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:58.310 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.305+0000 7f486c867700 1 --2- 172.21.15.146:0/3069397037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f486814f4c0 0x7f48681418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:58.310 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.305+0000 7f486d068700 1 --2- 172.21.15.146:0/3069397037 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48680bcba0 0x7f4868165060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:58.310 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.305+0000 7f486d869700 1 -- 172.21.15.146:0/3069397037 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48680bcba0 msgr2=0x7f4868165060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:58.310 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.305+0000 7f486d869700 1 --2- 172.21.15.146:0/3069397037 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48680bcba0 0x7f4868165060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:58.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.305+0000 7f486d869700 1 -- 172.21.15.146:0/3069397037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f486814f4c0 msgr2=0x7f48681418b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:58.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.305+0000 7f486d869700 1 --2- 172.21.15.146:0/3069397037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f486814f4c0 0x7f48681418b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:58.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.305+0000 7f486d869700 1 -- 172.21.15.146:0/3069397037 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486814e6b0 con 0x7f48681572e0 2021-01-27T09:44:58.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.305+0000 7f486c867700 1 --2- 172.21.15.146:0/3069397037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f486814f4c0 0x7f48681418b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:44:58.312 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.305+0000 7f486d869700 1 --2- 172.21.15.146:0/3069397037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48681572e0 0x7f4868140580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f4860009130 tx=0x7f4860017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:58.312 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.305+0000 7f48557fa700 1 -- 172.21.15.146:0/3069397037 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486000bec0 con 0x7f48681572e0 2021-01-27T09:44:58.312 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.305+0000 7f48557fa700 1 -- 172.21.15.146:0/3069397037 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4860011e70 con 0x7f48681572e0 2021-01-27T09:44:58.313 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.305+0000 7f48557fa700 1 -- 172.21.15.146:0/3069397037 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860010d20 con 0x7f48681572e0 2021-01-27T09:44:58.313 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.305+0000 7f486e06a700 1 -- 172.21.15.146:0/3069397037 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f486814d000 con 0x7f48681572e0 2021-01-27T09:44:58.313 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.305+0000 7f486e06a700 1 -- 172.21.15.146:0/3069397037 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486814ebb0 con 0x7f48681572e0 2021-01-27T09:44:58.314 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.309+0000 7f486e06a700 1 -- 172.21.15.146:0/3069397037 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f486806a190 con 0x7f48681572e0 2021-01-27T09:44:58.314 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.309+0000 7f48557fa700 1 -- 172.21.15.146:0/3069397037 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f486002b070 con 0x7f48681572e0 2021-01-27T09:44:58.314 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.309+0000 7f48557fa700 1 --2- 172.21.15.146:0/3069397037 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f48480561e0 0x7f48480586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:58.315 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.309+0000 7f48557fa700 1 -- 172.21.15.146:0/3069397037 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f48600710e0 con 0x7f48681572e0 2021-01-27T09:44:58.315 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.309+0000 7f486d068700 1 --2- 172.21.15.146:0/3069397037 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f48480561e0 0x7f48480586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:58.315 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.309+0000 7f486d068700 1 --2- 172.21.15.146:0/3069397037 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f48480561e0 0x7f48480586a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f486400bdd0 tx=0x7f4864006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:58.316 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.313+0000 7f48557fa700 1 -- 172.21.15.146:0/3069397037 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f4860046790 con 0x7f48681572e0 2021-01-27T09:44:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.453+0000 7f486e06a700 1 -- 172.21.15.146:0/3069397037 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f486813f900 con 0x7f48681572e0 2021-01-27T09:44:58.457 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.453+0000 7f48557fa700 1 -- 172.21.15.146:0/3069397037 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4860029090 con 0x7f48681572e0 2021-01-27T09:44:58.457 INFO:teuthology.orchestra.run.smithi146.stdout:64424509449 2021-01-27T09:44:58.459 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.457+0000 7f486e06a700 1 -- 172.21.15.146:0/3069397037 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f48480561e0 msgr2=0x7f48480586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:58.459 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.457+0000 7f486e06a700 1 --2- 172.21.15.146:0/3069397037 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f48480561e0 0x7f48480586a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f486400bdd0 tx=0x7f4864006e20).stop 2021-01-27T09:44:58.459 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.457+0000 7f486e06a700 1 -- 172.21.15.146:0/3069397037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48681572e0 msgr2=0x7f4868140580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.457+0000 7f486e06a700 1 --2- 172.21.15.146:0/3069397037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48681572e0 0x7f4868140580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f4860009130 tx=0x7f4860017000).stop 2021-01-27T09:44:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.457+0000 7f486e06a700 1 -- 172.21.15.146:0/3069397037 shutdown_connections 2021-01-27T09:44:58.461 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.457+0000 7f486e06a700 1 --2- 172.21.15.146:0/3069397037 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f48480561e0 0x7f48480586a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:58.461 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.457+0000 7f486e06a700 1 --2- 172.21.15.146:0/3069397037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48681572e0 0x7f4868140580 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:58.461 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.457+0000 7f486e06a700 1 --2- 172.21.15.146:0/3069397037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f486814f4c0 0x7f48681418b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:58.461 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.457+0000 7f486e06a700 1 --2- 172.21.15.146:0/3069397037 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48680bcba0 0x7f4868165060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:58.462 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.457+0000 7f486e06a700 1 -- 172.21.15.146:0/3069397037 >> 172.21.15.146:0/3069397037 conn(0x7f48680bf4c0 msgr2=0x7f4868060870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:58.462 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.457+0000 7f486e06a700 1 -- 172.21.15.146:0/3069397037 shutdown_connections 2021-01-27T09:44:58.462 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.457+0000 7f486e06a700 1 -- 172.21.15.146:0/3069397037 wait complete. 2021-01-27T09:44:58.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.1 2021-01-27T09:44:58.485 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2021-01-27T09:44:58.646 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.645+0000 7f05c4304700 1 Processor -- start 2021-01-27T09:44:58.647 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.645+0000 7f05c4304700 1 -- start start 2021-01-27T09:44:58.649 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.645+0000 7f05c4304700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f05bc0b8610 0x7f05bc14eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:58.649 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.645+0000 7f05c4304700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f05bc0be0d0 0x7f05bc0be540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:58.649 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.645+0000 7f05c4304700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05bc0ba700 con 0x7f05bc0b8230 2021-01-27T09:44:58.649 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.645+0000 7f05c4304700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05bc14f020 con 0x7f05bc0be0d0 2021-01-27T09:44:58.650 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.645+0000 7f05c4304700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc066280 con 0x7f05bc0b8610 2021-01-27T09:44:58.650 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.645+0000 7f05c20a0700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f05bc0b8230 0x7f05bc0b9f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46424/0 (socket says 172.21.15.146:46424) 2021-01-27T09:44:58.651 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.645+0000 7f05c20a0700 1 -- 172.21.15.146:0/1880903095 learned_addr learned my addr 172.21.15.146:0/1880903095 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:58.651 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.645+0000 7f05c28a1700 1 --2- 172.21.15.146:0/1880903095 >> v2:172.21.15.146:3300/0 conn(0x7f05bc0be0d0 0x7f05bc0be540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:58.651 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.645+0000 7f05c189f700 1 --2- 172.21.15.146:0/1880903095 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f05bc0b8610 0x7f05bc14eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:58.651 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.649+0000 7f05c28a1700 1 -- 172.21.15.146:0/1880903095 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f05bc0b8610 msgr2=0x7f05bc14eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:58.652 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.649+0000 7f05c28a1700 1 --2- 172.21.15.146:0/1880903095 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f05bc0b8610 0x7f05bc14eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:58.652 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.649+0000 7f05c28a1700 1 -- 172.21.15.146:0/1880903095 >> v1:172.21.15.146:6789/0 conn(0x7f05bc0b8230 legacy=0x7f05bc0b9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:58.652 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.649+0000 7f05c109e700 1 -- 172.21.15.146:0/1880903095 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3124353216 0 0) 0x7f05bc0ba700 con 0x7f05bc0b8230 2021-01-27T09:44:58.652 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.649+0000 7f05c28a1700 1 -- 172.21.15.146:0/1880903095 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc14acd0 con 0x7f05bc0be0d0 2021-01-27T09:44:58.653 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.649+0000 7f05c28a1700 1 --2- 172.21.15.146:0/1880903095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05bc0be0d0 0x7f05bc0be540 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f05b4009cc0 tx=0x7f05b4009220).ready entity=mon.1 client_cookie=e2af39d13141291 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:58.654 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.649+0000 7f05c109e700 1 -- 172.21.15.146:0/1880903095 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b400baa0 con 0x7f05bc0be0d0 2021-01-27T09:44:58.654 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.649+0000 7f05c109e700 1 -- 172.21.15.146:0/1880903095 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b400bc00 con 0x7f05bc0be0d0 2021-01-27T09:44:58.654 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.649+0000 7f05c109e700 1 -- 172.21.15.146:0/1880903095 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4011400 con 0x7f05bc0be0d0 2021-01-27T09:44:58.654 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.649+0000 7f05c4304700 1 -- 172.21.15.146:0/1880903095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05bc0be0d0 msgr2=0x7f05bc0be540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:58.655 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.649+0000 7f05c4304700 1 --2- 172.21.15.146:0/1880903095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05bc0be0d0 0x7f05bc0be540 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f05b4009cc0 tx=0x7f05b4009220).stop 2021-01-27T09:44:58.655 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.649+0000 7f05c4304700 1 -- 172.21.15.146:0/1880903095 shutdown_connections 2021-01-27T09:44:58.655 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.649+0000 7f05c4304700 1 --2- 172.21.15.146:0/1880903095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05bc0be0d0 0x7f05bc0be540 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:58.655 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.649+0000 7f05c4304700 1 --2- 172.21.15.146:0/1880903095 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f05bc0b8610 0x7f05bc14eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:58.655 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.649+0000 7f05c4304700 1 -- 172.21.15.146:0/1880903095 >> 172.21.15.146:0/1880903095 conn(0x7f05bc069110 msgr2=0x7f05bc067e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:58.656 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.649+0000 7f05c4304700 1 -- 172.21.15.146:0/1880903095 shutdown_connections 2021-01-27T09:44:58.656 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.649+0000 7f05c4304700 1 -- 172.21.15.146:0/1880903095 wait complete. 2021-01-27T09:44:58.658 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.653+0000 7f05c4304700 1 Processor -- start 2021-01-27T09:44:58.658 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.653+0000 7f05c4304700 1 -- start start 2021-01-27T09:44:58.658 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.653+0000 7f05c4304700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05bc0b8230 0x7f05bc155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:58.658 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.653+0000 7f05c4304700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f05bc0b8610 0x7f05bc161090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:58.659 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.653+0000 7f05c4304700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05bc0be0d0 0x7f05bc161580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:58.659 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.653+0000 7f05c4304700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc161a70 con 0x7f05bc0be0d0 2021-01-27T09:44:58.659 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.653+0000 7f05c4304700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc0bc3b0 con 0x7f05bc0b8230 2021-01-27T09:44:58.659 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.653+0000 7f05c4304700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc152a20 con 0x7f05bc0b8610 2021-01-27T09:44:58.660 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.653+0000 7f05c20a0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05bc0b8230 0x7f05bc155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:58.660 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.653+0000 7f05c20a0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05bc0b8230 0x7f05bc155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46858/0 (socket says 172.21.15.146:46858) 2021-01-27T09:44:58.660 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.653+0000 7f05c20a0700 1 -- 172.21.15.146:0/2220021816 learned_addr learned my addr 172.21.15.146:0/2220021816 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:58.660 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.653+0000 7f05c28a1700 1 --2- 172.21.15.146:0/2220021816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05bc0be0d0 0x7f05bc161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:58.660 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.653+0000 7f05c189f700 1 --2- 172.21.15.146:0/2220021816 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f05bc0b8610 0x7f05bc161090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:58.661 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.653+0000 7f05c20a0700 1 -- 172.21.15.146:0/2220021816 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f05bc0b8610 msgr2=0x7f05bc161090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:58.661 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.653+0000 7f05c20a0700 1 --2- 172.21.15.146:0/2220021816 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f05bc0b8610 0x7f05bc161090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:58.661 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.653+0000 7f05c20a0700 1 -- 172.21.15.146:0/2220021816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05bc0be0d0 msgr2=0x7f05bc161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:58.661 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.653+0000 7f05c20a0700 1 --2- 172.21.15.146:0/2220021816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05bc0be0d0 0x7f05bc161580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:58.661 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.657+0000 7f05c20a0700 1 -- 172.21.15.146:0/2220021816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc152cc0 con 0x7f05bc0b8230 2021-01-27T09:44:58.662 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.657+0000 7f05c20a0700 1 --2- 172.21.15.146:0/2220021816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05bc0b8230 0x7f05bc155050 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f05b800c790 tx=0x7f05b8007ce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:58.663 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.657+0000 7f05aa7fc700 1 -- 172.21.15.146:0/2220021816 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b80072e0 con 0x7f05bc0b8230 2021-01-27T09:44:58.663 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.657+0000 7f05aa7fc700 1 -- 172.21.15.146:0/2220021816 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b8007440 con 0x7f05bc0b8230 2021-01-27T09:44:58.663 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.657+0000 7f05aa7fc700 1 -- 172.21.15.146:0/2220021816 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8005830 con 0x7f05bc0b8230 2021-01-27T09:44:58.663 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.657+0000 7f05c4304700 1 -- 172.21.15.146:0/2220021816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05bc160bf0 con 0x7f05bc0b8230 2021-01-27T09:44:58.664 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.657+0000 7f05c4304700 1 -- 172.21.15.146:0/2220021816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05bc0bc7f0 con 0x7f05bc0b8230 2021-01-27T09:44:58.664 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.657+0000 7f05c4304700 1 -- 172.21.15.146:0/2220021816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05bc044ee0 con 0x7f05bc0b8230 2021-01-27T09:44:58.664 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.661+0000 7f05aa7fc700 1 -- 172.21.15.146:0/2220021816 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f05b8010070 con 0x7f05bc0b8230 2021-01-27T09:44:58.665 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.661+0000 7f05aa7fc700 1 --2- 172.21.15.146:0/2220021816 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f059c0561b0 0x7f059c058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:58.665 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.661+0000 7f05aa7fc700 1 -- 172.21.15.146:0/2220021816 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f05b806ec80 con 0x7f05bc0b8230 2021-01-27T09:44:58.665 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.661+0000 7f05c189f700 1 --2- 172.21.15.146:0/2220021816 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f059c0561b0 0x7f059c058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:58.665 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.661+0000 7f05c189f700 1 --2- 172.21.15.146:0/2220021816 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f059c0561b0 0x7f059c058670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f05bc144f90 tx=0x7f05ac006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:58.669 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.665+0000 7f05aa7fc700 1 -- 172.21.15.146:0/2220021816 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f05b8044220 con 0x7f05bc0b8230 2021-01-27T09:44:58.815 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.813+0000 7f05c4304700 1 -- 172.21.15.146:0/2220021816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f05bc14a890 con 0x7f05bc0b8230 2021-01-27T09:44:58.816 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.813+0000 7f05aa7fc700 1 -- 172.21.15.146:0/2220021816 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f05b8047840 con 0x7f05bc0b8230 2021-01-27T09:44:58.816 INFO:teuthology.orchestra.run.smithi146.stdout:64424509449 2021-01-27T09:44:58.820 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.817+0000 7f05c4304700 1 -- 172.21.15.146:0/2220021816 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f059c0561b0 msgr2=0x7f059c058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:58.820 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.817+0000 7f05c4304700 1 --2- 172.21.15.146:0/2220021816 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f059c0561b0 0x7f059c058670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f05bc144f90 tx=0x7f05ac006e20).stop 2021-01-27T09:44:58.820 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.817+0000 7f05c4304700 1 -- 172.21.15.146:0/2220021816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05bc0b8230 msgr2=0x7f05bc155050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:58.820 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.817+0000 7f05c4304700 1 --2- 172.21.15.146:0/2220021816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05bc0b8230 0x7f05bc155050 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f05b800c790 tx=0x7f05b8007ce0).stop 2021-01-27T09:44:58.821 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.817+0000 7f05c4304700 1 -- 172.21.15.146:0/2220021816 shutdown_connections 2021-01-27T09:44:58.821 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.817+0000 7f05c4304700 1 --2- 172.21.15.146:0/2220021816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05bc0be0d0 0x7f05bc161580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:58.821 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.817+0000 7f05c4304700 1 --2- 172.21.15.146:0/2220021816 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f05bc0b8610 0x7f05bc161090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:58.821 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.817+0000 7f05c4304700 1 --2- 172.21.15.146:0/2220021816 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f059c0561b0 0x7f059c058670 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:58.821 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.817+0000 7f05c4304700 1 --2- 172.21.15.146:0/2220021816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05bc0b8230 0x7f05bc155050 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:58.822 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.817+0000 7f05c4304700 1 -- 172.21.15.146:0/2220021816 >> 172.21.15.146:0/2220021816 conn(0x7f05bc069110 msgr2=0x7f05bc0beac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:58.822 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.817+0000 7f05c4304700 1 -- 172.21.15.146:0/2220021816 shutdown_connections 2021-01-27T09:44:58.822 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:58.817+0000 7f05c4304700 1 -- 172.21.15.146:0/2220021816 wait complete. 2021-01-27T09:44:58.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.2 2021-01-27T09:44:58.847 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2021-01-27T09:44:59.007 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.005+0000 7fe1bf168700 1 Processor -- start 2021-01-27T09:44:59.007 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.005+0000 7fe1bf168700 1 -- start start 2021-01-27T09:44:59.009 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.005+0000 7fe1bf168700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe1b80be650 0x7fe1b8066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:59.009 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.005+0000 7fe1bf168700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1b80bec50 0x7fe1b8152df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:59.010 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.005+0000 7fe1bf168700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b8156750 con 0x7fe1b80be270 2021-01-27T09:44:59.010 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.005+0000 7fe1bf168700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b8155f80 con 0x7fe1b80be650 2021-01-27T09:44:59.010 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.005+0000 7fe1bf168700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b8156210 con 0x7fe1b80bec50 2021-01-27T09:44:59.010 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.005+0000 7fe1bcf04700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe1b80be270 0x7fe1b8155860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:34472/0 (socket says 172.21.15.146:34472) 2021-01-27T09:44:59.011 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.005+0000 7fe1bcf04700 1 -- 172.21.15.146:0/1739680137 learned_addr learned my addr 172.21.15.146:0/1739680137 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:59.011 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.005+0000 7fe1b7fff700 1 --2- 172.21.15.146:0/1739680137 >> v2:172.21.15.146:3300/0 conn(0x7fe1b80be650 0x7fe1b8066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:59.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.005+0000 7fe1bd705700 1 --2- 172.21.15.146:0/1739680137 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1b80bec50 0x7fe1b8152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:59.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.009+0000 7fe1b77fe700 1 -- 172.21.15.146:0/1739680137 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513797099 0 0) 0x7fe1b8156750 con 0x7fe1b80be270 2021-01-27T09:44:59.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.009+0000 7fe1b77fe700 1 -- 172.21.15.146:0/1739680137 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe19c003270 con 0x7fe1b80be270 2021-01-27T09:44:59.014 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.009+0000 7fe1b7fff700 1 -- 172.21.15.146:0/1739680137 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1b80bec50 msgr2=0x7fe1b8152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:59.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.009+0000 7fe1b77fe700 1 -- 172.21.15.146:0/1739680137 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3252168599 0 0) 0x7fe19c003270 con 0x7fe1b80be270 2021-01-27T09:44:59.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.009+0000 7fe1b7fff700 1 --2- 172.21.15.146:0/1739680137 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1b80bec50 0x7fe1b8152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.009+0000 7fe1b7fff700 1 -- 172.21.15.146:0/1739680137 >> v1:172.21.15.78:6789/0 conn(0x7fe1b80be270 legacy=0x7fe1b8155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.009+0000 7fe1b7fff700 1 -- 172.21.15.146:0/1739680137 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b81564b0 con 0x7fe1b80be650 2021-01-27T09:44:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.009+0000 7fe1b7fff700 1 --2- 172.21.15.146:0/1739680137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1b80be650 0x7fe1b8066520 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fe1a400b9c0 tx=0x7fe1a4006e20).ready entity=mon.1 client_cookie=15f8704a7b46ed39 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.009+0000 7fe1b77fe700 1 -- 172.21.15.146:0/1739680137 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac001520 con 0x7fe1b80be650 2021-01-27T09:44:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.009+0000 7fe1b77fe700 1 -- 172.21.15.146:0/1739680137 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a4011400 con 0x7fe1b80be650 2021-01-27T09:44:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.009+0000 7fe1b77fe700 1 -- 172.21.15.146:0/1739680137 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4011780 con 0x7fe1b80be650 2021-01-27T09:44:59.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.009+0000 7fe1bf168700 1 -- 172.21.15.146:0/1739680137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1b80be650 msgr2=0x7fe1b8066520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:59.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.009+0000 7fe1bf168700 1 --2- 172.21.15.146:0/1739680137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1b80be650 0x7fe1b8066520 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fe1a400b9c0 tx=0x7fe1a4006e20).stop 2021-01-27T09:44:59.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.009+0000 7fe1bf168700 1 -- 172.21.15.146:0/1739680137 shutdown_connections 2021-01-27T09:44:59.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.009+0000 7fe1bf168700 1 --2- 172.21.15.146:0/1739680137 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1b80bec50 0x7fe1b8152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.009+0000 7fe1bf168700 1 --2- 172.21.15.146:0/1739680137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1b80be650 0x7fe1b8066520 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.009+0000 7fe1bf168700 1 -- 172.21.15.146:0/1739680137 >> 172.21.15.146:0/1739680137 conn(0x7fe1b8069110 msgr2=0x7fe1b8067e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:59.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.009+0000 7fe1bf168700 1 -- 172.21.15.146:0/1739680137 shutdown_connections 2021-01-27T09:44:59.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.009+0000 7fe1bf168700 1 -- 172.21.15.146:0/1739680137 wait complete. 2021-01-27T09:44:59.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.013+0000 7fe1bf168700 1 Processor -- start 2021-01-27T09:44:59.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.013+0000 7fe1bf168700 1 -- start start 2021-01-27T09:44:59.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.013+0000 7fe1bf168700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1b80be270 0x7fe1b8142d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:59.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.013+0000 7fe1bf168700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1b80bec50 0x7fe1b8144630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:59.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.013+0000 7fe1bf168700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b81437e0 0x7fe1b8151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:59.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.013+0000 7fe1bf168700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b81450f0 con 0x7fe1b81437e0 2021-01-27T09:44:59.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.013+0000 7fe1bf168700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b8145fa0 con 0x7fe1b80bec50 2021-01-27T09:44:59.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.013+0000 7fe1bf168700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b81432f0 con 0x7fe1b80be270 2021-01-27T09:44:59.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.013+0000 7fe1b7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1b80bec50 0x7fe1b8144630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:59.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.013+0000 7fe1bcf04700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1b80be270 0x7fe1b8142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:59.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.013+0000 7fe1b7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1b80bec50 0x7fe1b8144630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46874/0 (socket says 172.21.15.146:46874) 2021-01-27T09:44:59.023 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.013+0000 7fe1b7fff700 1 -- 172.21.15.146:0/3460273382 learned_addr learned my addr 172.21.15.146:0/3460273382 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:59.023 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.013+0000 7fe1bd705700 1 --2- 172.21.15.146:0/3460273382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b81437e0 0x7fe1b8151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:59.023 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.017+0000 7fe1b7fff700 1 -- 172.21.15.146:0/3460273382 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1b80be270 msgr2=0x7fe1b8142d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:59.023 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.017+0000 7fe1b7fff700 1 --2- 172.21.15.146:0/3460273382 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1b80be270 0x7fe1b8142d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.023 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.017+0000 7fe1b7fff700 1 -- 172.21.15.146:0/3460273382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b81437e0 msgr2=0x7fe1b8151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:59.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.017+0000 7fe1b7fff700 1 --2- 172.21.15.146:0/3460273382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b81437e0 0x7fe1b8151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.017+0000 7fe1b7fff700 1 -- 172.21.15.146:0/3460273382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b8145320 con 0x7fe1b80bec50 2021-01-27T09:44:59.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.017+0000 7fe1b7fff700 1 --2- 172.21.15.146:0/3460273382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1b80bec50 0x7fe1b8144630 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fe1b8061fd0 tx=0x7fe1a4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:59.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.017+0000 7fe1b4ff9700 1 -- 172.21.15.146:0/3460273382 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4000c90 con 0x7fe1b80bec50 2021-01-27T09:44:59.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.017+0000 7fe1b4ff9700 1 -- 172.21.15.146:0/3460273382 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a4010aa0 con 0x7fe1b80bec50 2021-01-27T09:44:59.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.017+0000 7fe1bf168700 1 -- 172.21.15.146:0/3460273382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b81455c0 con 0x7fe1b80bec50 2021-01-27T09:44:59.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.017+0000 7fe1b4ff9700 1 -- 172.21.15.146:0/3460273382 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4010e40 con 0x7fe1b80bec50 2021-01-27T09:44:59.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.017+0000 7fe1bf168700 1 -- 172.21.15.146:0/3460273382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b8145b00 con 0x7fe1b80bec50 2021-01-27T09:44:59.026 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.017+0000 7fe1bf168700 1 -- 172.21.15.146:0/3460273382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b8044ee0 con 0x7fe1b80bec50 2021-01-27T09:44:59.026 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.017+0000 7fe1b4ff9700 1 -- 172.21.15.146:0/3460273382 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fe1a400f070 con 0x7fe1b80bec50 2021-01-27T09:44:59.027 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.021+0000 7fe1b4ff9700 1 --2- 172.21.15.146:0/3460273382 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe198056210 0x7fe1980586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:59.027 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.021+0000 7fe1b4ff9700 1 -- 172.21.15.146:0/3460273382 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fe1a4070b30 con 0x7fe1b80bec50 2021-01-27T09:44:59.027 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.021+0000 7fe1bcf04700 1 --2- 172.21.15.146:0/3460273382 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe198056210 0x7fe1980586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:59.027 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.021+0000 7fe1bcf04700 1 --2- 172.21.15.146:0/3460273382 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe198056210 0x7fe1980586d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fe1ac000c00 tx=0x7fe1ac0012c0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:59.028 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.025+0000 7fe1b4ff9700 1 -- 172.21.15.146:0/3460273382 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fe1a40460d0 con 0x7fe1b80bec50 2021-01-27T09:44:59.170 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.169+0000 7fe1bf168700 1 -- 172.21.15.146:0/3460273382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe1b805c870 con 0x7fe1b80bec50 2021-01-27T09:44:59.171 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.169+0000 7fe1b4ff9700 1 -- 172.21.15.146:0/3460273382 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe1a40496f0 con 0x7fe1b80bec50 2021-01-27T09:44:59.172 INFO:teuthology.orchestra.run.smithi146.stdout:64424509449 2021-01-27T09:44:59.173 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.169+0000 7fe1bf168700 1 -- 172.21.15.146:0/3460273382 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe198056210 msgr2=0x7fe1980586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:59.173 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.169+0000 7fe1bf168700 1 --2- 172.21.15.146:0/3460273382 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe198056210 0x7fe1980586d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fe1ac000c00 tx=0x7fe1ac0012c0).stop 2021-01-27T09:44:59.174 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.169+0000 7fe1bf168700 1 -- 172.21.15.146:0/3460273382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1b80bec50 msgr2=0x7fe1b8144630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:59.174 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.169+0000 7fe1bf168700 1 --2- 172.21.15.146:0/3460273382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1b80bec50 0x7fe1b8144630 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fe1b8061fd0 tx=0x7fe1a4016000).stop 2021-01-27T09:44:59.174 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.169+0000 7fe1bf168700 1 -- 172.21.15.146:0/3460273382 shutdown_connections 2021-01-27T09:44:59.175 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.169+0000 7fe1bf168700 1 --2- 172.21.15.146:0/3460273382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b81437e0 0x7fe1b8151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.175 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.169+0000 7fe1bf168700 1 --2- 172.21.15.146:0/3460273382 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe198056210 0x7fe1980586d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.175 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.169+0000 7fe1bf168700 1 --2- 172.21.15.146:0/3460273382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1b80bec50 0x7fe1b8144630 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.175 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.169+0000 7fe1bf168700 1 --2- 172.21.15.146:0/3460273382 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe1b80be270 0x7fe1b8142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.176 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.169+0000 7fe1bf168700 1 -- 172.21.15.146:0/3460273382 >> 172.21.15.146:0/3460273382 conn(0x7fe1b8069110 msgr2=0x7fe1b8064360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:59.176 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.173+0000 7fe1bf168700 1 -- 172.21.15.146:0/3460273382 shutdown_connections 2021-01-27T09:44:59.176 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.173+0000 7fe1bf168700 1 -- 172.21.15.146:0/3460273382 wait complete. 2021-01-27T09:44:59.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.3 2021-01-27T09:44:59.202 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2021-01-27T09:44:59.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.361+0000 7fcda8df8700 1 Processor -- start 2021-01-27T09:44:59.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.361+0000 7fcda8df8700 1 -- start start 2021-01-27T09:44:59.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.365+0000 7fcda8df8700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcda40b9a90 0x7fcda40be0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:59.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.365+0000 7fcda8df8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcda40b9e70 0x7fcda40be5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:59.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.365+0000 7fcda8df8700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda40698b0 con 0x7fcda40bcf70 2021-01-27T09:44:59.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.365+0000 7fcda8df8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda414bc80 con 0x7fcda40b9e70 2021-01-27T09:44:59.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.365+0000 7fcda8df8700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda40beab0 con 0x7fcda40b9a90 2021-01-27T09:44:59.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.365+0000 7fcda2d9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fcda40bcf70 0x7fcda40bd400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:34488/0 (socket says 172.21.15.146:34488) 2021-01-27T09:44:59.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.365+0000 7fcda2d9d700 1 -- 172.21.15.146:0/3662443257 learned_addr learned my addr 172.21.15.146:0/3662443257 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:59.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.365+0000 7fcda259c700 1 --2- 172.21.15.146:0/3662443257 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcda40b9a90 0x7fcda40be0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:59.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.365+0000 7fcd9bfff700 1 --2- 172.21.15.146:0/3662443257 >> v2:172.21.15.146:3300/0 conn(0x7fcda40b9e70 0x7fcda40be5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.365+0000 7fcda1d9b700 1 -- 172.21.15.146:0/3662443257 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3301756547 0 0) 0x7fcda40698b0 con 0x7fcda40bcf70 2021-01-27T09:44:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.365+0000 7fcda1d9b700 1 -- 172.21.15.146:0/3662443257 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd84003270 con 0x7fcda40bcf70 2021-01-27T09:44:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.365+0000 7fcd9bfff700 1 -- 172.21.15.146:0/3662443257 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcda40b9a90 msgr2=0x7fcda40be0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.365+0000 7fcd9bfff700 1 --2- 172.21.15.146:0/3662443257 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcda40b9a90 0x7fcda40be0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.365+0000 7fcd9bfff700 1 -- 172.21.15.146:0/3662443257 >> v1:172.21.15.78:6789/0 conn(0x7fcda40bcf70 legacy=0x7fcda40bd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.365+0000 7fcd9bfff700 1 -- 172.21.15.146:0/3662443257 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda414be70 con 0x7fcda40b9e70 2021-01-27T09:44:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.365+0000 7fcd9bfff700 1 --2- 172.21.15.146:0/3662443257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcda40b9e70 0x7fcda40be5c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fcd8c00b9f0 tx=0x7fcd8c006e20).ready entity=mon.1 client_cookie=e3b47dedaea0aadb server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.365+0000 7fcda1d9b700 1 -- 172.21.15.146:0/3662443257 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c009680 con 0x7fcda40b9e70 2021-01-27T09:44:59.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.369+0000 7fcda1d9b700 1 -- 172.21.15.146:0/3662443257 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c0097e0 con 0x7fcda40b9e70 2021-01-27T09:44:59.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.369+0000 7fcda1d9b700 1 -- 172.21.15.146:0/3662443257 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c009b60 con 0x7fcda40b9e70 2021-01-27T09:44:59.373 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.369+0000 7fcda8df8700 1 -- 172.21.15.146:0/3662443257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcda40b9e70 msgr2=0x7fcda40be5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:59.373 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.369+0000 7fcda8df8700 1 --2- 172.21.15.146:0/3662443257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcda40b9e70 0x7fcda40be5c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fcd8c00b9f0 tx=0x7fcd8c006e20).stop 2021-01-27T09:44:59.373 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.369+0000 7fcda8df8700 1 -- 172.21.15.146:0/3662443257 shutdown_connections 2021-01-27T09:44:59.373 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.369+0000 7fcda8df8700 1 --2- 172.21.15.146:0/3662443257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcda40b9e70 0x7fcda40be5c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.374 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.369+0000 7fcda8df8700 1 --2- 172.21.15.146:0/3662443257 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcda40b9a90 0x7fcda40be0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.374 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.369+0000 7fcda8df8700 1 -- 172.21.15.146:0/3662443257 >> 172.21.15.146:0/3662443257 conn(0x7fcda4069110 msgr2=0x7fcda4067e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:59.374 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.369+0000 7fcda8df8700 1 -- 172.21.15.146:0/3662443257 shutdown_connections 2021-01-27T09:44:59.374 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.369+0000 7fcda8df8700 1 -- 172.21.15.146:0/3662443257 wait complete. 2021-01-27T09:44:59.376 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.369+0000 7fcda8df8700 1 Processor -- start 2021-01-27T09:44:59.376 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.369+0000 7fcda8df8700 1 -- start start 2021-01-27T09:44:59.376 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.373+0000 7fcda8df8700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcda40b9a90 0x7fcda4160c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:59.376 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.373+0000 7fcda8df8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcda40b9e70 0x7fcda415dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:59.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.373+0000 7fcda8df8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcda40bcf70 0x7fcda40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:59.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.373+0000 7fcda8df8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda4161b40 con 0x7fcda40b9e70 2021-01-27T09:44:59.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.373+0000 7fcda8df8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda415d610 con 0x7fcda40bcf70 2021-01-27T09:44:59.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.373+0000 7fcda8df8700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda4161110 con 0x7fcda40b9a90 2021-01-27T09:44:59.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.373+0000 7fcda259c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcda40b9a90 0x7fcda4160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:59.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.373+0000 7fcda259c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcda40b9a90 0x7fcda4160c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36374/0 (socket says 172.21.15.146:36374) 2021-01-27T09:44:59.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.373+0000 7fcda259c700 1 -- 172.21.15.146:0/2060931298 learned_addr learned my addr 172.21.15.146:0/2060931298 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:59.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.373+0000 7fcd9bfff700 1 --2- 172.21.15.146:0/2060931298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcda40b9e70 0x7fcda415dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:59.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.373+0000 7fcda2d9d700 1 --2- 172.21.15.146:0/2060931298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcda40bcf70 0x7fcda40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:59.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.373+0000 7fcda259c700 1 -- 172.21.15.146:0/2060931298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcda40bcf70 msgr2=0x7fcda40b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:59.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.373+0000 7fcda259c700 1 --2- 172.21.15.146:0/2060931298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcda40bcf70 0x7fcda40b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.373+0000 7fcda259c700 1 -- 172.21.15.146:0/2060931298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcda40b9e70 msgr2=0x7fcda415dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:59.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.373+0000 7fcda259c700 1 --2- 172.21.15.146:0/2060931298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcda40b9e70 0x7fcda415dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.373+0000 7fcda259c700 1 -- 172.21.15.146:0/2060931298 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda4161360 con 0x7fcda40b9a90 2021-01-27T09:44:59.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.373+0000 7fcd9bfff700 1 --2- 172.21.15.146:0/2060931298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcda40b9e70 0x7fcda415dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:44:59.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.373+0000 7fcda259c700 1 --2- 172.21.15.146:0/2060931298 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcda40b9a90 0x7fcda4160c20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fcd9400ec00 tx=0x7fcd94006e20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:59.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.373+0000 7fcd9a7fc700 1 -- 172.21.15.146:0/2060931298 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9400c7f0 con 0x7fcda40b9a90 2021-01-27T09:44:59.384 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.373+0000 7fcd9a7fc700 1 -- 172.21.15.146:0/2060931298 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9400c950 con 0x7fcda40b9a90 2021-01-27T09:44:59.385 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.373+0000 7fcda8df8700 1 -- 172.21.15.146:0/2060931298 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda4161600 con 0x7fcda40b9a90 2021-01-27T09:44:59.385 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.373+0000 7fcd9a7fc700 1 -- 172.21.15.146:0/2060931298 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9400ccd0 con 0x7fcda40b9a90 2021-01-27T09:44:59.385 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.377+0000 7fcda8df8700 1 -- 172.21.15.146:0/2060931298 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda415d860 con 0x7fcda40b9a90 2021-01-27T09:44:59.385 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.377+0000 7fcda8df8700 1 -- 172.21.15.146:0/2060931298 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda4044ee0 con 0x7fcda40b9a90 2021-01-27T09:44:59.386 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.377+0000 7fcd9a7fc700 1 -- 172.21.15.146:0/2060931298 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fcd9401b410 con 0x7fcda40b9a90 2021-01-27T09:44:59.387 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.377+0000 7fcd9a7fc700 1 --2- 172.21.15.146:0/2060931298 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcd88056210 0x7fcd880586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:59.387 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.377+0000 7fcd9a7fc700 1 -- 172.21.15.146:0/2060931298 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fcd9406f450 con 0x7fcda40b9a90 2021-01-27T09:44:59.387 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.381+0000 7fcd9bfff700 1 --2- 172.21.15.146:0/2060931298 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcd88056210 0x7fcd880586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:59.387 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.381+0000 7fcd9bfff700 1 --2- 172.21.15.146:0/2060931298 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcd88056210 0x7fcd880586d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fcd8c00b9f0 tx=0x7fcd8c016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:59.393 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.389+0000 7fcd9a7fc700 1 -- 172.21.15.146:0/2060931298 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fcd94044990 con 0x7fcda40b9a90 2021-01-27T09:44:59.537 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.533+0000 7fcda8df8700 1 -- 172.21.15.146:0/2060931298 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fcda40bc9e0 con 0x7fcda40b9a90 2021-01-27T09:44:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.537+0000 7fcd9a7fc700 1 -- 172.21.15.146:0/2060931298 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcd94047fb0 con 0x7fcda40b9a90 2021-01-27T09:44:59.539 INFO:teuthology.orchestra.run.smithi146.stdout:60129542153 2021-01-27T09:44:59.541 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.537+0000 7fcda8df8700 1 -- 172.21.15.146:0/2060931298 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcd88056210 msgr2=0x7fcd880586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:59.541 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.537+0000 7fcda8df8700 1 --2- 172.21.15.146:0/2060931298 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcd88056210 0x7fcd880586d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fcd8c00b9f0 tx=0x7fcd8c016000).stop 2021-01-27T09:44:59.541 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.537+0000 7fcda8df8700 1 -- 172.21.15.146:0/2060931298 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcda40b9a90 msgr2=0x7fcda4160c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:59.542 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.537+0000 7fcda8df8700 1 --2- 172.21.15.146:0/2060931298 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcda40b9a90 0x7fcda4160c20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fcd9400ec00 tx=0x7fcd94006e20).stop 2021-01-27T09:44:59.542 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.537+0000 7fcda8df8700 1 -- 172.21.15.146:0/2060931298 shutdown_connections 2021-01-27T09:44:59.542 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.537+0000 7fcda8df8700 1 --2- 172.21.15.146:0/2060931298 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fcd88056210 0x7fcd880586d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.542 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.537+0000 7fcda8df8700 1 --2- 172.21.15.146:0/2060931298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcda40bcf70 0x7fcda40b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.542 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.537+0000 7fcda8df8700 1 --2- 172.21.15.146:0/2060931298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcda40b9e70 0x7fcda415dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.543 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.537+0000 7fcda8df8700 1 --2- 172.21.15.146:0/2060931298 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcda40b9a90 0x7fcda4160c20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.543 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.537+0000 7fcda8df8700 1 -- 172.21.15.146:0/2060931298 >> 172.21.15.146:0/2060931298 conn(0x7fcda4069110 msgr2=0x7fcda41337f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:59.543 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.537+0000 7fcda8df8700 1 -- 172.21.15.146:0/2060931298 shutdown_connections 2021-01-27T09:44:59.543 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.537+0000 7fcda8df8700 1 -- 172.21.15.146:0/2060931298 wait complete. 2021-01-27T09:44:59.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542153 for osd.4 2021-01-27T09:44:59.568 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2021-01-27T09:44:59.743 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.741+0000 7f472d158700 1 Processor -- start 2021-01-27T09:44:59.743 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.741+0000 7f472d158700 1 -- start start 2021-01-27T09:44:59.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.741+0000 7f472d158700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4728067830 0x7f4728065fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:59.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.741+0000 7f472d158700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f47280be110 0x7f47280b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:59.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.741+0000 7f472d158700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47280b1810 con 0x7f47280bdd30 2021-01-27T09:44:59.746 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.741+0000 7f472d158700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4728065a90 con 0x7f47280be110 2021-01-27T09:44:59.746 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.741+0000 7f472d158700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47280b3f10 con 0x7f4728067830 2021-01-27T09:44:59.746 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.741+0000 7f472759e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f47280be110 0x7f47280b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:59.747 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.741+0000 7f472659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4728067830 0x7f4728065fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:59.747 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.741+0000 7f4726d9d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f47280bdd30 0x7f472814de30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:34500/0 (socket says 172.21.15.146:34500) 2021-01-27T09:44:59.747 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.745+0000 7f4726d9d700 1 -- 172.21.15.146:0/2159807454 learned_addr learned my addr 172.21.15.146:0/2159807454 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:44:59.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.745+0000 7f472759e700 1 -- 172.21.15.146:0/2159807454 >> v2:172.21.15.146:3300/0 conn(0x7f4728067830 msgr2=0x7f4728065fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:44:59.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.745+0000 7f472759e700 1 --2- 172.21.15.146:0/2159807454 >> v2:172.21.15.146:3300/0 conn(0x7f4728067830 0x7f4728065fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.745+0000 7f472759e700 1 -- 172.21.15.146:0/2159807454 >> v1:172.21.15.78:6789/0 conn(0x7f47280bdd30 legacy=0x7f472814de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:59.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.745+0000 7f4725d9b700 1 -- 172.21.15.146:0/2159807454 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897426494 0 0) 0x7f47280b1810 con 0x7f47280bdd30 2021-01-27T09:44:59.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.745+0000 7f472759e700 1 -- 172.21.15.146:0/2159807454 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47280b41b0 con 0x7f47280be110 2021-01-27T09:44:59.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.745+0000 7f472759e700 1 --2- 172.21.15.146:0/2159807454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47280be110 0x7f47280b1320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f4728066490 tx=0x7f4720009220).ready entity=mon.0 client_cookie=67aa77db329d68e2 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:59.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.745+0000 7f4725d9b700 1 -- 172.21.15.146:0/2159807454 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472000b9e0 con 0x7f47280be110 2021-01-27T09:44:59.750 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.745+0000 7f4725d9b700 1 -- 172.21.15.146:0/2159807454 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472000bb40 con 0x7f47280be110 2021-01-27T09:44:59.750 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.745+0000 7f4725d9b700 1 -- 172.21.15.146:0/2159807454 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720011400 con 0x7f47280be110 2021-01-27T09:44:59.751 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.745+0000 7f472d158700 1 -- 172.21.15.146:0/2159807454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47280be110 msgr2=0x7f47280b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:59.751 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.745+0000 7f472d158700 1 --2- 172.21.15.146:0/2159807454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47280be110 0x7f47280b1320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f4728066490 tx=0x7f4720009220).stop 2021-01-27T09:44:59.751 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.745+0000 7f472d158700 1 -- 172.21.15.146:0/2159807454 shutdown_connections 2021-01-27T09:44:59.751 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.745+0000 7f472d158700 1 --2- 172.21.15.146:0/2159807454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47280be110 0x7f47280b1320 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.752 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.745+0000 7f472d158700 1 --2- 172.21.15.146:0/2159807454 >> v2:172.21.15.146:3300/0 conn(0x7f4728067830 0x7f4728065fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.752 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.745+0000 7f472d158700 1 -- 172.21.15.146:0/2159807454 >> 172.21.15.146:0/2159807454 conn(0x7f4728069110 msgr2=0x7f4728060860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:59.752 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.745+0000 7f472d158700 1 -- 172.21.15.146:0/2159807454 shutdown_connections 2021-01-27T09:44:59.753 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.749+0000 7f472d158700 1 -- 172.21.15.146:0/2159807454 wait complete. 2021-01-27T09:44:59.753 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.749+0000 7f472d158700 1 Processor -- start 2021-01-27T09:44:59.753 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.749+0000 7f472d158700 1 -- start start 2021-01-27T09:44:59.755 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.753+0000 7f472d158700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4728067830 0x7f472814be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:59.755 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.753+0000 7f472d158700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f47280bdd30 0x7f472814f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:59.755 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.753+0000 7f472d158700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47280be110 0x7f4728151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:59.755 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.753+0000 7f472d158700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4728151480 con 0x7f4728067830 2021-01-27T09:44:59.755 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.753+0000 7f472d158700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47281463b0 con 0x7f47280be110 2021-01-27T09:44:59.756 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.753+0000 7f472d158700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4728146650 con 0x7f47280bdd30 2021-01-27T09:44:59.756 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.753+0000 7f472759e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47280be110 0x7f4728151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:59.756 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.753+0000 7f4726d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4728067830 0x7f472814be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:59.756 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.753+0000 7f472659c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f47280bdd30 0x7f472814f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:59.757 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.753+0000 7f4726d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4728067830 0x7f472814be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:49774/0 (socket says 172.21.15.146:49774) 2021-01-27T09:44:59.757 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.753+0000 7f4726d9d700 1 -- 172.21.15.146:0/3393947361 learned_addr learned my addr 172.21.15.146:0/3393947361 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:44:59.758 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.753+0000 7f472759e700 1 -- 172.21.15.146:0/3393947361 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f47280bdd30 msgr2=0x7f472814f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:59.758 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.753+0000 7f472759e700 1 --2- 172.21.15.146:0/3393947361 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f47280bdd30 0x7f472814f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.758 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.753+0000 7f472759e700 1 -- 172.21.15.146:0/3393947361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4728067830 msgr2=0x7f472814be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:59.759 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.753+0000 7f472759e700 1 --2- 172.21.15.146:0/3393947361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4728067830 0x7f472814be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.759 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.753+0000 7f472759e700 1 -- 172.21.15.146:0/3393947361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4728150ca0 con 0x7f47280be110 2021-01-27T09:44:59.759 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.753+0000 7f472759e700 1 --2- 172.21.15.146:0/3393947361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47280be110 0x7f4728151bd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f4720014000 tx=0x7f4720017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:59.759 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.753+0000 7f470effd700 1 -- 172.21.15.146:0/3393947361 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472001b650 con 0x7f47280be110 2021-01-27T09:44:59.760 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.753+0000 7f470effd700 1 -- 172.21.15.146:0/3393947361 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472001b7f0 con 0x7f47280be110 2021-01-27T09:44:59.760 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.753+0000 7f470effd700 1 -- 172.21.15.146:0/3393947361 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472001bbb0 con 0x7f47280be110 2021-01-27T09:44:59.760 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.753+0000 7f472d158700 1 -- 172.21.15.146:0/3393947361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4728150f40 con 0x7f47280be110 2021-01-27T09:44:59.760 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.753+0000 7f472d158700 1 -- 172.21.15.146:0/3393947361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472814f720 con 0x7f47280be110 2021-01-27T09:44:59.761 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.757+0000 7f472d158700 1 -- 172.21.15.146:0/3393947361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4728044ee0 con 0x7f47280be110 2021-01-27T09:44:59.762 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.757+0000 7f470effd700 1 -- 172.21.15.146:0/3393947361 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f472000f070 con 0x7f47280be110 2021-01-27T09:44:59.762 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.757+0000 7f470effd700 1 --2- 172.21.15.146:0/3393947361 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4708056210 0x7f47080586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:44:59.762 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.757+0000 7f470effd700 1 -- 172.21.15.146:0/3393947361 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f47200712a0 con 0x7f47280be110 2021-01-27T09:44:59.762 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.757+0000 7f4726d9d700 1 --2- 172.21.15.146:0/3393947361 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4708056210 0x7f47080586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:44:59.763 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.757+0000 7f4726d9d700 1 --2- 172.21.15.146:0/3393947361 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4708056210 0x7f47080586d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f4718006600 tx=0x7f4718007af0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:44:59.765 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.761+0000 7f470effd700 1 -- 172.21.15.146:0/3393947361 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f4720046820 con 0x7f47280be110 2021-01-27T09:44:59.908 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.905+0000 7f472d158700 1 -- 172.21.15.146:0/3393947361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f472814b660 con 0x7f47280be110 2021-01-27T09:44:59.909 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.905+0000 7f470effd700 1 -- 172.21.15.146:0/3393947361 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4720049e40 con 0x7f47280be110 2021-01-27T09:44:59.909 INFO:teuthology.orchestra.run.smithi146.stdout:60129542153 2021-01-27T09:44:59.912 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.909+0000 7f472d158700 1 -- 172.21.15.146:0/3393947361 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4708056210 msgr2=0x7f47080586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:59.912 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.909+0000 7f472d158700 1 --2- 172.21.15.146:0/3393947361 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4708056210 0x7f47080586d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f4718006600 tx=0x7f4718007af0).stop 2021-01-27T09:44:59.912 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.909+0000 7f472d158700 1 -- 172.21.15.146:0/3393947361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47280be110 msgr2=0x7f4728151bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:44:59.912 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.909+0000 7f472d158700 1 --2- 172.21.15.146:0/3393947361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47280be110 0x7f4728151bd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f4720014000 tx=0x7f4720017000).stop 2021-01-27T09:44:59.913 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.909+0000 7f472d158700 1 -- 172.21.15.146:0/3393947361 shutdown_connections 2021-01-27T09:44:59.914 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.909+0000 7f472d158700 1 --2- 172.21.15.146:0/3393947361 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4708056210 0x7f47080586d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.914 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.909+0000 7f472d158700 1 --2- 172.21.15.146:0/3393947361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47280be110 0x7f4728151bd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.914 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.909+0000 7f472d158700 1 --2- 172.21.15.146:0/3393947361 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f47280bdd30 0x7f472814f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.914 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.909+0000 7f472d158700 1 --2- 172.21.15.146:0/3393947361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4728067830 0x7f472814be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:44:59.915 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.909+0000 7f472d158700 1 -- 172.21.15.146:0/3393947361 >> 172.21.15.146:0/3393947361 conn(0x7f4728069110 msgr2=0x7f472805bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:44:59.915 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.909+0000 7f472d158700 1 -- 172.21.15.146:0/3393947361 shutdown_connections 2021-01-27T09:44:59.915 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:44:59.909+0000 7f472d158700 1 -- 172.21.15.146:0/3393947361 wait complete. 2021-01-27T09:44:59.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542153 for osd.5 2021-01-27T09:44:59.939 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2021-01-27T09:45:00.114 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.109+0000 7f92bea21700 1 Processor -- start 2021-01-27T09:45:00.115 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.113+0000 7f92bea21700 1 -- start start 2021-01-27T09:45:00.117 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.113+0000 7f92bea21700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f92b80b8150 0x7f92b81474a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:00.118 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.113+0000 7f92bea21700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b80b97b0 con 0x7f92b80b7880 2021-01-27T09:45:00.118 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.113+0000 7f92bea21700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b80b9f20 con 0x7f92b80bea30 2021-01-27T09:45:00.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.113+0000 7f92bea21700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b80b99e0 con 0x7f92b80b8150 2021-01-27T09:45:00.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.113+0000 7f92b77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f92b80b8150 0x7f92b81474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:00.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.117+0000 7f92b7fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f92b80b7880 0x7f92b814a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:34514/0 (socket says 172.21.15.146:34514) 2021-01-27T09:45:00.120 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.117+0000 7f92b7fff700 1 -- 172.21.15.146:0/1961886406 learned_addr learned my addr 172.21.15.146:0/1961886406 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:00.122 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.117+0000 7f92b77fe700 1 -- 172.21.15.146:0/1961886406 >> v1:172.21.15.146:6789/0 conn(0x7f92b80bea30 legacy=0x7f92b8154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:00.122 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.117+0000 7f92b6ffd700 1 -- 172.21.15.146:0/1961886406 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663918223 0 0) 0x7f92b80b97b0 con 0x7f92b80b7880 2021-01-27T09:45:00.123 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.117+0000 7f92b77fe700 1 -- 172.21.15.146:0/1961886406 >> v1:172.21.15.78:6789/0 conn(0x7f92b80b7880 legacy=0x7f92b814a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:00.123 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.117+0000 7f92b77fe700 1 -- 172.21.15.146:0/1961886406 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b80b9c80 con 0x7f92b80b8150 2021-01-27T09:45:00.124 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.117+0000 7f92b77fe700 1 --2- 172.21.15.146:0/1961886406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92b80b8150 0x7f92b81474a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f92ac00b9c0 tx=0x7f92ac006e20).ready entity=mon.1 client_cookie=4360c3a3fe16c51e server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:00.124 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.117+0000 7f92b6ffd700 1 -- 172.21.15.146:0/1961886406 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac009870 con 0x7f92b80b8150 2021-01-27T09:45:00.124 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.117+0000 7f92b6ffd700 1 -- 172.21.15.146:0/1961886406 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ac0099d0 con 0x7f92b80b8150 2021-01-27T09:45:00.125 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.117+0000 7f92b6ffd700 1 -- 172.21.15.146:0/1961886406 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac009d50 con 0x7f92b80b8150 2021-01-27T09:45:00.125 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.117+0000 7f92bea21700 1 -- 172.21.15.146:0/1961886406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92b80b8150 msgr2=0x7f92b81474a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:00.125 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.117+0000 7f92bea21700 1 --2- 172.21.15.146:0/1961886406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92b80b8150 0x7f92b81474a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f92ac00b9c0 tx=0x7f92ac006e20).stop 2021-01-27T09:45:00.125 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.117+0000 7f92bea21700 1 -- 172.21.15.146:0/1961886406 shutdown_connections 2021-01-27T09:45:00.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.117+0000 7f92bea21700 1 --2- 172.21.15.146:0/1961886406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92b80b8150 0x7f92b81474a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:00.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.117+0000 7f92bea21700 1 -- 172.21.15.146:0/1961886406 >> 172.21.15.146:0/1961886406 conn(0x7f92b8069110 msgr2=0x7f92b8067e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:00.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.117+0000 7f92bea21700 1 -- 172.21.15.146:0/1961886406 shutdown_connections 2021-01-27T09:45:00.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.117+0000 7f92bea21700 1 -- 172.21.15.146:0/1961886406 wait complete. 2021-01-27T09:45:00.129 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f92bea21700 1 Processor -- start 2021-01-27T09:45:00.129 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f92bea21700 1 -- start start 2021-01-27T09:45:00.129 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f92bea21700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92b80b7880 0x7f92b8066f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:00.131 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f92bea21700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f92b80bea30 0x7f92b815e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:00.131 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f92bea21700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b814dbf0 0x7f92b8148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:00.131 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f92bea21700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b81481f0 con 0x7f92b814dbf0 2021-01-27T09:45:00.132 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f92bea21700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b815e740 con 0x7f92b80b7880 2021-01-27T09:45:00.132 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f92bea21700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b814d790 con 0x7f92b80bea30 2021-01-27T09:45:00.132 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f92b7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92b80b7880 0x7f92b8066f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:00.132 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f92b7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92b80b7880 0x7f92b8066f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46914/0 (socket says 172.21.15.146:46914) 2021-01-27T09:45:00.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f92b7fff700 1 -- 172.21.15.146:0/1236037773 learned_addr learned my addr 172.21.15.146:0/1236037773 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:00.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f92b77fe700 1 --2- 172.21.15.146:0/1236037773 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f92b80bea30 0x7f92b815e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:00.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f92bcfbe700 1 --2- 172.21.15.146:0/1236037773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b814dbf0 0x7f92b8148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:00.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f92b7fff700 1 -- 172.21.15.146:0/1236037773 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f92b80bea30 msgr2=0x7f92b815e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:00.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f92b7fff700 1 --2- 172.21.15.146:0/1236037773 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f92b80bea30 0x7f92b815e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:00.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f92b7fff700 1 -- 172.21.15.146:0/1236037773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b814dbf0 msgr2=0x7f92b8148ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:00.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f92b7fff700 1 --2- 172.21.15.146:0/1236037773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b814dbf0 0x7f92b8148ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:00.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f92b7fff700 1 -- 172.21.15.146:0/1236037773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b8148920 con 0x7f92b80b7880 2021-01-27T09:45:00.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f92bcfbe700 1 --2- 172.21.15.146:0/1236037773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b814dbf0 0x7f92b8148ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:45:00.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f92b7fff700 1 --2- 172.21.15.146:0/1236037773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92b80b7880 0x7f92b8066f10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f92a800c710 tx=0x7f92a8007a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:00.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f929ffff700 1 -- 172.21.15.146:0/1236037773 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a8007320 con 0x7f92b80b7880 2021-01-27T09:45:00.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f929ffff700 1 -- 172.21.15.146:0/1236037773 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a8007480 con 0x7f92b80b7880 2021-01-27T09:45:00.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f92bea21700 1 -- 172.21.15.146:0/1236037773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b80674c0 con 0x7f92b80b7880 2021-01-27T09:45:00.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.121+0000 7f929ffff700 1 -- 172.21.15.146:0/1236037773 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a8005850 con 0x7f92b80b7880 2021-01-27T09:45:00.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.125+0000 7f92bea21700 1 -- 172.21.15.146:0/1236037773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b8148680 con 0x7f92b80b7880 2021-01-27T09:45:00.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.125+0000 7f92bea21700 1 -- 172.21.15.146:0/1236037773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b8044ee0 con 0x7f92b80b7880 2021-01-27T09:45:00.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.125+0000 7f929ffff700 1 -- 172.21.15.146:0/1236037773 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f92a8010030 con 0x7f92b80b7880 2021-01-27T09:45:00.137 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.125+0000 7f929ffff700 1 --2- 172.21.15.146:0/1236037773 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9298056210 0x7f92980586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:00.138 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.129+0000 7f929ffff700 1 -- 172.21.15.146:0/1236037773 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f92a806f180 con 0x7f92b80b7880 2021-01-27T09:45:00.138 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.129+0000 7f92b77fe700 1 --2- 172.21.15.146:0/1236037773 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9298056210 0x7f92980586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:00.138 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.129+0000 7f92b77fe700 1 --2- 172.21.15.146:0/1236037773 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9298056210 0x7f92980586d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f92b80665a0 tx=0x7f92ac016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:00.138 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.133+0000 7f929ffff700 1 -- 172.21.15.146:0/1236037773 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f92a8044830 con 0x7f92b80b7880 2021-01-27T09:45:00.276 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.273+0000 7f92bea21700 1 -- 172.21.15.146:0/1236037773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f92b814a8b0 con 0x7f92b80b7880 2021-01-27T09:45:00.277 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.273+0000 7f929ffff700 1 -- 172.21.15.146:0/1236037773 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f92a8047e50 con 0x7f92b80b7880 2021-01-27T09:45:00.277 INFO:teuthology.orchestra.run.smithi146.stdout:60129542153 2021-01-27T09:45:00.279 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.277+0000 7f92bea21700 1 -- 172.21.15.146:0/1236037773 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9298056210 msgr2=0x7f92980586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:00.279 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.277+0000 7f92bea21700 1 --2- 172.21.15.146:0/1236037773 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9298056210 0x7f92980586d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f92b80665a0 tx=0x7f92ac016000).stop 2021-01-27T09:45:00.280 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.277+0000 7f92bea21700 1 -- 172.21.15.146:0/1236037773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92b80b7880 msgr2=0x7f92b8066f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:00.280 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.277+0000 7f92bea21700 1 --2- 172.21.15.146:0/1236037773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92b80b7880 0x7f92b8066f10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f92a800c710 tx=0x7f92a8007a90).stop 2021-01-27T09:45:00.280 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.277+0000 7f92bea21700 1 -- 172.21.15.146:0/1236037773 shutdown_connections 2021-01-27T09:45:00.280 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.277+0000 7f92bea21700 1 --2- 172.21.15.146:0/1236037773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b814dbf0 0x7f92b8148ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:00.281 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.277+0000 7f92bea21700 1 --2- 172.21.15.146:0/1236037773 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f92b80bea30 0x7f92b815e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:00.281 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.277+0000 7f92bea21700 1 --2- 172.21.15.146:0/1236037773 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9298056210 0x7f92980586d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:00.281 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.277+0000 7f92bea21700 1 --2- 172.21.15.146:0/1236037773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92b80b7880 0x7f92b8066f10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:00.281 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.277+0000 7f92bea21700 1 -- 172.21.15.146:0/1236037773 >> 172.21.15.146:0/1236037773 conn(0x7f92b8069110 msgr2=0x7f92b8064360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:00.282 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.277+0000 7f92bea21700 1 -- 172.21.15.146:0/1236037773 shutdown_connections 2021-01-27T09:45:00.282 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.277+0000 7f92bea21700 1 -- 172.21.15.146:0/1236037773 wait complete. 2021-01-27T09:45:00.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542153 for osd.6 2021-01-27T09:45:00.306 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2021-01-27T09:45:00.473 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.469+0000 7f36dade3700 1 Processor -- start 2021-01-27T09:45:00.474 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.469+0000 7f36dade3700 1 -- start start 2021-01-27T09:45:00.475 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.473+0000 7f36dade3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f36d40bdd30 0x7f36d4065fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:00.475 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.473+0000 7f36dade3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d40b3f10 con 0x7f36d40be110 2021-01-27T09:45:00.476 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.473+0000 7f36dade3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d40b41b0 con 0x7f36d4067830 2021-01-27T09:45:00.476 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.473+0000 7f36dade3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d4065a90 con 0x7f36d40bdd30 2021-01-27T09:45:00.476 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.473+0000 7f36d9380700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f36d40be110 0x7f36d41477b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:34530/0 (socket says 172.21.15.146:34530) 2021-01-27T09:45:00.477 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.473+0000 7f36d9380700 1 -- 172.21.15.146:0/419437066 learned_addr learned my addr 172.21.15.146:0/419437066 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:00.477 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.473+0000 7f36d8b7f700 1 --2- 172.21.15.146:0/419437066 >> v2:172.21.15.146:3300/0 conn(0x7f36d40bdd30 0x7f36d4065fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:00.478 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.473+0000 7f36cb7fe700 1 -- 172.21.15.146:0/419437066 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683430330 0 0) 0x7f36d40b3f10 con 0x7f36d40be110 2021-01-27T09:45:00.478 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.473+0000 7f36cb7fe700 1 -- 172.21.15.146:0/419437066 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36c0003270 con 0x7f36d40be110 2021-01-27T09:45:00.478 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.473+0000 7f36d8b7f700 1 -- 172.21.15.146:0/419437066 >> v1:172.21.15.146:6789/0 conn(0x7f36d4067830 legacy=0x7f36d414de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:00.478 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.473+0000 7f36cb7fe700 1 -- 172.21.15.146:0/419437066 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 409330413 0 0) 0x7f36d40b41b0 con 0x7f36d4067830 2021-01-27T09:45:00.478 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.473+0000 7f36d8b7f700 1 -- 172.21.15.146:0/419437066 >> v1:172.21.15.78:6789/0 conn(0x7f36d40be110 legacy=0x7f36d41477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:00.479 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.473+0000 7f36d8b7f700 1 -- 172.21.15.146:0/419437066 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d4066e50 con 0x7f36d40bdd30 2021-01-27T09:45:00.480 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.477+0000 7f36d8b7f700 1 --2- 172.21.15.146:0/419437066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36d40bdd30 0x7f36d4065fa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f36d000b9c0 tx=0x7f36d0006e20).ready entity=mon.1 client_cookie=678b87a654c0da70 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:00.480 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.477+0000 7f36cb7fe700 1 -- 172.21.15.146:0/419437066 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d000beb0 con 0x7f36d40bdd30 2021-01-27T09:45:00.480 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.477+0000 7f36cb7fe700 1 -- 172.21.15.146:0/419437066 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d00097e0 con 0x7f36d40bdd30 2021-01-27T09:45:00.480 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.477+0000 7f36cb7fe700 1 -- 172.21.15.146:0/419437066 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d0009b60 con 0x7f36d40bdd30 2021-01-27T09:45:00.481 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.477+0000 7f36dade3700 1 -- 172.21.15.146:0/419437066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36d40bdd30 msgr2=0x7f36d4065fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:00.481 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.477+0000 7f36dade3700 1 --2- 172.21.15.146:0/419437066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36d40bdd30 0x7f36d4065fa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f36d000b9c0 tx=0x7f36d0006e20).stop 2021-01-27T09:45:00.481 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.477+0000 7f36dade3700 1 -- 172.21.15.146:0/419437066 shutdown_connections 2021-01-27T09:45:00.481 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.477+0000 7f36dade3700 1 --2- 172.21.15.146:0/419437066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36d40bdd30 0x7f36d4065fa0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:00.482 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.477+0000 7f36dade3700 1 -- 172.21.15.146:0/419437066 >> 172.21.15.146:0/419437066 conn(0x7f36d4069110 msgr2=0x7f36d4060860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:00.482 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.477+0000 7f36dade3700 1 -- 172.21.15.146:0/419437066 shutdown_connections 2021-01-27T09:45:00.482 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.477+0000 7f36dade3700 1 -- 172.21.15.146:0/419437066 wait complete. 2021-01-27T09:45:00.483 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.481+0000 7f36dade3700 1 Processor -- start 2021-01-27T09:45:00.483 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.481+0000 7f36dade3700 1 -- start start 2021-01-27T09:45:00.484 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.481+0000 7f36dade3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36d4067830 0x7f36d414ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:00.484 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.481+0000 7f36dade3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36d40be110 0x7f36d4160f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:00.485 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.481+0000 7f36dade3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d413f270 0x7f36d4147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:00.485 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.481+0000 7f36dade3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d4066280 con 0x7f36d413f270 2021-01-27T09:45:00.485 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.481+0000 7f36dade3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d414aaf0 con 0x7f36d4067830 2021-01-27T09:45:00.485 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.481+0000 7f36dade3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d414d300 con 0x7f36d40be110 2021-01-27T09:45:00.487 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.481+0000 7f36d8b7f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36d4067830 0x7f36d414ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:00.488 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.481+0000 7f36d9380700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d413f270 0x7f36d4147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:00.488 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.481+0000 7f36d8b7f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36d4067830 0x7f36d414ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46928/0 (socket says 172.21.15.146:46928) 2021-01-27T09:45:00.488 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.481+0000 7f36d8b7f700 1 -- 172.21.15.146:0/4046414915 learned_addr learned my addr 172.21.15.146:0/4046414915 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:00.488 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.481+0000 7f36cbfff700 1 --2- 172.21.15.146:0/4046414915 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36d40be110 0x7f36d4160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:00.488 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.481+0000 7f36d8b7f700 1 -- 172.21.15.146:0/4046414915 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36d40be110 msgr2=0x7f36d4160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:00.489 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.481+0000 7f36d8b7f700 1 --2- 172.21.15.146:0/4046414915 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36d40be110 0x7f36d4160f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:00.489 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.481+0000 7f36d8b7f700 1 -- 172.21.15.146:0/4046414915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d413f270 msgr2=0x7f36d4147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:00.489 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.481+0000 7f36d8b7f700 1 --2- 172.21.15.146:0/4046414915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d413f270 0x7f36d4147a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:00.489 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.481+0000 7f36d8b7f700 1 -- 172.21.15.146:0/4046414915 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d41441a0 con 0x7f36d4067830 2021-01-27T09:45:00.490 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.485+0000 7f36d8b7f700 1 --2- 172.21.15.146:0/4046414915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36d4067830 0x7f36d414ce10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f36d40610f0 tx=0x7f36d0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:00.490 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.485+0000 7f36c8ff9700 1 -- 172.21.15.146:0/4046414915 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d0022070 con 0x7f36d4067830 2021-01-27T09:45:00.490 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.485+0000 7f36c8ff9700 1 -- 172.21.15.146:0/4046414915 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d0011b70 con 0x7f36d4067830 2021-01-27T09:45:00.490 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.485+0000 7f36c8ff9700 1 -- 172.21.15.146:0/4046414915 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d001d400 con 0x7f36d4067830 2021-01-27T09:45:00.491 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.485+0000 7f36dade3700 1 -- 172.21.15.146:0/4046414915 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d414ad20 con 0x7f36d4067830 2021-01-27T09:45:00.491 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.485+0000 7f36dade3700 1 -- 172.21.15.146:0/4046414915 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d4160810 con 0x7f36d4067830 2021-01-27T09:45:00.493 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.485+0000 7f36dade3700 1 -- 172.21.15.146:0/4046414915 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d4044ee0 con 0x7f36d4067830 2021-01-27T09:45:00.493 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.485+0000 7f36c8ff9700 1 -- 172.21.15.146:0/4046414915 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f36d000f070 con 0x7f36d4067830 2021-01-27T09:45:00.493 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.489+0000 7f36c8ff9700 1 --2- 172.21.15.146:0/4046414915 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f36b40561e0 0x7f36b40586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:00.494 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.489+0000 7f36c8ff9700 1 -- 172.21.15.146:0/4046414915 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f36d0070c50 con 0x7f36d4067830 2021-01-27T09:45:00.494 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.489+0000 7f36cbfff700 1 --2- 172.21.15.146:0/4046414915 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f36b40561e0 0x7f36b40586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:00.494 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.489+0000 7f36cbfff700 1 --2- 172.21.15.146:0/4046414915 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f36b40561e0 0x7f36b40586a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f36d414ec00 tx=0x7f36c4007a30).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:00.495 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.493+0000 7f36c8ff9700 1 -- 172.21.15.146:0/4046414915 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f36d0046270 con 0x7f36d4067830 2021-01-27T09:45:00.639 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.637+0000 7f36dade3700 1 -- 172.21.15.146:0/4046414915 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f36d41484c0 con 0x7f36d4067830 2021-01-27T09:45:00.640 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.637+0000 7f36c8ff9700 1 -- 172.21.15.146:0/4046414915 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f36d0049890 con 0x7f36d4067830 2021-01-27T09:45:00.640 INFO:teuthology.orchestra.run.smithi146.stdout:60129542152 2021-01-27T09:45:00.642 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.641+0000 7f36dade3700 1 -- 172.21.15.146:0/4046414915 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f36b40561e0 msgr2=0x7f36b40586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:00.642 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.641+0000 7f36dade3700 1 --2- 172.21.15.146:0/4046414915 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f36b40561e0 0x7f36b40586a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f36d414ec00 tx=0x7f36c4007a30).stop 2021-01-27T09:45:00.643 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.641+0000 7f36dade3700 1 -- 172.21.15.146:0/4046414915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36d4067830 msgr2=0x7f36d414ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:00.643 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.641+0000 7f36dade3700 1 --2- 172.21.15.146:0/4046414915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36d4067830 0x7f36d414ce10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f36d40610f0 tx=0x7f36d0016000).stop 2021-01-27T09:45:00.644 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.641+0000 7f36dade3700 1 -- 172.21.15.146:0/4046414915 shutdown_connections 2021-01-27T09:45:00.644 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.641+0000 7f36dade3700 1 --2- 172.21.15.146:0/4046414915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36d413f270 0x7f36d4147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:00.644 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.641+0000 7f36dade3700 1 --2- 172.21.15.146:0/4046414915 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36d40be110 0x7f36d4160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:00.645 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.641+0000 7f36dade3700 1 --2- 172.21.15.146:0/4046414915 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f36b40561e0 0x7f36b40586a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:00.645 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.641+0000 7f36dade3700 1 --2- 172.21.15.146:0/4046414915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36d4067830 0x7f36d414ce10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:00.645 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.641+0000 7f36dade3700 1 -- 172.21.15.146:0/4046414915 >> 172.21.15.146:0/4046414915 conn(0x7f36d4069110 msgr2=0x7f36d41447f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:00.645 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.641+0000 7f36dade3700 1 -- 172.21.15.146:0/4046414915 shutdown_connections 2021-01-27T09:45:00.646 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.641+0000 7f36dade3700 1 -- 172.21.15.146:0/4046414915 wait complete. 2021-01-27T09:45:00.671 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.7 2021-01-27T09:45:00.671 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2021-01-27T09:45:00.671 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-01-27T09:45:00.837 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.833+0000 7fc7d3ba2700 1 Processor -- start 2021-01-27T09:45:00.838 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.837+0000 7fc7d3ba2700 1 -- start start 2021-01-27T09:45:00.840 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.837+0000 7fc7d3ba2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7cc14b220 0x7fc7cc064cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:00.840 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.837+0000 7fc7d3ba2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc7cc0bec50 0x7fc7cc151540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:00.840 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.837+0000 7fc7d3ba2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7cc0b1550 con 0x7fc7cc14b600 2021-01-27T09:45:00.840 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.837+0000 7fc7d3ba2700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7cc0651a0 con 0x7fc7cc0bec50 2021-01-27T09:45:00.841 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.837+0000 7fc7d3ba2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc064710 con 0x7fc7cc14b220 2021-01-27T09:45:00.842 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.837+0000 7fc7d113d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc7cc14b600 0x7fc7cc0be0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46510/0 (socket says 172.21.15.146:46510) 2021-01-27T09:45:00.842 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.837+0000 7fc7d193e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7cc14b220 0x7fc7cc064cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:00.842 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.837+0000 7fc7d113d700 1 -- 172.21.15.146:0/2309208970 learned_addr learned my addr 172.21.15.146:0/2309208970 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:00.842 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.837+0000 7fc7d213f700 1 --2- 172.21.15.146:0/2309208970 >> v2:172.21.15.78:3300/0 conn(0x7fc7cc0bec50 0x7fc7cc151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:00.843 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.837+0000 7fc7d193e700 1 -- 172.21.15.146:0/2309208970 >> v2:172.21.15.78:3300/0 conn(0x7fc7cc0bec50 msgr2=0x7fc7cc151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:00.843 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.837+0000 7fc7d193e700 1 --2- 172.21.15.146:0/2309208970 >> v2:172.21.15.78:3300/0 conn(0x7fc7cc0bec50 0x7fc7cc151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:00.843 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.837+0000 7fc7d193e700 1 -- 172.21.15.146:0/2309208970 >> v1:172.21.15.146:6789/0 conn(0x7fc7cc14b600 legacy=0x7fc7cc0be0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:00.843 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.837+0000 7fc7d093c700 1 -- 172.21.15.146:0/2309208970 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462867707 0 0) 0x7fc7cc0b1550 con 0x7fc7cc14b600 2021-01-27T09:45:00.843 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.837+0000 7fc7d193e700 1 -- 172.21.15.146:0/2309208970 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7cc065fa0 con 0x7fc7cc14b220 2021-01-27T09:45:00.844 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.841+0000 7fc7d193e700 1 --2- 172.21.15.146:0/2309208970 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7cc14b220 0x7fc7cc064cb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fc7c800b9c0 tx=0x7fc7c8006e20).ready entity=mon.2 client_cookie=2414d00d147b7311 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:00.845 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.841+0000 7fc7d093c700 1 -- 172.21.15.146:0/2309208970 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8009870 con 0x7fc7cc14b220 2021-01-27T09:45:00.845 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.841+0000 7fc7d093c700 1 -- 172.21.15.146:0/2309208970 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c80099d0 con 0x7fc7cc14b220 2021-01-27T09:45:00.846 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.841+0000 7fc7d093c700 1 -- 172.21.15.146:0/2309208970 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8009d50 con 0x7fc7cc14b220 2021-01-27T09:45:00.846 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.841+0000 7fc7d3ba2700 1 -- 172.21.15.146:0/2309208970 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7cc14b220 msgr2=0x7fc7cc064cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:00.846 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.841+0000 7fc7d3ba2700 1 --2- 172.21.15.146:0/2309208970 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7cc14b220 0x7fc7cc064cb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fc7c800b9c0 tx=0x7fc7c8006e20).stop 2021-01-27T09:45:00.846 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.841+0000 7fc7d3ba2700 1 -- 172.21.15.146:0/2309208970 shutdown_connections 2021-01-27T09:45:00.846 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.841+0000 7fc7d3ba2700 1 --2- 172.21.15.146:0/2309208970 >> v2:172.21.15.78:3300/0 conn(0x7fc7cc0bec50 0x7fc7cc151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:00.847 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.841+0000 7fc7d3ba2700 1 --2- 172.21.15.146:0/2309208970 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7cc14b220 0x7fc7cc064cb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:00.847 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.841+0000 7fc7d3ba2700 1 -- 172.21.15.146:0/2309208970 >> 172.21.15.146:0/2309208970 conn(0x7fc7cc069110 msgr2=0x7fc7cc067e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:00.847 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.841+0000 7fc7d3ba2700 1 -- 172.21.15.146:0/2309208970 shutdown_connections 2021-01-27T09:45:00.848 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.841+0000 7fc7d3ba2700 1 -- 172.21.15.146:0/2309208970 wait complete. 2021-01-27T09:45:00.849 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.845+0000 7fc7d3ba2700 1 Processor -- start 2021-01-27T09:45:00.850 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.845+0000 7fc7d3ba2700 1 -- start start 2021-01-27T09:45:00.850 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.845+0000 7fc7d3ba2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7cc0bec50 0x7fc7cc1607b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:00.850 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.845+0000 7fc7d3ba2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7cc14b220 0x7fc7cc0b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:00.850 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.845+0000 7fc7d3ba2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7cc14b600 0x7fc7cc15ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:00.851 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.845+0000 7fc7d3ba2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc15d4f0 con 0x7fc7cc14b220 2021-01-27T09:45:00.851 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.845+0000 7fc7d3ba2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc15d790 con 0x7fc7cc0bec50 2021-01-27T09:45:00.851 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.845+0000 7fc7d3ba2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc15da30 con 0x7fc7cc14b600 2021-01-27T09:45:00.851 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.845+0000 7fc7d193e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7cc0bec50 0x7fc7cc1607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:00.852 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.845+0000 7fc7d193e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7cc0bec50 0x7fc7cc1607b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46942/0 (socket says 172.21.15.146:46942) 2021-01-27T09:45:00.852 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.845+0000 7fc7d193e700 1 -- 172.21.15.146:0/459639471 learned_addr learned my addr 172.21.15.146:0/459639471 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:00.852 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.845+0000 7fc7d213f700 1 --2- 172.21.15.146:0/459639471 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7cc14b600 0x7fc7cc15ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:00.852 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.845+0000 7fc7d113d700 1 --2- 172.21.15.146:0/459639471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7cc14b220 0x7fc7cc0b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:00.855 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.849+0000 7fc7d193e700 1 -- 172.21.15.146:0/459639471 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7cc14b600 msgr2=0x7fc7cc15ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:00.855 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.849+0000 7fc7d193e700 1 --2- 172.21.15.146:0/459639471 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7cc14b600 0x7fc7cc15ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.849+0000 7fc7d193e700 1 -- 172.21.15.146:0/459639471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7cc14b220 msgr2=0x7fc7cc0b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.849+0000 7fc7d193e700 1 --2- 172.21.15.146:0/459639471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7cc14b220 0x7fc7cc0b2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.849+0000 7fc7d193e700 1 -- 172.21.15.146:0/459639471 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7cc15dcd0 con 0x7fc7cc0bec50 2021-01-27T09:45:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.849+0000 7fc7d193e700 1 --2- 172.21.15.146:0/459639471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7cc0bec50 0x7fc7cc1607b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fc7c8007fd0 tx=0x7fc7c8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.849+0000 7fc7b9ffb700 1 -- 172.21.15.146:0/459639471 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8011b70 con 0x7fc7cc0bec50 2021-01-27T09:45:00.857 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.849+0000 7fc7b9ffb700 1 -- 172.21.15.146:0/459639471 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c8011cd0 con 0x7fc7cc0bec50 2021-01-27T09:45:00.857 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.849+0000 7fc7d3ba2700 1 -- 172.21.15.146:0/459639471 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7cc15df70 con 0x7fc7cc0bec50 2021-01-27T09:45:00.857 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.849+0000 7fc7b9ffb700 1 -- 172.21.15.146:0/459639471 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c801c630 con 0x7fc7cc0bec50 2021-01-27T09:45:00.857 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.849+0000 7fc7d3ba2700 1 -- 172.21.15.146:0/459639471 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7cc14f290 con 0x7fc7cc0bec50 2021-01-27T09:45:00.858 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.849+0000 7fc7d3ba2700 1 -- 172.21.15.146:0/459639471 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7cc15e100 con 0x7fc7cc0bec50 2021-01-27T09:45:00.858 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.853+0000 7fc7b9ffb700 1 -- 172.21.15.146:0/459639471 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fc7c800f070 con 0x7fc7cc0bec50 2021-01-27T09:45:00.858 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.853+0000 7fc7b9ffb700 1 --2- 172.21.15.146:0/459639471 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc7ac056210 0x7fc7ac0586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:00.858 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.853+0000 7fc7b9ffb700 1 -- 172.21.15.146:0/459639471 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fc7c8070ad0 con 0x7fc7cc0bec50 2021-01-27T09:45:00.859 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.853+0000 7fc7d113d700 1 --2- 172.21.15.146:0/459639471 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc7ac056210 0x7fc7ac0586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:00.859 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.853+0000 7fc7d113d700 1 --2- 172.21.15.146:0/459639471 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc7ac056210 0x7fc7ac0586d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fc7bc007fd0 tx=0x7fc7bc007c50).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:00.861 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.861+0000 7fc7b9ffb700 1 -- 172.21.15.146:0/459639471 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fc7c8046180 con 0x7fc7cc0bec50 2021-01-27T09:45:01.002 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:00.997+0000 7fc7d3ba2700 1 -- 172.21.15.146:0/459639471 --> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc7cc044ee0 con 0x7fc7ac056210 2021-01-27T09:45:01.011 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.009+0000 7fc7b9ffb700 1 -- 172.21.15.146:0/459639471 <== mgr.4104 v2:172.21.15.78:6832/15486 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+101299 (secure 0 0 0) 0x7fc7cc044ee0 con 0x7fc7ac056210 2021-01-27T09:45:01.012 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:45:01.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.013+0000 7fc7d3ba2700 1 -- 172.21.15.146:0/459639471 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc7ac056210 msgr2=0x7fc7ac0586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:01.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.013+0000 7fc7d3ba2700 1 --2- 172.21.15.146:0/459639471 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc7ac056210 0x7fc7ac0586d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fc7bc007fd0 tx=0x7fc7bc007c50).stop 2021-01-27T09:45:01.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.013+0000 7fc7d3ba2700 1 -- 172.21.15.146:0/459639471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7cc0bec50 msgr2=0x7fc7cc1607b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:01.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.013+0000 7fc7d3ba2700 1 --2- 172.21.15.146:0/459639471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7cc0bec50 0x7fc7cc1607b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fc7c8007fd0 tx=0x7fc7c8016000).stop 2021-01-27T09:45:01.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.013+0000 7fc7d3ba2700 1 -- 172.21.15.146:0/459639471 shutdown_connections 2021-01-27T09:45:01.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.013+0000 7fc7d3ba2700 1 --2- 172.21.15.146:0/459639471 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7cc14b600 0x7fc7cc15ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.013+0000 7fc7d3ba2700 1 --2- 172.21.15.146:0/459639471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7cc14b220 0x7fc7cc0b2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.013+0000 7fc7d3ba2700 1 --2- 172.21.15.146:0/459639471 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc7ac056210 0x7fc7ac0586d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.013+0000 7fc7d3ba2700 1 --2- 172.21.15.146:0/459639471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7cc0bec50 0x7fc7cc1607b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.013+0000 7fc7d3ba2700 1 -- 172.21.15.146:0/459639471 >> 172.21.15.146:0/459639471 conn(0x7fc7cc069110 msgr2=0x7fc7cc1499e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:01.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.013+0000 7fc7d3ba2700 1 -- 172.21.15.146:0/459639471 shutdown_connections 2021-01-27T09:45:01.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.013+0000 7fc7d3ba2700 1 -- 172.21.15.146:0/459639471 wait complete. 2021-01-27T09:45:01.018 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2021-01-27T09:45:01.043 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2021-01-27T09:45:00.449582+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6354,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41620,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":754933100,"statfs":{"total":773094113280,"available":773051494400,"internally_reserved":0,"allocated":2314240,"data_stored":912406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2660,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004047"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.369789+0000","last_change":"2021-01-27T09:44:26.437753+0000","last_active":"2021-01-27T09:44:33.369789+0000","last_peered":"2021-01-27T09:44:33.369789+0000","last_clean":"2021-01-27T09:44:33.369789+0000","last_became_active":"2021-01-27T09:44:26.437402+0000","last_became_peered":"2021-01-27T09:44:26.437402+0000","last_unstale":"2021-01-27T09:44:33.369789+0000","last_undegraded":"2021-01-27T09:44:33.369789+0000","last_fullsized":"2021-01-27T09:44:33.369789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'9","reported_seq":"23","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.616159+0000","last_change":"2021-01-27T09:44:28.931645+0000","last_active":"2021-01-27T09:44:51.616159+0000","last_peered":"2021-01-27T09:44:51.616159+0000","last_clean":"2021-01-27T09:44:51.616159+0000","last_became_active":"2021-01-27T09:44:28.931347+0000","last_became_peered":"2021-01-27T09:44:28.931347+0000","last_unstale":"2021-01-27T09:44:51.616159+0000","last_undegraded":"2021-01-27T09:44:51.616159+0000","last_fullsized":"2021-01-27T09:44:51.616159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.364949+0000","last_change":"2021-01-27T09:44:29.336652+0000","last_active":"2021-01-27T09:44:33.364949+0000","last_peered":"2021-01-27T09:44:33.364949+0000","last_clean":"2021-01-27T09:44:33.364949+0000","last_became_active":"2021-01-27T09:44:29.336207+0000","last_became_peered":"2021-01-27T09:44:29.336207+0000","last_unstale":"2021-01-27T09:44:33.364949+0000","last_undegraded":"2021-01-27T09:44:33.364949+0000","last_fullsized":"2021-01-27T09:44:33.364949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.382353+0000","last_change":"2021-01-27T09:44:33.381360+0000","last_active":"2021-01-27T09:44:33.382353+0000","last_peered":"2021-01-27T09:44:33.382353+0000","last_clean":"2021-01-27T09:44:33.382353+0000","last_became_active":"2021-01-27T09:44:33.380037+0000","last_became_peered":"2021-01-27T09:44:33.380037+0000","last_unstale":"2021-01-27T09:44:33.382353+0000","last_undegraded":"2021-01-27T09:44:33.382353+0000","last_fullsized":"2021-01-27T09:44:33.382353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"17","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.372796+0000","last_change":"2021-01-27T09:44:26.436242+0000","last_active":"2021-01-27T09:44:33.372796+0000","last_peered":"2021-01-27T09:44:33.372796+0000","last_clean":"2021-01-27T09:44:33.372796+0000","last_became_active":"2021-01-27T09:44:26.435467+0000","last_became_peered":"2021-01-27T09:44:26.435467+0000","last_unstale":"2021-01-27T09:44:33.372796+0000","last_undegraded":"2021-01-27T09:44:33.372796+0000","last_fullsized":"2021-01-27T09:44:33.372796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'17","reported_seq":"31","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.618737+0000","last_change":"2021-01-27T09:44:28.934250+0000","last_active":"2021-01-27T09:44:51.618737+0000","last_peered":"2021-01-27T09:44:51.618737+0000","last_clean":"2021-01-27T09:44:51.618737+0000","last_became_active":"2021-01-27T09:44:28.933897+0000","last_became_peered":"2021-01-27T09:44:28.933897+0000","last_unstale":"2021-01-27T09:44:51.618737+0000","last_undegraded":"2021-01-27T09:44:51.618737+0000","last_fullsized":"2021-01-27T09:44:51.618737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":666,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.374140+0000","last_change":"2021-01-27T09:44:29.341412+0000","last_active":"2021-01-27T09:44:33.374140+0000","last_peered":"2021-01-27T09:44:33.374140+0000","last_clean":"2021-01-27T09:44:33.374140+0000","last_became_active":"2021-01-27T09:44:29.341016+0000","last_became_peered":"2021-01-27T09:44:29.341016+0000","last_unstale":"2021-01-27T09:44:33.374140+0000","last_undegraded":"2021-01-27T09:44:33.374140+0000","last_fullsized":"2021-01-27T09:44:33.374140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.380375+0000","last_change":"2021-01-27T09:44:33.378505+0000","last_active":"2021-01-27T09:44:33.380375+0000","last_peered":"2021-01-27T09:44:33.380375+0000","last_clean":"2021-01-27T09:44:33.380375+0000","last_became_active":"2021-01-27T09:44:33.377285+0000","last_became_peered":"2021-01-27T09:44:33.377285+0000","last_unstale":"2021-01-27T09:44:33.380375+0000","last_undegraded":"2021-01-27T09:44:33.380375+0000","last_fullsized":"2021-01-27T09:44:33.380375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368923+0000","last_change":"2021-01-27T09:44:25.841172+0000","last_active":"2021-01-27T09:44:33.368923+0000","last_peered":"2021-01-27T09:44:33.368923+0000","last_clean":"2021-01-27T09:44:33.368923+0000","last_became_active":"2021-01-27T09:44:25.840711+0000","last_became_peered":"2021-01-27T09:44:25.840711+0000","last_unstale":"2021-01-27T09:44:33.368923+0000","last_undegraded":"2021-01-27T09:44:33.368923+0000","last_fullsized":"2021-01-27T09:44:33.368923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'16","reported_seq":"30","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.615709+0000","last_change":"2021-01-27T09:44:28.932871+0000","last_active":"2021-01-27T09:44:51.615709+0000","last_peered":"2021-01-27T09:44:51.615709+0000","last_clean":"2021-01-27T09:44:51.615709+0000","last_became_active":"2021-01-27T09:44:28.932513+0000","last_became_peered":"2021-01-27T09:44:28.932513+0000","last_unstale":"2021-01-27T09:44:51.615709+0000","last_undegraded":"2021-01-27T09:44:51.615709+0000","last_fullsized":"2021-01-27T09:44:51.615709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3478,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.366893+0000","last_change":"2021-01-27T09:44:29.350508+0000","last_active":"2021-01-27T09:44:33.366893+0000","last_peered":"2021-01-27T09:44:33.366893+0000","last_clean":"2021-01-27T09:44:33.366893+0000","last_became_active":"2021-01-27T09:44:29.350179+0000","last_became_peered":"2021-01-27T09:44:29.350179+0000","last_unstale":"2021-01-27T09:44:33.366893+0000","last_undegraded":"2021-01-27T09:44:33.366893+0000","last_fullsized":"2021-01-27T09:44:33.366893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.442441+0000","last_change":"2021-01-27T09:44:33.441051+0000","last_active":"2021-01-27T09:44:33.442441+0000","last_peered":"2021-01-27T09:44:33.442441+0000","last_clean":"2021-01-27T09:44:33.442441+0000","last_became_active":"2021-01-27T09:44:33.439809+0000","last_became_peered":"2021-01-27T09:44:33.439809+0000","last_unstale":"2021-01-27T09:44:33.442441+0000","last_undegraded":"2021-01-27T09:44:33.442441+0000","last_fullsized":"2021-01-27T09:44:33.442441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"17","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.437810+0000","last_change":"2021-01-27T09:44:26.405089+0000","last_active":"2021-01-27T09:44:33.437810+0000","last_peered":"2021-01-27T09:44:33.437810+0000","last_clean":"2021-01-27T09:44:33.437810+0000","last_became_active":"2021-01-27T09:44:26.403537+0000","last_became_peered":"2021-01-27T09:44:26.403537+0000","last_unstale":"2021-01-27T09:44:33.437810+0000","last_undegraded":"2021-01-27T09:44:33.437810+0000","last_fullsized":"2021-01-27T09:44:33.437810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'10","reported_seq":"23","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.617676+0000","last_change":"2021-01-27T09:44:28.932480+0000","last_active":"2021-01-27T09:44:51.617676+0000","last_peered":"2021-01-27T09:44:51.617676+0000","last_clean":"2021-01-27T09:44:51.617676+0000","last_became_active":"2021-01-27T09:44:28.932127+0000","last_became_peered":"2021-01-27T09:44:28.932127+0000","last_unstale":"2021-01-27T09:44:51.617676+0000","last_undegraded":"2021-01-27T09:44:51.617676+0000","last_fullsized":"2021-01-27T09:44:51.617676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":736,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.366915+0000","last_change":"2021-01-27T09:44:29.338414+0000","last_active":"2021-01-27T09:44:33.366915+0000","last_peered":"2021-01-27T09:44:33.366915+0000","last_clean":"2021-01-27T09:44:33.366915+0000","last_became_active":"2021-01-27T09:44:29.337813+0000","last_became_peered":"2021-01-27T09:44:29.337813+0000","last_unstale":"2021-01-27T09:44:33.366915+0000","last_undegraded":"2021-01-27T09:44:33.366915+0000","last_fullsized":"2021-01-27T09:44:33.366915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.448516+0000","last_change":"2021-01-27T09:44:33.442248+0000","last_active":"2021-01-27T09:44:33.448516+0000","last_peered":"2021-01-27T09:44:33.448516+0000","last_clean":"2021-01-27T09:44:33.448516+0000","last_became_active":"2021-01-27T09:44:33.440410+0000","last_became_peered":"2021-01-27T09:44:33.440410+0000","last_unstale":"2021-01-27T09:44:33.448516+0000","last_undegraded":"2021-01-27T09:44:33.448516+0000","last_fullsized":"2021-01-27T09:44:33.448516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.442528+0000","last_change":"2021-01-27T09:44:33.441395+0000","last_active":"2021-01-27T09:44:33.442528+0000","last_peered":"2021-01-27T09:44:33.442528+0000","last_clean":"2021-01-27T09:44:33.442528+0000","last_became_active":"2021-01-27T09:44:33.440377+0000","last_became_peered":"2021-01-27T09:44:33.440377+0000","last_unstale":"2021-01-27T09:44:33.442528+0000","last_undegraded":"2021-01-27T09:44:33.442528+0000","last_fullsized":"2021-01-27T09:44:33.442528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"26'18","reported_seq":"31","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.608717+0000","last_change":"2021-01-27T09:44:28.929059+0000","last_active":"2021-01-27T09:44:51.608717+0000","last_peered":"2021-01-27T09:44:51.608717+0000","last_clean":"2021-01-27T09:44:51.608717+0000","last_became_active":"2021-01-27T09:44:28.928444+0000","last_became_peered":"2021-01-27T09:44:28.928444+0000","last_unstale":"2021-01-27T09:44:51.608717+0000","last_undegraded":"2021-01-27T09:44:51.608717+0000","last_fullsized":"2021-01-27T09:44:51.608717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":642,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368690+0000","last_change":"2021-01-27T09:44:26.403671+0000","last_active":"2021-01-27T09:44:33.368690+0000","last_peered":"2021-01-27T09:44:33.368690+0000","last_clean":"2021-01-27T09:44:33.368690+0000","last_became_active":"2021-01-27T09:44:26.403137+0000","last_became_peered":"2021-01-27T09:44:26.403137+0000","last_unstale":"2021-01-27T09:44:33.368690+0000","last_undegraded":"2021-01-27T09:44:33.368690+0000","last_fullsized":"2021-01-27T09:44:33.368690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.367795+0000","last_change":"2021-01-27T09:44:29.347824+0000","last_active":"2021-01-27T09:44:33.367795+0000","last_peered":"2021-01-27T09:44:33.367795+0000","last_clean":"2021-01-27T09:44:33.367795+0000","last_became_active":"2021-01-27T09:44:29.347463+0000","last_became_peered":"2021-01-27T09:44:29.347463+0000","last_unstale":"2021-01-27T09:44:33.367795+0000","last_undegraded":"2021-01-27T09:44:33.367795+0000","last_fullsized":"2021-01-27T09:44:33.367795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.443462+0000","last_change":"2021-01-27T09:44:33.441988+0000","last_active":"2021-01-27T09:44:33.443462+0000","last_peered":"2021-01-27T09:44:33.443462+0000","last_clean":"2021-01-27T09:44:33.443462+0000","last_became_active":"2021-01-27T09:44:33.440172+0000","last_became_peered":"2021-01-27T09:44:33.440172+0000","last_unstale":"2021-01-27T09:44:33.443462+0000","last_undegraded":"2021-01-27T09:44:33.443462+0000","last_fullsized":"2021-01-27T09:44:33.443462+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"26'21","reported_seq":"35","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.618079+0000","last_change":"2021-01-27T09:44:28.930780+0000","last_active":"2021-01-27T09:44:51.618079+0000","last_peered":"2021-01-27T09:44:51.618079+0000","last_clean":"2021-01-27T09:44:51.618079+0000","last_became_active":"2021-01-27T09:44:28.930374+0000","last_became_peered":"2021-01-27T09:44:28.930374+0000","last_unstale":"2021-01-27T09:44:51.618079+0000","last_undegraded":"2021-01-27T09:44:51.618079+0000","last_fullsized":"2021-01-27T09:44:51.618079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":112,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"17","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.372343+0000","last_change":"2021-01-27T09:44:25.838965+0000","last_active":"2021-01-27T09:44:33.372343+0000","last_peered":"2021-01-27T09:44:33.372343+0000","last_clean":"2021-01-27T09:44:33.372343+0000","last_became_active":"2021-01-27T09:44:25.838635+0000","last_became_peered":"2021-01-27T09:44:25.838635+0000","last_unstale":"2021-01-27T09:44:33.372343+0000","last_undegraded":"2021-01-27T09:44:33.372343+0000","last_fullsized":"2021-01-27T09:44:33.372343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.367109+0000","last_change":"2021-01-27T09:44:29.348218+0000","last_active":"2021-01-27T09:44:33.367109+0000","last_peered":"2021-01-27T09:44:33.367109+0000","last_clean":"2021-01-27T09:44:33.367109+0000","last_became_active":"2021-01-27T09:44:29.347905+0000","last_became_peered":"2021-01-27T09:44:29.347905+0000","last_unstale":"2021-01-27T09:44:33.367109+0000","last_undegraded":"2021-01-27T09:44:33.367109+0000","last_fullsized":"2021-01-27T09:44:33.367109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.380414+0000","last_change":"2021-01-27T09:44:33.378828+0000","last_active":"2021-01-27T09:44:33.380414+0000","last_peered":"2021-01-27T09:44:33.380414+0000","last_clean":"2021-01-27T09:44:33.380414+0000","last_became_active":"2021-01-27T09:44:33.376984+0000","last_became_peered":"2021-01-27T09:44:33.376984+0000","last_unstale":"2021-01-27T09:44:33.380414+0000","last_undegraded":"2021-01-27T09:44:33.380414+0000","last_fullsized":"2021-01-27T09:44:33.380414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"26'12","reported_seq":"26","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.617400+0000","last_change":"2021-01-27T09:44:28.933091+0000","last_active":"2021-01-27T09:44:51.617400+0000","last_peered":"2021-01-27T09:44:51.617400+0000","last_clean":"2021-01-27T09:44:51.617400+0000","last_became_active":"2021-01-27T09:44:28.932701+0000","last_became_peered":"2021-01-27T09:44:28.932701+0000","last_unstale":"2021-01-27T09:44:51.617400+0000","last_undegraded":"2021-01-27T09:44:51.617400+0000","last_fullsized":"2021-01-27T09:44:51.617400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":720,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368552+0000","last_change":"2021-01-27T09:44:25.737081+0000","last_active":"2021-01-27T09:44:33.368552+0000","last_peered":"2021-01-27T09:44:33.368552+0000","last_clean":"2021-01-27T09:44:33.368552+0000","last_became_active":"2021-01-27T09:44:25.736516+0000","last_became_peered":"2021-01-27T09:44:25.736516+0000","last_unstale":"2021-01-27T09:44:33.368552+0000","last_undegraded":"2021-01-27T09:44:33.368552+0000","last_fullsized":"2021-01-27T09:44:33.368552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.437701+0000","last_change":"2021-01-27T09:44:29.347815+0000","last_active":"2021-01-27T09:44:33.437701+0000","last_peered":"2021-01-27T09:44:33.437701+0000","last_clean":"2021-01-27T09:44:33.437701+0000","last_became_active":"2021-01-27T09:44:29.347415+0000","last_became_peered":"2021-01-27T09:44:29.347415+0000","last_unstale":"2021-01-27T09:44:33.437701+0000","last_undegraded":"2021-01-27T09:44:33.437701+0000","last_fullsized":"2021-01-27T09:44:33.437701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.437850+0000","last_change":"2021-01-27T09:44:33.436705+0000","last_active":"2021-01-27T09:44:33.437850+0000","last_peered":"2021-01-27T09:44:33.437850+0000","last_clean":"2021-01-27T09:44:33.437850+0000","last_became_active":"2021-01-27T09:44:33.435975+0000","last_became_peered":"2021-01-27T09:44:33.435975+0000","last_unstale":"2021-01-27T09:44:33.437850+0000","last_undegraded":"2021-01-27T09:44:33.437850+0000","last_fullsized":"2021-01-27T09:44:33.437850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'8","reported_seq":"22","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.612586+0000","last_change":"2021-01-27T09:44:28.930455+0000","last_active":"2021-01-27T09:44:51.612586+0000","last_peered":"2021-01-27T09:44:51.612586+0000","last_clean":"2021-01-27T09:44:51.612586+0000","last_became_active":"2021-01-27T09:44:28.930088+0000","last_became_peered":"2021-01-27T09:44:28.930088+0000","last_unstale":"2021-01-27T09:44:51.612586+0000","last_undegraded":"2021-01-27T09:44:51.612586+0000","last_fullsized":"2021-01-27T09:44:51.612586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368647+0000","last_change":"2021-01-27T09:44:25.736301+0000","last_active":"2021-01-27T09:44:33.368647+0000","last_peered":"2021-01-27T09:44:33.368647+0000","last_clean":"2021-01-27T09:44:33.368647+0000","last_became_active":"2021-01-27T09:44:25.735741+0000","last_became_peered":"2021-01-27T09:44:25.735741+0000","last_unstale":"2021-01-27T09:44:33.368647+0000","last_undegraded":"2021-01-27T09:44:33.368647+0000","last_fullsized":"2021-01-27T09:44:33.368647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"20","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.432653+0000","last_change":"2021-01-27T09:44:24.570544+0000","last_active":"2021-01-27T09:44:33.432653+0000","last_peered":"2021-01-27T09:44:33.432653+0000","last_clean":"2021-01-27T09:44:33.432653+0000","last_became_active":"2021-01-27T09:44:24.569755+0000","last_became_peered":"2021-01-27T09:44:24.569755+0000","last_unstale":"2021-01-27T09:44:33.432653+0000","last_undegraded":"2021-01-27T09:44:33.432653+0000","last_fullsized":"2021-01-27T09:44:33.432653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:19.429176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:19.429176+0000","last_clean_scrub_stamp":"2021-01-27T09:44:19.429176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368821+0000","last_change":"2021-01-27T09:44:29.337716+0000","last_active":"2021-01-27T09:44:33.368821+0000","last_peered":"2021-01-27T09:44:33.368821+0000","last_clean":"2021-01-27T09:44:33.368821+0000","last_became_active":"2021-01-27T09:44:29.337355+0000","last_became_peered":"2021-01-27T09:44:29.337355+0000","last_unstale":"2021-01-27T09:44:33.368821+0000","last_undegraded":"2021-01-27T09:44:33.368821+0000","last_fullsized":"2021-01-27T09:44:33.368821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":6354,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":12708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5136,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366704,"statfs":{"total":96636764160,"available":96631504896,"internally_reserved":0,"allocated":270336,"data_stored":112757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.875}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5030000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.895}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.395}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5179999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8439999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7709999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5240,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366600,"statfs":{"total":96636764160,"available":96631398400,"internally_reserved":0,"allocated":311296,"data_stored":114069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6850000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1080000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4889999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6909999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0369999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7240000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6509999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5136,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366704,"statfs":{"total":96636764160,"available":96631504896,"internally_reserved":0,"allocated":270336,"data_stored":112757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2480000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.667}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3580000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4670000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6349999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0459999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5569999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5148,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366692,"statfs":{"total":96636764160,"available":96631492608,"internally_reserved":0,"allocated":282624,"data_stored":112613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6890000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5269999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.587}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2160000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2530000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8919999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.391}]}]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5204,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366636,"statfs":{"total":96636764160,"available":96631435264,"internally_reserved":0,"allocated":274432,"data_stored":112083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3119999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1309999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.536}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6659999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1859999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8759999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6269999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":118357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1640000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.806}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9809999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5459999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4770000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5224,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366616,"statfs":{"total":96636764160,"available":96631414784,"internally_reserved":0,"allocated":294912,"data_stored":116347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.607}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6619999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8540000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5369999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4460000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7770000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5212,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366628,"statfs":{"total":96636764160,"available":96631427072,"internally_reserved":0,"allocated":282624,"data_stored":113423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.754}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2669999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.98}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6360000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0990000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4860000000000002}]}]}]}} 2021-01-27T09:45:01.046 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-01-27T09:45:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.209+0000 7f1a04dda700 1 Processor -- start 2021-01-27T09:45:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.209+0000 7f1a04dda700 1 -- start start 2021-01-27T09:45:01.215 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.213+0000 7f1a04dda700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1a00067830 0x7f1a00065fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:01.215 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.213+0000 7f1a04dda700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a000b3f10 con 0x7f1a000bdd30 2021-01-27T09:45:01.216 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.213+0000 7f1a04dda700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a000b41b0 con 0x7f1a000be110 2021-01-27T09:45:01.216 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.213+0000 7f1a04dda700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a00065a90 con 0x7f1a00067830 2021-01-27T09:45:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.213+0000 7f19fdd9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1a00067830 0x7f1a00065fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.213+0000 7f19fdd9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1a00067830 0x7f1a00065fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:49824/0 (socket says 172.21.15.146:49824) 2021-01-27T09:45:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.213+0000 7f19fdd9b700 1 -- 172.21.15.146:0/416523404 learned_addr learned my addr 172.21.15.146:0/416523404 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:01.218 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.213+0000 7f19fed9d700 1 --1- 172.21.15.146:0/416523404 >> v1:172.21.15.146:6789/0 conn(0x7f1a000be110 0x7f1a001477b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46526/0 (socket says 172.21.15.146:46526) 2021-01-27T09:45:01.218 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.213+0000 7f19fdd9b700 1 -- 172.21.15.146:0/416523404 >> v1:172.21.15.146:6789/0 conn(0x7f1a000be110 legacy=0x7f1a001477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:01.218 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.213+0000 7f19fd59a700 1 -- 172.21.15.146:0/416523404 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896138367 0 0) 0x7f1a000b41b0 con 0x7f1a000be110 2021-01-27T09:45:01.218 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.213+0000 7f19fdd9b700 1 -- 172.21.15.146:0/416523404 >> v1:172.21.15.78:6789/0 conn(0x7f1a000bdd30 legacy=0x7f1a0014de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.213+0000 7f19fdd9b700 1 -- 172.21.15.146:0/416523404 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a00066e50 con 0x7f1a00067830 2021-01-27T09:45:01.220 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.213+0000 7f19fdd9b700 1 --2- 172.21.15.146:0/416523404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a00067830 0x7f1a00065fa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f19f400ba20 tx=0x7f19f4006ee0).ready entity=mon.0 client_cookie=3842cbc4f19572f4 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:01.220 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.217+0000 7f19fd59a700 1 -- 172.21.15.146:0/416523404 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4009840 con 0x7f1a00067830 2021-01-27T09:45:01.220 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.217+0000 7f19fd59a700 1 -- 172.21.15.146:0/416523404 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f40099a0 con 0x7f1a00067830 2021-01-27T09:45:01.220 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.217+0000 7f19fd59a700 1 -- 172.21.15.146:0/416523404 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4009d20 con 0x7f1a00067830 2021-01-27T09:45:01.221 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.217+0000 7f1a04dda700 1 -- 172.21.15.146:0/416523404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a00067830 msgr2=0x7f1a00065fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:01.221 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.217+0000 7f1a04dda700 1 --2- 172.21.15.146:0/416523404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a00067830 0x7f1a00065fa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f19f400ba20 tx=0x7f19f4006ee0).stop 2021-01-27T09:45:01.221 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.217+0000 7f1a04dda700 1 -- 172.21.15.146:0/416523404 shutdown_connections 2021-01-27T09:45:01.221 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.217+0000 7f1a04dda700 1 --2- 172.21.15.146:0/416523404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a00067830 0x7f1a00065fa0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.221 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.217+0000 7f1a04dda700 1 -- 172.21.15.146:0/416523404 >> 172.21.15.146:0/416523404 conn(0x7f1a00069110 msgr2=0x7f1a00060860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:01.222 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.217+0000 7f1a04dda700 1 -- 172.21.15.146:0/416523404 shutdown_connections 2021-01-27T09:45:01.222 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.217+0000 7f1a04dda700 1 -- 172.21.15.146:0/416523404 wait complete. 2021-01-27T09:45:01.223 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.221+0000 7f1a04dda700 1 Processor -- start 2021-01-27T09:45:01.223 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.221+0000 7f1a04dda700 1 -- start start 2021-01-27T09:45:01.224 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.221+0000 7f1a04dda700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a00067830 0x7f1a00161470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:01.224 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.221+0000 7f1a04dda700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a000bdd30 0x7f1a0013e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:01.224 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.221+0000 7f1a04dda700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a000be110 0x7f1a0013e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:01.225 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.221+0000 7f1a04dda700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a001483e0 con 0x7f1a00067830 2021-01-27T09:45:01.225 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.221+0000 7f1a04dda700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a00147c40 con 0x7f1a000bdd30 2021-01-27T09:45:01.226 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.221+0000 7f1a04dda700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a00161960 con 0x7f1a000be110 2021-01-27T09:45:01.228 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.221+0000 7f19fdd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a000bdd30 0x7f1a0013e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:01.229 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.221+0000 7f19fe59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a00067830 0x7f1a00161470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:01.229 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.221+0000 7f19fe59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a00067830 0x7f1a00161470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:49830/0 (socket says 172.21.15.146:49830) 2021-01-27T09:45:01.229 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.221+0000 7f19fe59c700 1 -- 172.21.15.146:0/2797564490 learned_addr learned my addr 172.21.15.146:0/2797564490 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:01.229 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.221+0000 7f19fed9d700 1 --2- 172.21.15.146:0/2797564490 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a000be110 0x7f1a0013e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:01.229 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.221+0000 7f19fdd9b700 1 -- 172.21.15.146:0/2797564490 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a000be110 msgr2=0x7f1a0013e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:01.230 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.221+0000 7f19fdd9b700 1 --2- 172.21.15.146:0/2797564490 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a000be110 0x7f1a0013e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.230 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.221+0000 7f19fdd9b700 1 -- 172.21.15.146:0/2797564490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a00067830 msgr2=0x7f1a00161470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:01.230 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.221+0000 7f19fdd9b700 1 --2- 172.21.15.146:0/2797564490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a00067830 0x7f1a00161470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.230 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.221+0000 7f19fdd9b700 1 -- 172.21.15.146:0/2797564490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0014d940 con 0x7f1a000bdd30 2021-01-27T09:45:01.231 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.221+0000 7f19fe59c700 1 --2- 172.21.15.146:0/2797564490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a00067830 0x7f1a00161470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:45:01.231 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.221+0000 7f19fed9d700 1 --2- 172.21.15.146:0/2797564490 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a000be110 0x7f1a0013e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:45:01.231 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.221+0000 7f19fdd9b700 1 --2- 172.21.15.146:0/2797564490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a000bdd30 0x7f1a0013e3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f19f4013000 tx=0x7f19f4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:01.231 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.225+0000 7f19ee7fc700 1 -- 172.21.15.146:0/2797564490 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4020070 con 0x7f1a000bdd30 2021-01-27T09:45:01.232 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.225+0000 7f19ee7fc700 1 -- 172.21.15.146:0/2797564490 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f401c420 con 0x7f1a000bdd30 2021-01-27T09:45:01.232 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.225+0000 7f1a04dda700 1 -- 172.21.15.146:0/2797564490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a0013c7d0 con 0x7f1a000bdd30 2021-01-27T09:45:01.232 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.225+0000 7f19ee7fc700 1 -- 172.21.15.146:0/2797564490 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f401c7c0 con 0x7f1a000bdd30 2021-01-27T09:45:01.232 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.225+0000 7f1a04dda700 1 -- 172.21.15.146:0/2797564490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a00148140 con 0x7f1a000bdd30 2021-01-27T09:45:01.232 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.225+0000 7f1a04dda700 1 -- 172.21.15.146:0/2797564490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a00044ee0 con 0x7f1a000bdd30 2021-01-27T09:45:01.233 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.225+0000 7f19ee7fc700 1 -- 172.21.15.146:0/2797564490 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f19f400f070 con 0x7f1a000bdd30 2021-01-27T09:45:01.233 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.225+0000 7f19ee7fc700 1 --2- 172.21.15.146:0/2797564490 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f19dc0561b0 0x7f19dc058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:01.234 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.225+0000 7f19ee7fc700 1 -- 172.21.15.146:0/2797564490 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f19f4070330 con 0x7f1a000bdd30 2021-01-27T09:45:01.234 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.225+0000 7f19fe59c700 1 --2- 172.21.15.146:0/2797564490 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f19dc0561b0 0x7f19dc058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:01.234 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.229+0000 7f19fe59c700 1 --2- 172.21.15.146:0/2797564490 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f19dc0561b0 0x7f19dc058670 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f19f000f2a0 tx=0x7f19f0009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:01.235 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.229+0000 7f19ee7fc700 1 -- 172.21.15.146:0/2797564490 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f19f4045960 con 0x7f1a000bdd30 2021-01-27T09:45:01.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.369+0000 7f1a04dda700 1 -- 172.21.15.146:0/2797564490 --> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a00063c20 con 0x7f19dc0561b0 2021-01-27T09:45:01.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.377+0000 7f19ee7fc700 1 -- 172.21.15.146:0/2797564490 <== mgr.4104 v2:172.21.15.78:6832/15486 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+101299 (secure 0 0 0) 0x7f1a00063c20 con 0x7f19dc0561b0 2021-01-27T09:45:01.382 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:45:01.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.381+0000 7f1a04dda700 1 -- 172.21.15.146:0/2797564490 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f19dc0561b0 msgr2=0x7f19dc058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:01.384 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.381+0000 7f1a04dda700 1 --2- 172.21.15.146:0/2797564490 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f19dc0561b0 0x7f19dc058670 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f19f000f2a0 tx=0x7f19f0009040).stop 2021-01-27T09:45:01.384 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.381+0000 7f1a04dda700 1 -- 172.21.15.146:0/2797564490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a000bdd30 msgr2=0x7f1a0013e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:01.384 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.381+0000 7f1a04dda700 1 --2- 172.21.15.146:0/2797564490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a000bdd30 0x7f1a0013e3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f19f4013000 tx=0x7f19f4016000).stop 2021-01-27T09:45:01.384 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.381+0000 7f1a04dda700 1 -- 172.21.15.146:0/2797564490 shutdown_connections 2021-01-27T09:45:01.385 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.381+0000 7f1a04dda700 1 --2- 172.21.15.146:0/2797564490 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1a000be110 0x7f1a0013e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.385 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.381+0000 7f1a04dda700 1 --2- 172.21.15.146:0/2797564490 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f19dc0561b0 0x7f19dc058670 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.385 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.381+0000 7f1a04dda700 1 --2- 172.21.15.146:0/2797564490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a000bdd30 0x7f1a0013e3c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.385 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.381+0000 7f1a04dda700 1 --2- 172.21.15.146:0/2797564490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a00067830 0x7f1a00161470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.386 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.381+0000 7f1a04dda700 1 -- 172.21.15.146:0/2797564490 >> 172.21.15.146:0/2797564490 conn(0x7f1a00069110 msgr2=0x7f1a001446e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:01.386 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.381+0000 7f1a04dda700 1 -- 172.21.15.146:0/2797564490 shutdown_connections 2021-01-27T09:45:01.386 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.381+0000 7f1a04dda700 1 -- 172.21.15.146:0/2797564490 wait complete. 2021-01-27T09:45:01.387 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2021-01-27T09:45:01.407 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2021-01-27T09:45:00.449582+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6354,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41620,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":754933100,"statfs":{"total":773094113280,"available":773051494400,"internally_reserved":0,"allocated":2314240,"data_stored":912406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2660,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004047"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.369789+0000","last_change":"2021-01-27T09:44:26.437753+0000","last_active":"2021-01-27T09:44:33.369789+0000","last_peered":"2021-01-27T09:44:33.369789+0000","last_clean":"2021-01-27T09:44:33.369789+0000","last_became_active":"2021-01-27T09:44:26.437402+0000","last_became_peered":"2021-01-27T09:44:26.437402+0000","last_unstale":"2021-01-27T09:44:33.369789+0000","last_undegraded":"2021-01-27T09:44:33.369789+0000","last_fullsized":"2021-01-27T09:44:33.369789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'9","reported_seq":"23","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.616159+0000","last_change":"2021-01-27T09:44:28.931645+0000","last_active":"2021-01-27T09:44:51.616159+0000","last_peered":"2021-01-27T09:44:51.616159+0000","last_clean":"2021-01-27T09:44:51.616159+0000","last_became_active":"2021-01-27T09:44:28.931347+0000","last_became_peered":"2021-01-27T09:44:28.931347+0000","last_unstale":"2021-01-27T09:44:51.616159+0000","last_undegraded":"2021-01-27T09:44:51.616159+0000","last_fullsized":"2021-01-27T09:44:51.616159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.364949+0000","last_change":"2021-01-27T09:44:29.336652+0000","last_active":"2021-01-27T09:44:33.364949+0000","last_peered":"2021-01-27T09:44:33.364949+0000","last_clean":"2021-01-27T09:44:33.364949+0000","last_became_active":"2021-01-27T09:44:29.336207+0000","last_became_peered":"2021-01-27T09:44:29.336207+0000","last_unstale":"2021-01-27T09:44:33.364949+0000","last_undegraded":"2021-01-27T09:44:33.364949+0000","last_fullsized":"2021-01-27T09:44:33.364949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.382353+0000","last_change":"2021-01-27T09:44:33.381360+0000","last_active":"2021-01-27T09:44:33.382353+0000","last_peered":"2021-01-27T09:44:33.382353+0000","last_clean":"2021-01-27T09:44:33.382353+0000","last_became_active":"2021-01-27T09:44:33.380037+0000","last_became_peered":"2021-01-27T09:44:33.380037+0000","last_unstale":"2021-01-27T09:44:33.382353+0000","last_undegraded":"2021-01-27T09:44:33.382353+0000","last_fullsized":"2021-01-27T09:44:33.382353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"17","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.372796+0000","last_change":"2021-01-27T09:44:26.436242+0000","last_active":"2021-01-27T09:44:33.372796+0000","last_peered":"2021-01-27T09:44:33.372796+0000","last_clean":"2021-01-27T09:44:33.372796+0000","last_became_active":"2021-01-27T09:44:26.435467+0000","last_became_peered":"2021-01-27T09:44:26.435467+0000","last_unstale":"2021-01-27T09:44:33.372796+0000","last_undegraded":"2021-01-27T09:44:33.372796+0000","last_fullsized":"2021-01-27T09:44:33.372796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'17","reported_seq":"31","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.618737+0000","last_change":"2021-01-27T09:44:28.934250+0000","last_active":"2021-01-27T09:44:51.618737+0000","last_peered":"2021-01-27T09:44:51.618737+0000","last_clean":"2021-01-27T09:44:51.618737+0000","last_became_active":"2021-01-27T09:44:28.933897+0000","last_became_peered":"2021-01-27T09:44:28.933897+0000","last_unstale":"2021-01-27T09:44:51.618737+0000","last_undegraded":"2021-01-27T09:44:51.618737+0000","last_fullsized":"2021-01-27T09:44:51.618737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":666,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.374140+0000","last_change":"2021-01-27T09:44:29.341412+0000","last_active":"2021-01-27T09:44:33.374140+0000","last_peered":"2021-01-27T09:44:33.374140+0000","last_clean":"2021-01-27T09:44:33.374140+0000","last_became_active":"2021-01-27T09:44:29.341016+0000","last_became_peered":"2021-01-27T09:44:29.341016+0000","last_unstale":"2021-01-27T09:44:33.374140+0000","last_undegraded":"2021-01-27T09:44:33.374140+0000","last_fullsized":"2021-01-27T09:44:33.374140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.380375+0000","last_change":"2021-01-27T09:44:33.378505+0000","last_active":"2021-01-27T09:44:33.380375+0000","last_peered":"2021-01-27T09:44:33.380375+0000","last_clean":"2021-01-27T09:44:33.380375+0000","last_became_active":"2021-01-27T09:44:33.377285+0000","last_became_peered":"2021-01-27T09:44:33.377285+0000","last_unstale":"2021-01-27T09:44:33.380375+0000","last_undegraded":"2021-01-27T09:44:33.380375+0000","last_fullsized":"2021-01-27T09:44:33.380375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368923+0000","last_change":"2021-01-27T09:44:25.841172+0000","last_active":"2021-01-27T09:44:33.368923+0000","last_peered":"2021-01-27T09:44:33.368923+0000","last_clean":"2021-01-27T09:44:33.368923+0000","last_became_active":"2021-01-27T09:44:25.840711+0000","last_became_peered":"2021-01-27T09:44:25.840711+0000","last_unstale":"2021-01-27T09:44:33.368923+0000","last_undegraded":"2021-01-27T09:44:33.368923+0000","last_fullsized":"2021-01-27T09:44:33.368923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'16","reported_seq":"30","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.615709+0000","last_change":"2021-01-27T09:44:28.932871+0000","last_active":"2021-01-27T09:44:51.615709+0000","last_peered":"2021-01-27T09:44:51.615709+0000","last_clean":"2021-01-27T09:44:51.615709+0000","last_became_active":"2021-01-27T09:44:28.932513+0000","last_became_peered":"2021-01-27T09:44:28.932513+0000","last_unstale":"2021-01-27T09:44:51.615709+0000","last_undegraded":"2021-01-27T09:44:51.615709+0000","last_fullsized":"2021-01-27T09:44:51.615709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3478,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.366893+0000","last_change":"2021-01-27T09:44:29.350508+0000","last_active":"2021-01-27T09:44:33.366893+0000","last_peered":"2021-01-27T09:44:33.366893+0000","last_clean":"2021-01-27T09:44:33.366893+0000","last_became_active":"2021-01-27T09:44:29.350179+0000","last_became_peered":"2021-01-27T09:44:29.350179+0000","last_unstale":"2021-01-27T09:44:33.366893+0000","last_undegraded":"2021-01-27T09:44:33.366893+0000","last_fullsized":"2021-01-27T09:44:33.366893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.442441+0000","last_change":"2021-01-27T09:44:33.441051+0000","last_active":"2021-01-27T09:44:33.442441+0000","last_peered":"2021-01-27T09:44:33.442441+0000","last_clean":"2021-01-27T09:44:33.442441+0000","last_became_active":"2021-01-27T09:44:33.439809+0000","last_became_peered":"2021-01-27T09:44:33.439809+0000","last_unstale":"2021-01-27T09:44:33.442441+0000","last_undegraded":"2021-01-27T09:44:33.442441+0000","last_fullsized":"2021-01-27T09:44:33.442441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"17","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.437810+0000","last_change":"2021-01-27T09:44:26.405089+0000","last_active":"2021-01-27T09:44:33.437810+0000","last_peered":"2021-01-27T09:44:33.437810+0000","last_clean":"2021-01-27T09:44:33.437810+0000","last_became_active":"2021-01-27T09:44:26.403537+0000","last_became_peered":"2021-01-27T09:44:26.403537+0000","last_unstale":"2021-01-27T09:44:33.437810+0000","last_undegraded":"2021-01-27T09:44:33.437810+0000","last_fullsized":"2021-01-27T09:44:33.437810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'10","reported_seq":"23","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.617676+0000","last_change":"2021-01-27T09:44:28.932480+0000","last_active":"2021-01-27T09:44:51.617676+0000","last_peered":"2021-01-27T09:44:51.617676+0000","last_clean":"2021-01-27T09:44:51.617676+0000","last_became_active":"2021-01-27T09:44:28.932127+0000","last_became_peered":"2021-01-27T09:44:28.932127+0000","last_unstale":"2021-01-27T09:44:51.617676+0000","last_undegraded":"2021-01-27T09:44:51.617676+0000","last_fullsized":"2021-01-27T09:44:51.617676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":736,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.366915+0000","last_change":"2021-01-27T09:44:29.338414+0000","last_active":"2021-01-27T09:44:33.366915+0000","last_peered":"2021-01-27T09:44:33.366915+0000","last_clean":"2021-01-27T09:44:33.366915+0000","last_became_active":"2021-01-27T09:44:29.337813+0000","last_became_peered":"2021-01-27T09:44:29.337813+0000","last_unstale":"2021-01-27T09:44:33.366915+0000","last_undegraded":"2021-01-27T09:44:33.366915+0000","last_fullsized":"2021-01-27T09:44:33.366915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.448516+0000","last_change":"2021-01-27T09:44:33.442248+0000","last_active":"2021-01-27T09:44:33.448516+0000","last_peered":"2021-01-27T09:44:33.448516+0000","last_clean":"2021-01-27T09:44:33.448516+0000","last_became_active":"2021-01-27T09:44:33.440410+0000","last_became_peered":"2021-01-27T09:44:33.440410+0000","last_unstale":"2021-01-27T09:44:33.448516+0000","last_undegraded":"2021-01-27T09:44:33.448516+0000","last_fullsized":"2021-01-27T09:44:33.448516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.442528+0000","last_change":"2021-01-27T09:44:33.441395+0000","last_active":"2021-01-27T09:44:33.442528+0000","last_peered":"2021-01-27T09:44:33.442528+0000","last_clean":"2021-01-27T09:44:33.442528+0000","last_became_active":"2021-01-27T09:44:33.440377+0000","last_became_peered":"2021-01-27T09:44:33.440377+0000","last_unstale":"2021-01-27T09:44:33.442528+0000","last_undegraded":"2021-01-27T09:44:33.442528+0000","last_fullsized":"2021-01-27T09:44:33.442528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"26'18","reported_seq":"31","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.608717+0000","last_change":"2021-01-27T09:44:28.929059+0000","last_active":"2021-01-27T09:44:51.608717+0000","last_peered":"2021-01-27T09:44:51.608717+0000","last_clean":"2021-01-27T09:44:51.608717+0000","last_became_active":"2021-01-27T09:44:28.928444+0000","last_became_peered":"2021-01-27T09:44:28.928444+0000","last_unstale":"2021-01-27T09:44:51.608717+0000","last_undegraded":"2021-01-27T09:44:51.608717+0000","last_fullsized":"2021-01-27T09:44:51.608717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":642,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368690+0000","last_change":"2021-01-27T09:44:26.403671+0000","last_active":"2021-01-27T09:44:33.368690+0000","last_peered":"2021-01-27T09:44:33.368690+0000","last_clean":"2021-01-27T09:44:33.368690+0000","last_became_active":"2021-01-27T09:44:26.403137+0000","last_became_peered":"2021-01-27T09:44:26.403137+0000","last_unstale":"2021-01-27T09:44:33.368690+0000","last_undegraded":"2021-01-27T09:44:33.368690+0000","last_fullsized":"2021-01-27T09:44:33.368690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.367795+0000","last_change":"2021-01-27T09:44:29.347824+0000","last_active":"2021-01-27T09:44:33.367795+0000","last_peered":"2021-01-27T09:44:33.367795+0000","last_clean":"2021-01-27T09:44:33.367795+0000","last_became_active":"2021-01-27T09:44:29.347463+0000","last_became_peered":"2021-01-27T09:44:29.347463+0000","last_unstale":"2021-01-27T09:44:33.367795+0000","last_undegraded":"2021-01-27T09:44:33.367795+0000","last_fullsized":"2021-01-27T09:44:33.367795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.443462+0000","last_change":"2021-01-27T09:44:33.441988+0000","last_active":"2021-01-27T09:44:33.443462+0000","last_peered":"2021-01-27T09:44:33.443462+0000","last_clean":"2021-01-27T09:44:33.443462+0000","last_became_active":"2021-01-27T09:44:33.440172+0000","last_became_peered":"2021-01-27T09:44:33.440172+0000","last_unstale":"2021-01-27T09:44:33.443462+0000","last_undegraded":"2021-01-27T09:44:33.443462+0000","last_fullsized":"2021-01-27T09:44:33.443462+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"26'21","reported_seq":"35","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.618079+0000","last_change":"2021-01-27T09:44:28.930780+0000","last_active":"2021-01-27T09:44:51.618079+0000","last_peered":"2021-01-27T09:44:51.618079+0000","last_clean":"2021-01-27T09:44:51.618079+0000","last_became_active":"2021-01-27T09:44:28.930374+0000","last_became_peered":"2021-01-27T09:44:28.930374+0000","last_unstale":"2021-01-27T09:44:51.618079+0000","last_undegraded":"2021-01-27T09:44:51.618079+0000","last_fullsized":"2021-01-27T09:44:51.618079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":112,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"17","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.372343+0000","last_change":"2021-01-27T09:44:25.838965+0000","last_active":"2021-01-27T09:44:33.372343+0000","last_peered":"2021-01-27T09:44:33.372343+0000","last_clean":"2021-01-27T09:44:33.372343+0000","last_became_active":"2021-01-27T09:44:25.838635+0000","last_became_peered":"2021-01-27T09:44:25.838635+0000","last_unstale":"2021-01-27T09:44:33.372343+0000","last_undegraded":"2021-01-27T09:44:33.372343+0000","last_fullsized":"2021-01-27T09:44:33.372343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.367109+0000","last_change":"2021-01-27T09:44:29.348218+0000","last_active":"2021-01-27T09:44:33.367109+0000","last_peered":"2021-01-27T09:44:33.367109+0000","last_clean":"2021-01-27T09:44:33.367109+0000","last_became_active":"2021-01-27T09:44:29.347905+0000","last_became_peered":"2021-01-27T09:44:29.347905+0000","last_unstale":"2021-01-27T09:44:33.367109+0000","last_undegraded":"2021-01-27T09:44:33.367109+0000","last_fullsized":"2021-01-27T09:44:33.367109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.380414+0000","last_change":"2021-01-27T09:44:33.378828+0000","last_active":"2021-01-27T09:44:33.380414+0000","last_peered":"2021-01-27T09:44:33.380414+0000","last_clean":"2021-01-27T09:44:33.380414+0000","last_became_active":"2021-01-27T09:44:33.376984+0000","last_became_peered":"2021-01-27T09:44:33.376984+0000","last_unstale":"2021-01-27T09:44:33.380414+0000","last_undegraded":"2021-01-27T09:44:33.380414+0000","last_fullsized":"2021-01-27T09:44:33.380414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"26'12","reported_seq":"26","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.617400+0000","last_change":"2021-01-27T09:44:28.933091+0000","last_active":"2021-01-27T09:44:51.617400+0000","last_peered":"2021-01-27T09:44:51.617400+0000","last_clean":"2021-01-27T09:44:51.617400+0000","last_became_active":"2021-01-27T09:44:28.932701+0000","last_became_peered":"2021-01-27T09:44:28.932701+0000","last_unstale":"2021-01-27T09:44:51.617400+0000","last_undegraded":"2021-01-27T09:44:51.617400+0000","last_fullsized":"2021-01-27T09:44:51.617400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":720,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368552+0000","last_change":"2021-01-27T09:44:25.737081+0000","last_active":"2021-01-27T09:44:33.368552+0000","last_peered":"2021-01-27T09:44:33.368552+0000","last_clean":"2021-01-27T09:44:33.368552+0000","last_became_active":"2021-01-27T09:44:25.736516+0000","last_became_peered":"2021-01-27T09:44:25.736516+0000","last_unstale":"2021-01-27T09:44:33.368552+0000","last_undegraded":"2021-01-27T09:44:33.368552+0000","last_fullsized":"2021-01-27T09:44:33.368552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.437701+0000","last_change":"2021-01-27T09:44:29.347815+0000","last_active":"2021-01-27T09:44:33.437701+0000","last_peered":"2021-01-27T09:44:33.437701+0000","last_clean":"2021-01-27T09:44:33.437701+0000","last_became_active":"2021-01-27T09:44:29.347415+0000","last_became_peered":"2021-01-27T09:44:29.347415+0000","last_unstale":"2021-01-27T09:44:33.437701+0000","last_undegraded":"2021-01-27T09:44:33.437701+0000","last_fullsized":"2021-01-27T09:44:33.437701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.437850+0000","last_change":"2021-01-27T09:44:33.436705+0000","last_active":"2021-01-27T09:44:33.437850+0000","last_peered":"2021-01-27T09:44:33.437850+0000","last_clean":"2021-01-27T09:44:33.437850+0000","last_became_active":"2021-01-27T09:44:33.435975+0000","last_became_peered":"2021-01-27T09:44:33.435975+0000","last_unstale":"2021-01-27T09:44:33.437850+0000","last_undegraded":"2021-01-27T09:44:33.437850+0000","last_fullsized":"2021-01-27T09:44:33.437850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'8","reported_seq":"22","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.612586+0000","last_change":"2021-01-27T09:44:28.930455+0000","last_active":"2021-01-27T09:44:51.612586+0000","last_peered":"2021-01-27T09:44:51.612586+0000","last_clean":"2021-01-27T09:44:51.612586+0000","last_became_active":"2021-01-27T09:44:28.930088+0000","last_became_peered":"2021-01-27T09:44:28.930088+0000","last_unstale":"2021-01-27T09:44:51.612586+0000","last_undegraded":"2021-01-27T09:44:51.612586+0000","last_fullsized":"2021-01-27T09:44:51.612586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368647+0000","last_change":"2021-01-27T09:44:25.736301+0000","last_active":"2021-01-27T09:44:33.368647+0000","last_peered":"2021-01-27T09:44:33.368647+0000","last_clean":"2021-01-27T09:44:33.368647+0000","last_became_active":"2021-01-27T09:44:25.735741+0000","last_became_peered":"2021-01-27T09:44:25.735741+0000","last_unstale":"2021-01-27T09:44:33.368647+0000","last_undegraded":"2021-01-27T09:44:33.368647+0000","last_fullsized":"2021-01-27T09:44:33.368647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"20","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.432653+0000","last_change":"2021-01-27T09:44:24.570544+0000","last_active":"2021-01-27T09:44:33.432653+0000","last_peered":"2021-01-27T09:44:33.432653+0000","last_clean":"2021-01-27T09:44:33.432653+0000","last_became_active":"2021-01-27T09:44:24.569755+0000","last_became_peered":"2021-01-27T09:44:24.569755+0000","last_unstale":"2021-01-27T09:44:33.432653+0000","last_undegraded":"2021-01-27T09:44:33.432653+0000","last_fullsized":"2021-01-27T09:44:33.432653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:19.429176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:19.429176+0000","last_clean_scrub_stamp":"2021-01-27T09:44:19.429176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368821+0000","last_change":"2021-01-27T09:44:29.337716+0000","last_active":"2021-01-27T09:44:33.368821+0000","last_peered":"2021-01-27T09:44:33.368821+0000","last_clean":"2021-01-27T09:44:33.368821+0000","last_became_active":"2021-01-27T09:44:29.337355+0000","last_became_peered":"2021-01-27T09:44:29.337355+0000","last_unstale":"2021-01-27T09:44:33.368821+0000","last_undegraded":"2021-01-27T09:44:33.368821+0000","last_fullsized":"2021-01-27T09:44:33.368821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":6354,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":12708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5136,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366704,"statfs":{"total":96636764160,"available":96631504896,"internally_reserved":0,"allocated":270336,"data_stored":112757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.875}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5030000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.895}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.395}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5179999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8439999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7709999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5240,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366600,"statfs":{"total":96636764160,"available":96631398400,"internally_reserved":0,"allocated":311296,"data_stored":114069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6850000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1080000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4889999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6909999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0369999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7240000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6509999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5136,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366704,"statfs":{"total":96636764160,"available":96631504896,"internally_reserved":0,"allocated":270336,"data_stored":112757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2480000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.667}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3580000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4670000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6349999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0459999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5569999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5148,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366692,"statfs":{"total":96636764160,"available":96631492608,"internally_reserved":0,"allocated":282624,"data_stored":112613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6890000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5269999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.587}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2160000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2530000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8919999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.391}]}]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5204,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366636,"statfs":{"total":96636764160,"available":96631435264,"internally_reserved":0,"allocated":274432,"data_stored":112083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3119999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1309999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.536}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6659999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1859999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8759999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6269999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":118357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1640000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.806}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9809999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5459999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4770000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5224,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366616,"statfs":{"total":96636764160,"available":96631414784,"internally_reserved":0,"allocated":294912,"data_stored":116347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.607}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6619999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8540000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5369999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4460000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7770000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5212,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366628,"statfs":{"total":96636764160,"available":96631427072,"internally_reserved":0,"allocated":282624,"data_stored":113423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.754}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2669999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.98}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6360000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0990000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4860000000000002}]}]}]}} 2021-01-27T09:45:01.410 INFO:tasks.ceph.ceph_manager.ceph:clean! 2021-01-27T09:45:01.410 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-01-27T09:45:01.411 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2021-01-27T09:45:01.411 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-01-27T09:45:01.570 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.569+0000 7fd5be3c9700 1 Processor -- start 2021-01-27T09:45:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.569+0000 7fd5be3c9700 1 -- start start 2021-01-27T09:45:01.572 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.569+0000 7fd5be3c9700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd5b8147b30 0x7fd5b80672b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:01.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.569+0000 7fd5be3c9700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5b8064d20 0x7fd5b8065170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:01.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.569+0000 7fd5be3c9700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b81513e0 con 0x7fd5b8147f10 2021-01-27T09:45:01.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.569+0000 7fd5be3c9700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b80be8a0 con 0x7fd5b8147b30 2021-01-27T09:45:01.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.569+0000 7fd5be3c9700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b80677a0 con 0x7fd5b8064d20 2021-01-27T09:45:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.569+0000 7fd5bcbc6700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd5b8147f10 0x7fd5b8062810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:34570/0 (socket says 172.21.15.146:34570) 2021-01-27T09:45:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.569+0000 7fd5bcbc6700 1 -- 172.21.15.146:0/1238294481 learned_addr learned my addr 172.21.15.146:0/1238294481 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:01.577 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.569+0000 7fd5bd3c7700 1 --2- 172.21.15.146:0/1238294481 >> v2:172.21.15.78:3300/0 conn(0x7fd5b8147b30 0x7fd5b80672b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:01.577 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.569+0000 7fd5bdbc8700 1 --2- 172.21.15.146:0/1238294481 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5b8064d20 0x7fd5b8065170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:01.577 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.569+0000 7fd5b7fff700 1 -- 172.21.15.146:0/1238294481 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 17416703 0 0) 0x7fd5b81513e0 con 0x7fd5b8147f10 2021-01-27T09:45:01.577 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.569+0000 7fd5b7fff700 1 -- 172.21.15.146:0/1238294481 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5a4003270 con 0x7fd5b8147f10 2021-01-27T09:45:01.578 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5b7fff700 1 -- 172.21.15.146:0/1238294481 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2839343486 0 0) 0x7fd5a4003270 con 0x7fd5b8147f10 2021-01-27T09:45:01.578 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5b7fff700 1 -- 172.21.15.146:0/1238294481 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5b8064d20 msgr2=0x7fd5b8065170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:01.578 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5b7fff700 1 --2- 172.21.15.146:0/1238294481 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5b8064d20 0x7fd5b8065170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.578 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5b7fff700 1 -- 172.21.15.146:0/1238294481 >> v2:172.21.15.78:3300/0 conn(0x7fd5b8147b30 msgr2=0x7fd5b80672b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:01.579 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5b7fff700 1 --2- 172.21.15.146:0/1238294481 >> v2:172.21.15.78:3300/0 conn(0x7fd5b8147b30 0x7fd5b80672b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.579 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5b7fff700 1 -- 172.21.15.146:0/1238294481 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b8151680 con 0x7fd5b8147f10 2021-01-27T09:45:01.579 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5b7fff700 1 -- 172.21.15.146:0/1238294481 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3890990827 0 0) 0x7fd5ac001540 con 0x7fd5b8147f10 2021-01-27T09:45:01.579 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5b7fff700 1 -- 172.21.15.146:0/1238294481 >> v1:172.21.15.78:6789/0 conn(0x7fd5b8147f10 legacy=0x7fd5b8062810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:01.580 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5b7fff700 1 --2- 172.21.15.146:0/1238294481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5a4003860 0x7fd5a4003c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:01.580 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5b7fff700 1 --2- 172.21.15.146:0/1238294481 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5b8064d20 0x7fd5a4004510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:01.580 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5b7fff700 1 --2- 172.21.15.146:0/1238294481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a4004a00 0x7fd5a4004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:01.580 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5b7fff700 1 -- 172.21.15.146:0/1238294481 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b80be8a0 con 0x7fd5a4003860 2021-01-27T09:45:01.581 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5b7fff700 1 -- 172.21.15.146:0/1238294481 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b80677a0 con 0x7fd5a4004a00 2021-01-27T09:45:01.581 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5b7fff700 1 -- 172.21.15.146:0/1238294481 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a40053a0 con 0x7fd5b8064d20 2021-01-27T09:45:01.581 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5bcbc6700 1 --2- 172.21.15.146:0/1238294481 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5b8064d20 0x7fd5a4004510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:01.581 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5bd3c7700 1 --2- 172.21.15.146:0/1238294481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5a4003860 0x7fd5a4003c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:01.582 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5bdbc8700 1 --2- 172.21.15.146:0/1238294481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a4004a00 0x7fd5a4004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:01.582 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5bcbc6700 1 -- 172.21.15.146:0/1238294481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a4004a00 msgr2=0x7fd5a4004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:01.582 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5bcbc6700 1 --2- 172.21.15.146:0/1238294481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a4004a00 0x7fd5a4004e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.582 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5bcbc6700 1 -- 172.21.15.146:0/1238294481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5a4003860 msgr2=0x7fd5a4003c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:01.582 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5bcbc6700 1 --2- 172.21.15.146:0/1238294481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5a4003860 0x7fd5a4003c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.583 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5bcbc6700 1 -- 172.21.15.146:0/1238294481 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a4003270 con 0x7fd5b8064d20 2021-01-27T09:45:01.583 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5bd3c7700 1 --2- 172.21.15.146:0/1238294481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5a4003860 0x7fd5a4003c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:45:01.586 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5bcbc6700 1 --2- 172.21.15.146:0/1238294481 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5b8064d20 0x7fd5a4004510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fd5ac00c410 tx=0x7fd5b814dc90).ready entity=mon.2 client_cookie=4bff5be9a3da628c server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:01.586 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5b7fff700 1 -- 172.21.15.146:0/1238294481 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac007720 con 0x7fd5b8064d20 2021-01-27T09:45:01.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5b7fff700 1 -- 172.21.15.146:0/1238294481 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ac0070d0 con 0x7fd5b8064d20 2021-01-27T09:45:01.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.573+0000 7fd5b7fff700 1 -- 172.21.15.146:0/1238294481 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac00cea0 con 0x7fd5b8064d20 2021-01-27T09:45:01.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.577+0000 7fd5be3c9700 1 -- 172.21.15.146:0/1238294481 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5b8064d20 msgr2=0x7fd5a4004510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:01.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.577+0000 7fd5be3c9700 1 --2- 172.21.15.146:0/1238294481 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5b8064d20 0x7fd5a4004510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fd5ac00c410 tx=0x7fd5b814dc90).stop 2021-01-27T09:45:01.588 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.577+0000 7fd5bdbc8700 1 -- 172.21.15.146:0/1238294481 reap_dead start 2021-01-27T09:45:01.588 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.577+0000 7fd5be3c9700 1 -- 172.21.15.146:0/1238294481 shutdown_connections 2021-01-27T09:45:01.588 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.577+0000 7fd5be3c9700 1 -- 172.21.15.146:0/1238294481 >> 172.21.15.146:0/1238294481 conn(0x7fd5b8067d30 msgr2=0x7fd5b8068110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:01.588 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.577+0000 7fd5be3c9700 1 -- 172.21.15.146:0/1238294481 shutdown_connections 2021-01-27T09:45:01.589 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.577+0000 7fd5be3c9700 1 -- 172.21.15.146:0/1238294481 wait complete. 2021-01-27T09:45:01.589 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.577+0000 7fd5be3c9700 1 Processor -- start 2021-01-27T09:45:01.589 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.581+0000 7fd5be3c9700 1 -- start start 2021-01-27T09:45:01.589 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.581+0000 7fd5be3c9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5b8143010 0x7fd5b815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:01.590 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.581+0000 7fd5be3c9700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5b80bdaa0 0x7fd5b8150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:01.590 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.581+0000 7fd5be3c9700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5b8150c10 0x7fd5b80c2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:01.590 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.581+0000 7fd5be3c9700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b815d4a0 con 0x7fd5b8150c10 2021-01-27T09:45:01.590 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.581+0000 7fd5be3c9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b80c3a30 con 0x7fd5b8143010 2021-01-27T09:45:01.591 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.581+0000 7fd5be3c9700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b80c3f10 con 0x7fd5b80bdaa0 2021-01-27T09:45:01.591 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.581+0000 7fd5bd3c7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5b8143010 0x7fd5b815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:01.591 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.581+0000 7fd5bd3c7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5b8143010 0x7fd5b815ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46976/0 (socket says 172.21.15.146:46976) 2021-01-27T09:45:01.591 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.581+0000 7fd5bd3c7700 1 -- 172.21.15.146:0/3291515041 learned_addr learned my addr 172.21.15.146:0/3291515041 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:01.591 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.581+0000 7fd5bcbc6700 1 --2- 172.21.15.146:0/3291515041 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5b80bdaa0 0x7fd5b8150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:01.592 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.581+0000 7fd5bdbc8700 1 --2- 172.21.15.146:0/3291515041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5b8150c10 0x7fd5b80c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:01.592 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.581+0000 7fd5bd3c7700 1 -- 172.21.15.146:0/3291515041 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5b80bdaa0 msgr2=0x7fd5b8150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:01.592 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.581+0000 7fd5bd3c7700 1 --2- 172.21.15.146:0/3291515041 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5b80bdaa0 0x7fd5b8150720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.592 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.581+0000 7fd5bd3c7700 1 -- 172.21.15.146:0/3291515041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5b8150c10 msgr2=0x7fd5b80c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:01.592 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.581+0000 7fd5bd3c7700 1 --2- 172.21.15.146:0/3291515041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5b8150c10 0x7fd5b80c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.593 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.581+0000 7fd5bd3c7700 1 -- 172.21.15.146:0/3291515041 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b80c4170 con 0x7fd5b8143010 2021-01-27T09:45:01.593 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.581+0000 7fd5bd3c7700 1 --2- 172.21.15.146:0/3291515041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5b8143010 0x7fd5b815ddd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fd5a800f370 tx=0x7fd5a8009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:01.593 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.581+0000 7fd5b57fa700 1 -- 172.21.15.146:0/3291515041 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a800fe50 con 0x7fd5b8143010 2021-01-27T09:45:01.593 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.581+0000 7fd5b57fa700 1 -- 172.21.15.146:0/3291515041 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a8014440 con 0x7fd5b8143010 2021-01-27T09:45:01.594 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.581+0000 7fd5b57fa700 1 -- 172.21.15.146:0/3291515041 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a80147c0 con 0x7fd5b8143010 2021-01-27T09:45:01.594 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.581+0000 7fd5be3c9700 1 -- 172.21.15.146:0/3291515041 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b815d690 con 0x7fd5b8143010 2021-01-27T09:45:01.594 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.585+0000 7fd5be3c9700 1 -- 172.21.15.146:0/3291515041 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b814bed0 con 0x7fd5b8143010 2021-01-27T09:45:01.595 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.585+0000 7fd5be3c9700 1 -- 172.21.15.146:0/3291515041 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b8044ee0 con 0x7fd5b8143010 2021-01-27T09:45:01.595 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.585+0000 7fd5b57fa700 1 -- 172.21.15.146:0/3291515041 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fd5a8024070 con 0x7fd5b8143010 2021-01-27T09:45:01.595 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.585+0000 7fd5b57fa700 1 --2- 172.21.15.146:0/3291515041 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd5980561e0 0x7fd5980586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:01.596 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.585+0000 7fd5b57fa700 1 -- 172.21.15.146:0/3291515041 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fd5a8070280 con 0x7fd5b8143010 2021-01-27T09:45:01.596 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.589+0000 7fd5bcbc6700 1 --2- 172.21.15.146:0/3291515041 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd5980561e0 0x7fd5980586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:01.596 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.589+0000 7fd5bcbc6700 1 --2- 172.21.15.146:0/3291515041 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd5980561e0 0x7fd5980586a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fd5a4003760 tx=0x7fd5ac015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:01.598 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.597+0000 7fd5b57fa700 1 -- 172.21.15.146:0/3291515041 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fd5a80458d0 con 0x7fd5b8143010 2021-01-27T09:45:01.786 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.785+0000 7fd5be3c9700 1 -- 172.21.15.146:0/3291515041 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd5b8149820 con 0x7fd5b8143010 2021-01-27T09:45:01.787 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.785+0000 7fd5b57fa700 1 -- 172.21.15.146:0/3291515041 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fd5a8022020 con 0x7fd5b8143010 2021-01-27T09:45:01.787 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:45:01.789 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.785+0000 7fd5be3c9700 1 -- 172.21.15.146:0/3291515041 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd5980561e0 msgr2=0x7fd5980586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:01.789 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.785+0000 7fd5be3c9700 1 --2- 172.21.15.146:0/3291515041 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd5980561e0 0x7fd5980586a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fd5a4003760 tx=0x7fd5ac015000).stop 2021-01-27T09:45:01.790 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.785+0000 7fd5be3c9700 1 -- 172.21.15.146:0/3291515041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5b8143010 msgr2=0x7fd5b815ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:01.790 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.785+0000 7fd5be3c9700 1 --2- 172.21.15.146:0/3291515041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5b8143010 0x7fd5b815ddd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fd5a800f370 tx=0x7fd5a8009220).stop 2021-01-27T09:45:01.791 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.789+0000 7fd5be3c9700 1 -- 172.21.15.146:0/3291515041 shutdown_connections 2021-01-27T09:45:01.792 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.789+0000 7fd5be3c9700 1 --2- 172.21.15.146:0/3291515041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5b8150c10 0x7fd5b80c2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.792 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.789+0000 7fd5be3c9700 1 --2- 172.21.15.146:0/3291515041 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd5b80bdaa0 0x7fd5b8150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.792 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.789+0000 7fd5be3c9700 1 --2- 172.21.15.146:0/3291515041 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd5980561e0 0x7fd5980586a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.793 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.789+0000 7fd5be3c9700 1 --2- 172.21.15.146:0/3291515041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5b8143010 0x7fd5b815ddd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.793 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.789+0000 7fd5be3c9700 1 -- 172.21.15.146:0/3291515041 >> 172.21.15.146:0/3291515041 conn(0x7fd5b8067d30 msgr2=0x7fd5b8146e90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:01.793 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.789+0000 7fd5be3c9700 1 -- 172.21.15.146:0/3291515041 shutdown_connections 2021-01-27T09:45:01.793 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.789+0000 7fd5be3c9700 1 -- 172.21.15.146:0/3291515041 wait complete. 2021-01-27T09:45:01.814 INFO:teuthology.orchestra.run.smithi146.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-01-27T09:45:01.815 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2021-01-27T09:45:01.816 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-01-27T09:45:01.980 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.977+0000 7f41116cb700 1 Processor -- start 2021-01-27T09:45:01.980 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.977+0000 7f41116cb700 1 -- start start 2021-01-27T09:45:01.983 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.981+0000 7f41116cb700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f410c14b220 0x7f410c064cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:01.983 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.981+0000 7f41116cb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f410c14b600 0x7f410c0be0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:01.983 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.981+0000 7f41116cb700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f410c0b1550 con 0x7f410c0bec50 2021-01-27T09:45:01.984 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.981+0000 7f41116cb700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f410c0651a0 con 0x7f410c14b600 2021-01-27T09:45:01.984 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.981+0000 7f41116cb700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410c064710 con 0x7f410c14b220 2021-01-27T09:45:01.985 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.981+0000 7f410b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f410c0bec50 0x7f410c151540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46558/0 (socket says 172.21.15.146:46558) 2021-01-27T09:45:01.985 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.981+0000 7f410b7fe700 1 -- 172.21.15.146:0/4239251382 learned_addr learned my addr 172.21.15.146:0/4239251382 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:01.986 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.981+0000 7f410a7fc700 1 --2- 172.21.15.146:0/4239251382 >> v2:172.21.15.146:3300/0 conn(0x7f410c14b600 0x7f410c0be0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:01.986 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.981+0000 7f410affd700 1 --2- 172.21.15.146:0/4239251382 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f410c14b220 0x7f410c064cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:01.986 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.981+0000 7f4109ffb700 1 -- 172.21.15.146:0/4239251382 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 217983186 0 0) 0x7f410c0b1550 con 0x7f410c0bec50 2021-01-27T09:45:01.986 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.981+0000 7f4109ffb700 1 -- 172.21.15.146:0/4239251382 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40ec003270 con 0x7f410c0bec50 2021-01-27T09:45:01.987 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.981+0000 7f410a7fc700 1 -- 172.21.15.146:0/4239251382 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f410c14b220 msgr2=0x7f410c064cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:01.987 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.981+0000 7f410a7fc700 1 --2- 172.21.15.146:0/4239251382 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f410c14b220 0x7f410c064cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.987 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.981+0000 7f410a7fc700 1 -- 172.21.15.146:0/4239251382 >> v1:172.21.15.146:6789/0 conn(0x7f410c0bec50 legacy=0x7f410c151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:01.988 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.981+0000 7f410a7fc700 1 -- 172.21.15.146:0/4239251382 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c065fa0 con 0x7f410c14b600 2021-01-27T09:45:01.988 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.981+0000 7f410a7fc700 1 --2- 172.21.15.146:0/4239251382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f410c14b600 0x7f410c0be0d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f40fc00b9c0 tx=0x7f40fc006e20).ready entity=mon.1 client_cookie=345caa630dfaa2a0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:01.989 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.985+0000 7f4109ffb700 1 -- 172.21.15.146:0/4239251382 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc009690 con 0x7f410c14b600 2021-01-27T09:45:01.989 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.985+0000 7f4109ffb700 1 -- 172.21.15.146:0/4239251382 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40fc0097f0 con 0x7f410c14b600 2021-01-27T09:45:01.989 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.985+0000 7f4109ffb700 1 -- 172.21.15.146:0/4239251382 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc009b70 con 0x7f410c14b600 2021-01-27T09:45:01.990 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.985+0000 7f41116cb700 1 -- 172.21.15.146:0/4239251382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f410c14b600 msgr2=0x7f410c0be0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:01.990 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.985+0000 7f41116cb700 1 --2- 172.21.15.146:0/4239251382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f410c14b600 0x7f410c0be0d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f40fc00b9c0 tx=0x7f40fc006e20).stop 2021-01-27T09:45:01.990 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.985+0000 7f41116cb700 1 -- 172.21.15.146:0/4239251382 shutdown_connections 2021-01-27T09:45:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.985+0000 7f41116cb700 1 --2- 172.21.15.146:0/4239251382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f410c14b600 0x7f410c0be0d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.985+0000 7f41116cb700 1 --2- 172.21.15.146:0/4239251382 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f410c14b220 0x7f410c064cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.985+0000 7f41116cb700 1 -- 172.21.15.146:0/4239251382 >> 172.21.15.146:0/4239251382 conn(0x7f410c069110 msgr2=0x7f410c067e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.985+0000 7f41116cb700 1 -- 172.21.15.146:0/4239251382 shutdown_connections 2021-01-27T09:45:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.985+0000 7f41116cb700 1 -- 172.21.15.146:0/4239251382 wait complete. 2021-01-27T09:45:01.993 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.989+0000 7f41116cb700 1 Processor -- start 2021-01-27T09:45:01.993 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.989+0000 7f41116cb700 1 -- start start 2021-01-27T09:45:01.994 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.989+0000 7f41116cb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f410c0bec50 0x7f410c1477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:01.994 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.989+0000 7f41116cb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f410c14b220 0x7f410c14f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:01.994 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.989+0000 7f41116cb700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f410c14b600 0x7f410c1463b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:01.994 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.989+0000 7f41116cb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c14e270 con 0x7f410c0bec50 2021-01-27T09:45:01.995 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.989+0000 7f41116cb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c142c50 con 0x7f410c14b220 2021-01-27T09:45:01.995 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.989+0000 7f41116cb700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410c14d350 con 0x7f410c14b600 2021-01-27T09:45:01.995 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.989+0000 7f410a7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f410c14b220 0x7f410c14f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:01.996 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.989+0000 7f410a7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f410c14b220 0x7f410c14f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46992/0 (socket says 172.21.15.146:46992) 2021-01-27T09:45:01.996 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.989+0000 7f410a7fc700 1 -- 172.21.15.146:0/728917366 learned_addr learned my addr 172.21.15.146:0/728917366 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:01.996 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.989+0000 7f410affd700 1 --2- 172.21.15.146:0/728917366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f410c0bec50 0x7f410c1477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:01.996 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.989+0000 7f410b7fe700 1 --2- 172.21.15.146:0/728917366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f410c14b600 0x7f410c1463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.989+0000 7f410a7fc700 1 -- 172.21.15.146:0/728917366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f410c14b600 msgr2=0x7f410c1463b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.989+0000 7f410a7fc700 1 --2- 172.21.15.146:0/728917366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f410c14b600 0x7f410c1463b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.989+0000 7f410a7fc700 1 -- 172.21.15.146:0/728917366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f410c0bec50 msgr2=0x7f410c1477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.989+0000 7f410a7fc700 1 --2- 172.21.15.146:0/728917366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f410c0bec50 0x7f410c1477b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.989+0000 7f410a7fc700 1 -- 172.21.15.146:0/728917366 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c14d5f0 con 0x7f410c14b220 2021-01-27T09:45:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.989+0000 7f410a7fc700 1 --2- 172.21.15.146:0/728917366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f410c14b220 0x7f410c14f290 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f40fc00b170 tx=0x7f40fc016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.989+0000 7f4102ffd700 1 -- 172.21.15.146:0/728917366 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc012cd0 con 0x7f410c14b220 2021-01-27T09:45:02.000 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.989+0000 7f4102ffd700 1 -- 172.21.15.146:0/728917366 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40fc012e30 con 0x7f410c14b220 2021-01-27T09:45:02.000 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.989+0000 7f41116cb700 1 -- 172.21.15.146:0/728917366 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f410c14d890 con 0x7f410c14b220 2021-01-27T09:45:02.000 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.993+0000 7f4102ffd700 1 -- 172.21.15.146:0/728917366 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc01c650 con 0x7f410c14b220 2021-01-27T09:45:02.001 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.993+0000 7f41116cb700 1 -- 172.21.15.146:0/728917366 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f410c14ddd0 con 0x7f410c14b220 2021-01-27T09:45:02.001 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.993+0000 7f41116cb700 1 -- 172.21.15.146:0/728917366 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f410c044ee0 con 0x7f410c14b220 2021-01-27T09:45:02.001 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.993+0000 7f4102ffd700 1 -- 172.21.15.146:0/728917366 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f40fc00f070 con 0x7f410c14b220 2021-01-27T09:45:02.001 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.993+0000 7f4102ffd700 1 --2- 172.21.15.146:0/728917366 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f40f00561e0 0x7f40f00586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:02.002 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.993+0000 7f4102ffd700 1 -- 172.21.15.146:0/728917366 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f40fc070af0 con 0x7f410c14b220 2021-01-27T09:45:02.002 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.997+0000 7f410affd700 1 --2- 172.21.15.146:0/728917366 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f40f00561e0 0x7f40f00586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:02.002 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:01.997+0000 7f410affd700 1 --2- 172.21.15.146:0/728917366 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f40f00561e0 0x7f40f00586a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f40f400bb90 tx=0x7f40f4006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:02.004 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.001+0000 7f4102ffd700 1 -- 172.21.15.146:0/728917366 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f40fc0461a0 con 0x7f410c14b220 2021-01-27T09:45:02.148 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.145+0000 7f41116cb700 1 -- 172.21.15.146:0/728917366 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f410c063c20 con 0x7f410c14b220 2021-01-27T09:45:02.150 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.149+0000 7f4102ffd700 1 -- 172.21.15.146:0/728917366 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18638 (secure 0 0 0) 0x7f40fc0497c0 con 0x7f410c14b220 2021-01-27T09:45:02.151 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:45:02.151 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":26,"fsid":"968a1bec-aac5-444e-b70f-7770587be945","created":"2021-01-27T09:44:13.797940+0000","modified":"2021-01-27T09:44:33.763400+0000","last_up_change":"2021-01-27T09:44:23.479967+0000","last_in_change":"2021-01-27T09:44:23.479967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T09:44:18.497521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-27T09:44:24.550303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-27T09:44:27.607542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-27T09:44:28.331389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-01-27T09:44:31.378452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25441909-a40b-4d82-828d-326685513ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":14470},{"type":"v1","addr":"172.21.15.146:6801","nonce":14470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":14470},{"type":"v1","addr":"172.21.15.146:6803","nonce":14470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":14470},{"type":"v1","addr":"172.21.15.146:6810","nonce":14470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":14470},{"type":"v1","addr":"172.21.15.146:6807","nonce":14470}]},"public_addr":"172.21.15.146:6801/14470","cluster_addr":"172.21.15.146:6803/14470","heartbeat_back_addr":"172.21.15.146:6810/14470","heartbeat_front_addr":"172.21.15.146:6807/14470","state":["exists","up"]},{"osd":1,"uuid":"825bbc51-2ffe-4612-a300-00960e48be02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":14472},{"type":"v1","addr":"172.21.15.146:6817","nonce":14472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":14472},{"type":"v1","addr":"172.21.15.146:6819","nonce":14472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":14472},{"type":"v1","addr":"172.21.15.146:6827","nonce":14472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":14472},{"type":"v1","addr":"172.21.15.146:6823","nonce":14472}]},"public_addr":"172.21.15.146:6817/14472","cluster_addr":"172.21.15.146:6819/14472","heartbeat_back_addr":"172.21.15.146:6827/14472","heartbeat_front_addr":"172.21.15.146:6823/14472","state":["exists","up"]},{"osd":2,"uuid":"e568b97a-8e71-4ab9-bd64-056892110b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":14474},{"type":"v1","addr":"172.21.15.146:6822","nonce":14474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":14474},{"type":"v1","addr":"172.21.15.146:6826","nonce":14474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":14474},{"type":"v1","addr":"172.21.15.146:6831","nonce":14474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":14474},{"type":"v1","addr":"172.21.15.146:6829","nonce":14474}]},"public_addr":"172.21.15.146:6822/14474","cluster_addr":"172.21.15.146:6826/14474","heartbeat_back_addr":"172.21.15.146:6831/14474","heartbeat_front_addr":"172.21.15.146:6829/14474","state":["exists","up"]},{"osd":3,"uuid":"f5d50f63-f74a-4aea-a62d-51c38db4d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":14471},{"type":"v1","addr":"172.21.15.146:6806","nonce":14471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":14471},{"type":"v1","addr":"172.21.15.146:6811","nonce":14471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":14471},{"type":"v1","addr":"172.21.15.146:6815","nonce":14471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":14471},{"type":"v1","addr":"172.21.15.146:6813","nonce":14471}]},"public_addr":"172.21.15.146:6806/14471","cluster_addr":"172.21.15.146:6811/14471","heartbeat_back_addr":"172.21.15.146:6815/14471","heartbeat_front_addr":"172.21.15.146:6813/14471","state":["exists","up"]},{"osd":4,"uuid":"782458d7-6f52-48f4-9466-67b61ef27016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":15826},{"type":"v1","addr":"172.21.15.78:6817","nonce":15826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":15826},{"type":"v1","addr":"172.21.15.78:6819","nonce":15826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":15826},{"type":"v1","addr":"172.21.15.78:6823","nonce":15826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":15826},{"type":"v1","addr":"172.21.15.78:6821","nonce":15826}]},"public_addr":"172.21.15.78:6817/15826","cluster_addr":"172.21.15.78:6819/15826","heartbeat_back_addr":"172.21.15.78:6823/15826","heartbeat_front_addr":"172.21.15.78:6821/15826","state":["exists","up"]},{"osd":5,"uuid":"1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":15827},{"type":"v1","addr":"172.21.15.78:6801","nonce":15827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":15827},{"type":"v1","addr":"172.21.15.78:6803","nonce":15827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":15827},{"type":"v1","addr":"172.21.15.78:6807","nonce":15827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":15827},{"type":"v1","addr":"172.21.15.78:6805","nonce":15827}]},"public_addr":"172.21.15.78:6801/15827","cluster_addr":"172.21.15.78:6803/15827","heartbeat_back_addr":"172.21.15.78:6807/15827","heartbeat_front_addr":"172.21.15.78:6805/15827","state":["exists","up"]},{"osd":6,"uuid":"4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":15825},{"type":"v1","addr":"172.21.15.78:6809","nonce":15825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":15825},{"type":"v1","addr":"172.21.15.78:6811","nonce":15825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":15825},{"type":"v1","addr":"172.21.15.78:6815","nonce":15825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":15825},{"type":"v1","addr":"172.21.15.78:6813","nonce":15825}]},"public_addr":"172.21.15.78:6809/15825","cluster_addr":"172.21.15.78:6811/15825","heartbeat_back_addr":"172.21.15.78:6815/15825","heartbeat_front_addr":"172.21.15.78:6813/15825","state":["exists","up"]},{"osd":7,"uuid":"851aeaf3-bcdc-4ac6-b578-c42e1bf87c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":15828},{"type":"v1","addr":"172.21.15.78:6825","nonce":15828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":15828},{"type":"v1","addr":"172.21.15.78:6827","nonce":15828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":15828},{"type":"v1","addr":"172.21.15.78:6831","nonce":15828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":15828},{"type":"v1","addr":"172.21.15.78:6829","nonce":15828}]},"public_addr":"172.21.15.78:6825/15828","cluster_addr":"172.21.15.78:6827/15828","heartbeat_back_addr":"172.21.15.78:6831/15828","heartbeat_front_addr":"172.21.15.78:6829/15828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.573930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.718144+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.641838+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.551598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.374444+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.171108+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.360910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.356020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:45:02.153 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.149+0000 7f41116cb700 1 -- 172.21.15.146:0/728917366 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f40f00561e0 msgr2=0x7f40f00586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:02.153 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.149+0000 7f41116cb700 1 --2- 172.21.15.146:0/728917366 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f40f00561e0 0x7f40f00586a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f40f400bb90 tx=0x7f40f4006e20).stop 2021-01-27T09:45:02.153 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.149+0000 7f41116cb700 1 -- 172.21.15.146:0/728917366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f410c14b220 msgr2=0x7f410c14f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:02.153 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.149+0000 7f41116cb700 1 --2- 172.21.15.146:0/728917366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f410c14b220 0x7f410c14f290 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f40fc00b170 tx=0x7f40fc016000).stop 2021-01-27T09:45:02.153 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.149+0000 7f41116cb700 1 -- 172.21.15.146:0/728917366 shutdown_connections 2021-01-27T09:45:02.154 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.149+0000 7f41116cb700 1 --2- 172.21.15.146:0/728917366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f410c14b600 0x7f410c1463b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:02.154 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.149+0000 7f41116cb700 1 --2- 172.21.15.146:0/728917366 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f40f00561e0 0x7f40f00586a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:02.154 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.149+0000 7f41116cb700 1 --2- 172.21.15.146:0/728917366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f410c14b220 0x7f410c14f290 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:02.154 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.149+0000 7f41116cb700 1 --2- 172.21.15.146:0/728917366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f410c0bec50 0x7f410c1477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:02.155 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.149+0000 7f41116cb700 1 -- 172.21.15.146:0/728917366 >> 172.21.15.146:0/728917366 conn(0x7f410c069110 msgr2=0x7f410c0b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:02.155 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.149+0000 7f41116cb700 1 -- 172.21.15.146:0/728917366 shutdown_connections 2021-01-27T09:45:02.156 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.149+0000 7f41116cb700 1 -- 172.21.15.146:0/728917366 wait complete. 2021-01-27T09:45:02.182 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-27T09:44:18.497521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-27T09:44:24.550303+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-27T09:44:27.607542+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-01-27T09:44:28.331389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2021-01-27T09:44:31.378452+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-27T09:45:02.183 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-01-27T09:45:02.354 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.353+0000 7f679f1d6700 1 Processor -- start 2021-01-27T09:45:02.355 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.353+0000 7f679f1d6700 1 -- start start 2021-01-27T09:45:02.358 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.357+0000 7f679f1d6700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6798065df0 0x7f6798063020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:02.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.357+0000 7f679f1d6700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6798063920 con 0x7f67980661d0 2021-01-27T09:45:02.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.357+0000 7f679f1d6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67981521a0 con 0x7f67980b9770 2021-01-27T09:45:02.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.357+0000 7f679f1d6700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67980bfd10 con 0x7f6798065df0 2021-01-27T09:45:02.360 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.357+0000 7f679d9d3700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f67980661d0 0x7f6798155750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:34606/0 (socket says 172.21.15.146:34606) 2021-01-27T09:45:02.360 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.357+0000 7f679d9d3700 1 -- 172.21.15.146:0/687692039 learned_addr learned my addr 172.21.15.146:0/687692039 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:02.360 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.357+0000 7f679e1d4700 1 --2- 172.21.15.146:0/687692039 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6798065df0 0x7f6798063020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:02.361 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.357+0000 7f679d1d2700 1 -- 172.21.15.146:0/687692039 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301660468 0 0) 0x7f6798063920 con 0x7f67980661d0 2021-01-27T09:45:02.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.357+0000 7f679d1d2700 1 -- 172.21.15.146:0/687692039 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6780003270 con 0x7f67980661d0 2021-01-27T09:45:02.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.357+0000 7f679d1d2700 1 -- 172.21.15.146:0/687692039 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258484724 0 0) 0x7f67981521a0 con 0x7f67980b9770 2021-01-27T09:45:02.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.357+0000 7f679d1d2700 1 -- 172.21.15.146:0/687692039 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6798063920 con 0x7f67980b9770 2021-01-27T09:45:02.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.357+0000 7f679e1d4700 1 -- 172.21.15.146:0/687692039 >> v1:172.21.15.146:6789/0 conn(0x7f67980b9770 legacy=0x7f679814f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:02.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.357+0000 7f679e1d4700 1 -- 172.21.15.146:0/687692039 >> v1:172.21.15.78:6789/0 conn(0x7f67980661d0 legacy=0x7f6798155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:02.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.357+0000 7f679e1d4700 1 -- 172.21.15.146:0/687692039 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6798152440 con 0x7f6798065df0 2021-01-27T09:45:02.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.357+0000 7f679e1d4700 1 --2- 172.21.15.146:0/687692039 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6798065df0 0x7f6798063020 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f679400b9f0 tx=0x7f6794006e20).ready entity=mon.2 client_cookie=d2f5dec8cc16a9fc server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:02.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.361+0000 7f679d1d2700 1 -- 172.21.15.146:0/687692039 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67940096c0 con 0x7f6798065df0 2021-01-27T09:45:02.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.361+0000 7f679d1d2700 1 -- 172.21.15.146:0/687692039 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6794009820 con 0x7f6798065df0 2021-01-27T09:45:02.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.361+0000 7f679d1d2700 1 -- 172.21.15.146:0/687692039 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6794009ba0 con 0x7f6798065df0 2021-01-27T09:45:02.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.361+0000 7f679f1d6700 1 -- 172.21.15.146:0/687692039 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6798065df0 msgr2=0x7f6798063020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:02.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.361+0000 7f679f1d6700 1 --2- 172.21.15.146:0/687692039 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6798065df0 0x7f6798063020 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f679400b9f0 tx=0x7f6794006e20).stop 2021-01-27T09:45:02.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.361+0000 7f679f1d6700 1 -- 172.21.15.146:0/687692039 shutdown_connections 2021-01-27T09:45:02.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.361+0000 7f679f1d6700 1 --2- 172.21.15.146:0/687692039 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6798065df0 0x7f6798063020 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:02.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.361+0000 7f679f1d6700 1 -- 172.21.15.146:0/687692039 >> 172.21.15.146:0/687692039 conn(0x7f67980644f0 msgr2=0x7f6798067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:02.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.361+0000 7f679f1d6700 1 -- 172.21.15.146:0/687692039 shutdown_connections 2021-01-27T09:45:02.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.361+0000 7f679f1d6700 1 -- 172.21.15.146:0/687692039 wait complete. 2021-01-27T09:45:02.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f679f1d6700 1 Processor -- start 2021-01-27T09:45:02.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f679f1d6700 1 -- start start 2021-01-27T09:45:02.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f679f1d6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6798065df0 0x7f679814ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:02.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f679f1d6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67980661d0 0x7f6798153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:02.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f679f1d6700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67980b9770 0x7f679814fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:02.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f679f1d6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67980bbd80 con 0x7f6798065df0 2021-01-27T09:45:02.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f679f1d6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679814b8a0 con 0x7f67980661d0 2021-01-27T09:45:02.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f679f1d6700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679814bb40 con 0x7f67980b9770 2021-01-27T09:45:02.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f679e1d4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6798065df0 0x7f679814ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:02.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f679d9d3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67980661d0 0x7f6798153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:02.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f679e1d4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6798065df0 0x7f679814ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:49878/0 (socket says 172.21.15.146:49878) 2021-01-27T09:45:02.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f679e1d4700 1 -- 172.21.15.146:0/2980483574 learned_addr learned my addr 172.21.15.146:0/2980483574 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:02.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f679e9d5700 1 --2- 172.21.15.146:0/2980483574 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67980b9770 0x7f679814fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:02.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f679e1d4700 1 -- 172.21.15.146:0/2980483574 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67980b9770 msgr2=0x7f679814fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:02.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f679e1d4700 1 --2- 172.21.15.146:0/2980483574 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67980b9770 0x7f679814fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:02.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f679e1d4700 1 -- 172.21.15.146:0/2980483574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67980661d0 msgr2=0x7f6798153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:02.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f679e1d4700 1 --2- 172.21.15.146:0/2980483574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67980661d0 0x7f6798153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:02.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f679e1d4700 1 -- 172.21.15.146:0/2980483574 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679814bde0 con 0x7f6798065df0 2021-01-27T09:45:02.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f679e1d4700 1 --2- 172.21.15.146:0/2980483574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6798065df0 0x7f679814ed40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f6798064380 tx=0x7f6794016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:02.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f67867fc700 1 -- 172.21.15.146:0/2980483574 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6794011bc0 con 0x7f6798065df0 2021-01-27T09:45:02.373 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f67867fc700 1 -- 172.21.15.146:0/2980483574 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6794011d20 con 0x7f6798065df0 2021-01-27T09:45:02.373 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f679f1d6700 1 -- 172.21.15.146:0/2980483574 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f679814c080 con 0x7f6798065df0 2021-01-27T09:45:02.373 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f67867fc700 1 -- 172.21.15.146:0/2980483574 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679401d610 con 0x7f6798065df0 2021-01-27T09:45:02.373 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.365+0000 7f679f1d6700 1 -- 172.21.15.146:0/2980483574 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6798153a70 con 0x7f6798065df0 2021-01-27T09:45:02.374 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.369+0000 7f679f1d6700 1 -- 172.21.15.146:0/2980483574 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6798062a10 con 0x7f6798065df0 2021-01-27T09:45:02.375 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.369+0000 7f67867fc700 1 -- 172.21.15.146:0/2980483574 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f679400f070 con 0x7f6798065df0 2021-01-27T09:45:02.375 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.369+0000 7f67867fc700 1 --2- 172.21.15.146:0/2980483574 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6778056210 0x7f67780586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:02.375 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.369+0000 7f67867fc700 1 -- 172.21.15.146:0/2980483574 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f6794070ff0 con 0x7f6798065df0 2021-01-27T09:45:02.375 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.369+0000 7f679d9d3700 1 --2- 172.21.15.146:0/2980483574 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6778056210 0x7f67780586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:02.376 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.373+0000 7f679d9d3700 1 --2- 172.21.15.146:0/2980483574 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6778056210 0x7f67780586d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f6798151720 tx=0x7f6788009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:02.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.381+0000 7f67867fc700 1 -- 172.21.15.146:0/2980483574 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f6794046690 con 0x7f6798065df0 2021-01-27T09:45:02.526 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.525+0000 7f679f1d6700 1 -- 172.21.15.146:0/2980483574 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6798044680 con 0x7f6798065df0 2021-01-27T09:45:02.528 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.525+0000 7f67867fc700 1 -- 172.21.15.146:0/2980483574 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6794049c70 con 0x7f6798065df0 2021-01-27T09:45:02.528 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2021-01-27T09:45:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.525+0000 7f679f1d6700 1 -- 172.21.15.146:0/2980483574 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6778056210 msgr2=0x7f67780586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.525+0000 7f679f1d6700 1 --2- 172.21.15.146:0/2980483574 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6778056210 0x7f67780586d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f6798151720 tx=0x7f6788009040).stop 2021-01-27T09:45:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.525+0000 7f679f1d6700 1 -- 172.21.15.146:0/2980483574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6798065df0 msgr2=0x7f679814ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:02.531 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.525+0000 7f679f1d6700 1 --2- 172.21.15.146:0/2980483574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6798065df0 0x7f679814ed40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f6798064380 tx=0x7f6794016000).stop 2021-01-27T09:45:02.531 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.525+0000 7f679f1d6700 1 -- 172.21.15.146:0/2980483574 shutdown_connections 2021-01-27T09:45:02.531 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.525+0000 7f679f1d6700 1 --2- 172.21.15.146:0/2980483574 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67980b9770 0x7f679814fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:02.531 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.525+0000 7f679f1d6700 1 --2- 172.21.15.146:0/2980483574 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6778056210 0x7f67780586d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:02.531 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.525+0000 7f679f1d6700 1 --2- 172.21.15.146:0/2980483574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67980661d0 0x7f6798153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:02.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.525+0000 7f679f1d6700 1 --2- 172.21.15.146:0/2980483574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6798065df0 0x7f679814ed40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:02.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.525+0000 7f679f1d6700 1 -- 172.21.15.146:0/2980483574 >> 172.21.15.146:0/2980483574 conn(0x7f67980644f0 msgr2=0x7f67980bc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:02.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.529+0000 7f679f1d6700 1 -- 172.21.15.146:0/2980483574 shutdown_connections 2021-01-27T09:45:02.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.529+0000 7f679f1d6700 1 -- 172.21.15.146:0/2980483574 wait complete. 2021-01-27T09:45:02.555 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-01-27T09:45:02.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.725+0000 7f33f5481700 1 Processor -- start 2021-01-27T09:45:02.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.725+0000 7f33f5481700 1 -- start start 2021-01-27T09:45:02.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.729+0000 7f33f5481700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f33f0065df0 0x7f33f00bf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:02.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.729+0000 7f33f5481700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f33f00bfa60 0x7f33f0151d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:02.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.729+0000 7f33f5481700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f33f00661d0 0x7f33f014e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:02.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.729+0000 7f33f5481700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f00bf7a0 con 0x7f33f0065df0 2021-01-27T09:45:02.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.729+0000 7f33f5481700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f00be710 con 0x7f33f00661d0 2021-01-27T09:45:02.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.729+0000 7f33f5481700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f00be970 con 0x7f33f00bfa60 2021-01-27T09:45:02.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.729+0000 7f33effff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f33f0065df0 0x7f33f00bf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:02.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.729+0000 7f33f4c80700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f33f00661d0 0x7f33f014e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:02.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.729+0000 7f33ef7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f33f00bfa60 0x7f33f0151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:02.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.729+0000 7f33ef7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f33f00bfa60 0x7f33f0151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36500/0 (socket says 172.21.15.146:36500) 2021-01-27T09:45:02.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.729+0000 7f33ef7fe700 1 -- 172.21.15.146:0/3560869100 learned_addr learned my addr 172.21.15.146:0/3560869100 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:02.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.729+0000 7f33effff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f33f0065df0 0x7f33f00bf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:49886/0 (socket says 172.21.15.146:49886) 2021-01-27T09:45:02.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.729+0000 7f33f4c80700 1 -- 172.21.15.146:0/3560869100 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f33f00bfa60 msgr2=0x7f33f0151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:02.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.729+0000 7f33f4c80700 1 --2- 172.21.15.146:0/3560869100 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f33f00bfa60 0x7f33f0151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:02.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.729+0000 7f33f4c80700 1 -- 172.21.15.146:0/3560869100 >> v2:172.21.15.78:3300/0 conn(0x7f33f0065df0 msgr2=0x7f33f00bf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:02.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.729+0000 7f33f4c80700 1 --2- 172.21.15.146:0/3560869100 >> v2:172.21.15.78:3300/0 conn(0x7f33f0065df0 0x7f33f00bf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:02.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.729+0000 7f33f4c80700 1 -- 172.21.15.146:0/3560869100 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f00bec10 con 0x7f33f00661d0 2021-01-27T09:45:02.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.729+0000 7f33f4c80700 1 --2- 172.21.15.146:0/3560869100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33f00661d0 0x7f33f014e5b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f33f0067930 tx=0x7f33e8009220).ready entity=mon.1 client_cookie=20a811eff1c36286 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:02.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.729+0000 7f33eeffd700 1 -- 172.21.15.146:0/3560869100 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e800b9c0 con 0x7f33f00661d0 2021-01-27T09:45:02.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.729+0000 7f33eeffd700 1 -- 172.21.15.146:0/3560869100 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e800bb20 con 0x7f33f00661d0 2021-01-27T09:45:02.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.729+0000 7f33eeffd700 1 -- 172.21.15.146:0/3560869100 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e8011400 con 0x7f33f00661d0 2021-01-27T09:45:02.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.733+0000 7f33f5481700 1 -- 172.21.15.146:0/3560869100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33f00661d0 msgr2=0x7f33f014e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:02.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.733+0000 7f33f5481700 1 --2- 172.21.15.146:0/3560869100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33f00661d0 0x7f33f014e5b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f33f0067930 tx=0x7f33e8009220).stop 2021-01-27T09:45:02.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.733+0000 7f33f5481700 1 -- 172.21.15.146:0/3560869100 shutdown_connections 2021-01-27T09:45:02.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.733+0000 7f33f5481700 1 --2- 172.21.15.146:0/3560869100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33f00661d0 0x7f33f014e5b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:02.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.733+0000 7f33f5481700 1 --2- 172.21.15.146:0/3560869100 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f33f00bfa60 0x7f33f0151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:02.740 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.733+0000 7f33f5481700 1 --2- 172.21.15.146:0/3560869100 >> v2:172.21.15.78:3300/0 conn(0x7f33f0065df0 0x7f33f00bf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:02.740 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.733+0000 7f33f5481700 1 -- 172.21.15.146:0/3560869100 >> 172.21.15.146:0/3560869100 conn(0x7f33f00644f0 msgr2=0x7f33f0067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:02.740 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.733+0000 7f33f5481700 1 -- 172.21.15.146:0/3560869100 shutdown_connections 2021-01-27T09:45:02.740 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.733+0000 7f33f5481700 1 -- 172.21.15.146:0/3560869100 wait complete. 2021-01-27T09:45:02.740 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.733+0000 7f33f5481700 1 Processor -- start 2021-01-27T09:45:02.741 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.733+0000 7f33f5481700 1 -- start start 2021-01-27T09:45:02.743 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.733+0000 7f33f5481700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f33f0065df0 0x7f33f015ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:02.743 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.733+0000 7f33f5481700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33f00661d0 0x7f33f015d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:02.743 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.733+0000 7f33f5481700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33f00bfa60 0x7f33f00a2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:02.744 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.733+0000 7f33f5481700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f00a3050 con 0x7f33f00661d0 2021-01-27T09:45:02.744 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.733+0000 7f33f5481700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f00a32a0 con 0x7f33f00bfa60 2021-01-27T09:45:02.744 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.733+0000 7f33f5481700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f015c240 con 0x7f33f0065df0 2021-01-27T09:45:02.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.737+0000 7f33effff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f33f0065df0 0x7f33f015ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:02.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.737+0000 7f33ef7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33f00661d0 0x7f33f015d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:02.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.737+0000 7f33effff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f33f0065df0 0x7f33f015ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36506/0 (socket says 172.21.15.146:36506) 2021-01-27T09:45:02.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.737+0000 7f33effff700 1 -- 172.21.15.146:0/2766344313 learned_addr learned my addr 172.21.15.146:0/2766344313 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:02.746 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.737+0000 7f33f4c80700 1 --2- 172.21.15.146:0/2766344313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33f00bfa60 0x7f33f00a2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:02.746 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.737+0000 7f33ef7fe700 1 -- 172.21.15.146:0/2766344313 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f33f0065df0 msgr2=0x7f33f015ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:02.746 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.737+0000 7f33ef7fe700 1 --2- 172.21.15.146:0/2766344313 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f33f0065df0 0x7f33f015ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:02.747 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.737+0000 7f33ef7fe700 1 -- 172.21.15.146:0/2766344313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33f00bfa60 msgr2=0x7f33f00a2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:02.747 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.737+0000 7f33ef7fe700 1 --2- 172.21.15.146:0/2766344313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33f00bfa60 0x7f33f00a2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:02.747 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.737+0000 7f33ef7fe700 1 -- 172.21.15.146:0/2766344313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f015c4e0 con 0x7f33f00661d0 2021-01-27T09:45:02.747 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.737+0000 7f33effff700 1 --2- 172.21.15.146:0/2766344313 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f33f0065df0 0x7f33f015ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:45:02.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.737+0000 7f33ef7fe700 1 --2- 172.21.15.146:0/2766344313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33f00661d0 0x7f33f015d160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f33e400f830 tx=0x7f33e4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:02.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.737+0000 7f33d7fff700 1 -- 172.21.15.146:0/2766344313 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4014670 con 0x7f33f00661d0 2021-01-27T09:45:02.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.737+0000 7f33d7fff700 1 -- 172.21.15.146:0/2766344313 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e40147d0 con 0x7f33f00661d0 2021-01-27T09:45:02.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.737+0000 7f33f5481700 1 -- 172.21.15.146:0/2766344313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f015c780 con 0x7f33f00661d0 2021-01-27T09:45:02.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.737+0000 7f33d7fff700 1 -- 172.21.15.146:0/2766344313 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4014b70 con 0x7f33f00661d0 2021-01-27T09:45:02.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.737+0000 7f33f5481700 1 -- 172.21.15.146:0/2766344313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f015ccc0 con 0x7f33f00661d0 2021-01-27T09:45:02.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.737+0000 7f33f5481700 1 -- 172.21.15.146:0/2766344313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f00bedf0 con 0x7f33f00661d0 2021-01-27T09:45:02.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.741+0000 7f33d7fff700 1 -- 172.21.15.146:0/2766344313 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f33e401a020 con 0x7f33f00661d0 2021-01-27T09:45:02.750 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.741+0000 7f33d7fff700 1 --2- 172.21.15.146:0/2766344313 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f33d00561e0 0x7f33d00586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:02.750 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.741+0000 7f33d7fff700 1 -- 172.21.15.146:0/2766344313 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f33e406f8b0 con 0x7f33f00661d0 2021-01-27T09:45:02.750 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.741+0000 7f33effff700 1 --2- 172.21.15.146:0/2766344313 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f33d00561e0 0x7f33d00586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:02.751 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.741+0000 7f33effff700 1 --2- 172.21.15.146:0/2766344313 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f33d00561e0 0x7f33d00586a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f33e00113f0 tx=0x7f33e0006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:02.751 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.749+0000 7f33d7fff700 1 -- 172.21.15.146:0/2766344313 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f33e4044ed0 con 0x7f33f00661d0 2021-01-27T09:45:02.892 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.889+0000 7f33f5481700 1 -- 172.21.15.146:0/2766344313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f33f0062a10 con 0x7f33f00661d0 2021-01-27T09:45:02.893 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.889+0000 7f33d7fff700 1 -- 172.21.15.146:0/2766344313 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f33e4038020 con 0x7f33f00661d0 2021-01-27T09:45:02.894 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:45:02.897 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.893+0000 7f33f5481700 1 -- 172.21.15.146:0/2766344313 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f33d00561e0 msgr2=0x7f33d00586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:02.897 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.893+0000 7f33f5481700 1 --2- 172.21.15.146:0/2766344313 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f33d00561e0 0x7f33d00586a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f33e00113f0 tx=0x7f33e0006e20).stop 2021-01-27T09:45:02.897 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.893+0000 7f33f5481700 1 -- 172.21.15.146:0/2766344313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33f00661d0 msgr2=0x7f33f015d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:02.898 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.893+0000 7f33f5481700 1 --2- 172.21.15.146:0/2766344313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33f00661d0 0x7f33f015d160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f33e400f830 tx=0x7f33e4008040).stop 2021-01-27T09:45:02.898 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.893+0000 7f33f5481700 1 -- 172.21.15.146:0/2766344313 shutdown_connections 2021-01-27T09:45:02.898 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.893+0000 7f33f5481700 1 --2- 172.21.15.146:0/2766344313 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f33d00561e0 0x7f33d00586a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:02.899 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.893+0000 7f33f5481700 1 --2- 172.21.15.146:0/2766344313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33f00bfa60 0x7f33f00a2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:02.899 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.893+0000 7f33f5481700 1 --2- 172.21.15.146:0/2766344313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33f00661d0 0x7f33f015d160 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:02.899 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.893+0000 7f33f5481700 1 --2- 172.21.15.146:0/2766344313 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f33f0065df0 0x7f33f015ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:02.899 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.893+0000 7f33f5481700 1 -- 172.21.15.146:0/2766344313 >> 172.21.15.146:0/2766344313 conn(0x7f33f00644f0 msgr2=0x7f33f014f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:02.900 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.897+0000 7f33f5481700 1 -- 172.21.15.146:0/2766344313 shutdown_connections 2021-01-27T09:45:02.900 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:02.897+0000 7f33f5481700 1 -- 172.21.15.146:0/2766344313 wait complete. 2021-01-27T09:45:02.925 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-01-27T09:45:03.088 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.085+0000 7f77a56fd700 1 Processor -- start 2021-01-27T09:45:03.088 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.085+0000 7f77a56fd700 1 -- start start 2021-01-27T09:45:03.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.089+0000 7f77a56fd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f77a00bc000 0x7f77a00bc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:03.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.089+0000 7f77a56fd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f77a00be640 0x7f77a0060f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:03.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.089+0000 7f77a56fd700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a0065dd0 con 0x7f77a0060020 2021-01-27T09:45:03.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.089+0000 7f77a56fd700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a0066af0 con 0x7f77a00bc000 2021-01-27T09:45:03.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.089+0000 7f77a56fd700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a014f090 con 0x7f77a00be640 2021-01-27T09:45:03.093 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.089+0000 7f779ffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f77a0060020 0x7f77a014f480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:34636/0 (socket says 172.21.15.146:34636) 2021-01-27T09:45:03.093 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.089+0000 7f779e7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f77a00be640 0x7f77a0060f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:03.094 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.089+0000 7f779ffff700 1 -- 172.21.15.146:0/3082057454 learned_addr learned my addr 172.21.15.146:0/3082057454 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:03.094 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.089+0000 7f779effd700 1 --2- 172.21.15.146:0/3082057454 >> v2:172.21.15.78:3300/0 conn(0x7f77a00bc000 0x7f77a00bc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:03.094 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.089+0000 7f779effd700 1 -- 172.21.15.146:0/3082057454 >> v2:172.21.15.146:3300/0 conn(0x7f77a00be640 msgr2=0x7f77a0060f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:03.094 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.089+0000 7f779effd700 1 --2- 172.21.15.146:0/3082057454 >> v2:172.21.15.146:3300/0 conn(0x7f77a00be640 0x7f77a0060f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.095 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.089+0000 7f779effd700 1 -- 172.21.15.146:0/3082057454 >> v1:172.21.15.78:6789/0 conn(0x7f77a0060020 legacy=0x7f77a014f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:03.095 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.089+0000 7f779effd700 1 -- 172.21.15.146:0/3082057454 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a0066070 con 0x7f77a00bc000 2021-01-27T09:45:03.095 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.089+0000 7f779dffb700 1 -- 172.21.15.146:0/3082057454 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 648072799 0 0) 0x7f77a0065dd0 con 0x7f77a0060020 2021-01-27T09:45:03.097 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.093+0000 7f779effd700 1 --2- 172.21.15.146:0/3082057454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77a00bc000 0x7f77a00bc3e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f77a00bcde0 tx=0x7f7790006e20).ready entity=mon.0 client_cookie=95784fe9c5ae3c81 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:03.097 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.093+0000 7f779dffb700 1 -- 172.21.15.146:0/3082057454 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779000be80 con 0x7f77a00bc000 2021-01-27T09:45:03.097 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.093+0000 7f779dffb700 1 -- 172.21.15.146:0/3082057454 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7790009870 con 0x7f77a00bc000 2021-01-27T09:45:03.098 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.093+0000 7f779dffb700 1 -- 172.21.15.146:0/3082057454 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7790009bf0 con 0x7f77a00bc000 2021-01-27T09:45:03.098 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.093+0000 7f77a56fd700 1 -- 172.21.15.146:0/3082057454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77a00bc000 msgr2=0x7f77a00bc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:03.098 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.093+0000 7f77a56fd700 1 --2- 172.21.15.146:0/3082057454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77a00bc000 0x7f77a00bc3e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f77a00bcde0 tx=0x7f7790006e20).stop 2021-01-27T09:45:03.098 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.093+0000 7f77a56fd700 1 -- 172.21.15.146:0/3082057454 shutdown_connections 2021-01-27T09:45:03.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.093+0000 7f77a56fd700 1 --2- 172.21.15.146:0/3082057454 >> v2:172.21.15.146:3300/0 conn(0x7f77a00be640 0x7f77a0060f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.093+0000 7f77a56fd700 1 --2- 172.21.15.146:0/3082057454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77a00bc000 0x7f77a00bc3e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.093+0000 7f77a56fd700 1 -- 172.21.15.146:0/3082057454 >> 172.21.15.146:0/3082057454 conn(0x7f77a00c2810 msgr2=0x7f77a00c2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:03.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.093+0000 7f77a56fd700 1 -- 172.21.15.146:0/3082057454 shutdown_connections 2021-01-27T09:45:03.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.093+0000 7f77a56fd700 1 -- 172.21.15.146:0/3082057454 wait complete. 2021-01-27T09:45:03.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.093+0000 7f77a56fd700 1 Processor -- start 2021-01-27T09:45:03.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.097+0000 7f77a56fd700 1 -- start start 2021-01-27T09:45:03.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.097+0000 7f77a56fd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77a0060020 0x7f77a0152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:03.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.097+0000 7f77a56fd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77a00bc000 0x7f77a013b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:03.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.097+0000 7f77a56fd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77a00be640 0x7f77a013bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:03.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.097+0000 7f77a56fd700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a013c1e0 con 0x7f77a00bc000 2021-01-27T09:45:03.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.097+0000 7f77a56fd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a013b030 con 0x7f77a0060020 2021-01-27T09:45:03.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.097+0000 7f77a56fd700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a00b8d70 con 0x7f77a00be640 2021-01-27T09:45:03.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.097+0000 7f779effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77a0060020 0x7f77a0152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:03.104 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.097+0000 7f779effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77a0060020 0x7f77a0152ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47032/0 (socket says 172.21.15.146:47032) 2021-01-27T09:45:03.104 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.097+0000 7f779effd700 1 -- 172.21.15.146:0/995549035 learned_addr learned my addr 172.21.15.146:0/995549035 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:03.104 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.097+0000 7f779e7fc700 1 --2- 172.21.15.146:0/995549035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77a00bc000 0x7f77a013b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:03.104 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.097+0000 7f779ffff700 1 --2- 172.21.15.146:0/995549035 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77a00be640 0x7f77a013bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:03.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.097+0000 7f779effd700 1 -- 172.21.15.146:0/995549035 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77a00be640 msgr2=0x7f77a013bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:03.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.097+0000 7f779effd700 1 --2- 172.21.15.146:0/995549035 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77a00be640 0x7f77a013bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.106 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.097+0000 7f779effd700 1 -- 172.21.15.146:0/995549035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77a00bc000 msgr2=0x7f77a013b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:03.106 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.097+0000 7f779effd700 1 --2- 172.21.15.146:0/995549035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77a00bc000 0x7f77a013b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.106 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.097+0000 7f779effd700 1 -- 172.21.15.146:0/995549035 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a00b9010 con 0x7f77a0060020 2021-01-27T09:45:03.107 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.097+0000 7f779effd700 1 --2- 172.21.15.146:0/995549035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77a0060020 0x7f77a0152ad0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f77a0065270 tx=0x7f7790016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:03.107 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.097+0000 7f7786ffd700 1 -- 172.21.15.146:0/995549035 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7790011b40 con 0x7f77a0060020 2021-01-27T09:45:03.107 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.097+0000 7f7786ffd700 1 -- 172.21.15.146:0/995549035 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7790011ca0 con 0x7f77a0060020 2021-01-27T09:45:03.107 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.097+0000 7f77a56fd700 1 -- 172.21.15.146:0/995549035 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a00b92b0 con 0x7f77a0060020 2021-01-27T09:45:03.107 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.097+0000 7f7786ffd700 1 -- 172.21.15.146:0/995549035 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779001d640 con 0x7f77a0060020 2021-01-27T09:45:03.108 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.097+0000 7f77a56fd700 1 -- 172.21.15.146:0/995549035 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a00b9650 con 0x7f77a0060020 2021-01-27T09:45:03.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.101+0000 7f77a56fd700 1 -- 172.21.15.146:0/995549035 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a0044ee0 con 0x7f77a0060020 2021-01-27T09:45:03.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.101+0000 7f7786ffd700 1 -- 172.21.15.146:0/995549035 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f7790024030 con 0x7f77a0060020 2021-01-27T09:45:03.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.101+0000 7f7786ffd700 1 --2- 172.21.15.146:0/995549035 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f77800561e0 0x7f77800586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:03.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.101+0000 7f7786ffd700 1 -- 172.21.15.146:0/995549035 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f7790070620 con 0x7f77a0060020 2021-01-27T09:45:03.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.101+0000 7f779e7fc700 1 --2- 172.21.15.146:0/995549035 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f77800561e0 0x7f77800586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:03.110 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.105+0000 7f779e7fc700 1 --2- 172.21.15.146:0/995549035 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f77800561e0 0x7f77800586a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f77a00bea40 tx=0x7f7794006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:03.110 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.105+0000 7f7786ffd700 1 -- 172.21.15.146:0/995549035 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f7790045c70 con 0x7f77a0060020 2021-01-27T09:45:03.250 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.249+0000 7f77a56fd700 1 -- 172.21.15.146:0/995549035 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f77a00008d0 con 0x7f77a0060020 2021-01-27T09:45:03.251 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.249+0000 7f7786ffd700 1 -- 172.21.15.146:0/995549035 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7790022020 con 0x7f77a0060020 2021-01-27T09:45:03.252 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:45:03.253 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.249+0000 7f77a56fd700 1 -- 172.21.15.146:0/995549035 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f77800561e0 msgr2=0x7f77800586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:03.253 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.249+0000 7f77a56fd700 1 --2- 172.21.15.146:0/995549035 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f77800561e0 0x7f77800586a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f77a00bea40 tx=0x7f7794006e20).stop 2021-01-27T09:45:03.254 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.249+0000 7f77a56fd700 1 -- 172.21.15.146:0/995549035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77a0060020 msgr2=0x7f77a0152ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:03.254 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.249+0000 7f77a56fd700 1 --2- 172.21.15.146:0/995549035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77a0060020 0x7f77a0152ad0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f77a0065270 tx=0x7f7790016000).stop 2021-01-27T09:45:03.255 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.249+0000 7f77a56fd700 1 -- 172.21.15.146:0/995549035 shutdown_connections 2021-01-27T09:45:03.255 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.249+0000 7f77a56fd700 1 --2- 172.21.15.146:0/995549035 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77a00be640 0x7f77a013bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.255 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.249+0000 7f77a56fd700 1 --2- 172.21.15.146:0/995549035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77a00bc000 0x7f77a013b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.255 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.249+0000 7f77a56fd700 1 --2- 172.21.15.146:0/995549035 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f77800561e0 0x7f77800586a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.256 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.249+0000 7f77a56fd700 1 --2- 172.21.15.146:0/995549035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77a0060020 0x7f77a0152ad0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.256 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.249+0000 7f77a56fd700 1 -- 172.21.15.146:0/995549035 >> 172.21.15.146:0/995549035 conn(0x7f77a00c2810 msgr2=0x7f77a0060a20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:03.256 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.253+0000 7f77a56fd700 1 -- 172.21.15.146:0/995549035 shutdown_connections 2021-01-27T09:45:03.256 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.253+0000 7f77a56fd700 1 -- 172.21.15.146:0/995549035 wait complete. 2021-01-27T09:45:03.281 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-01-27T09:45:03.453 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.449+0000 7fc30f2b0700 1 Processor -- start 2021-01-27T09:45:03.454 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.449+0000 7fc30f2b0700 1 -- start start 2021-01-27T09:45:03.456 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.453+0000 7fc30f2b0700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3080bcb30 0x7fc3080bd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:03.456 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.453+0000 7fc30f2b0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc3080bcf10 0x7fc30814efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:03.456 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.453+0000 7fc30f2b0700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc308155510 con 0x7fc308062f30 2021-01-27T09:45:03.457 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.453+0000 7fc30f2b0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc308067a90 con 0x7fc3080bcf10 2021-01-27T09:45:03.457 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.453+0000 7fc30f2b0700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3080ba460 con 0x7fc3080bcb30 2021-01-27T09:45:03.458 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.453+0000 7fc30e2ae700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3080bcb30 0x7fc3080bd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:03.458 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.453+0000 7fc30e2ae700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3080bcb30 0x7fc3080bd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36526/0 (socket says 172.21.15.146:36526) 2021-01-27T09:45:03.458 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.453+0000 7fc30e2ae700 1 -- 172.21.15.146:0/839401590 learned_addr learned my addr 172.21.15.146:0/839401590 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:03.459 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.453+0000 7fc30eaaf700 1 --1- 172.21.15.146:0/839401590 >> v1:172.21.15.78:6789/0 conn(0x7fc308062f30 0x7fc308152090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:34650/0 (socket says 172.21.15.146:34650) 2021-01-27T09:45:03.459 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.453+0000 7fc30daad700 1 --2- 172.21.15.146:0/839401590 >> v2:172.21.15.146:3300/0 conn(0x7fc3080bcf10 0x7fc30814efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:03.462 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.453+0000 7fc30e2ae700 1 -- 172.21.15.146:0/839401590 >> v2:172.21.15.146:3300/0 conn(0x7fc3080bcf10 msgr2=0x7fc30814efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:03.462 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.453+0000 7fc30e2ae700 1 --2- 172.21.15.146:0/839401590 >> v2:172.21.15.146:3300/0 conn(0x7fc3080bcf10 0x7fc30814efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.462 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.453+0000 7fc30e2ae700 1 -- 172.21.15.146:0/839401590 >> v1:172.21.15.78:6789/0 conn(0x7fc308062f30 legacy=0x7fc308152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:03.463 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.453+0000 7fc30e2ae700 1 -- 172.21.15.146:0/839401590 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc308155770 con 0x7fc3080bcb30 2021-01-27T09:45:03.463 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.453+0000 7fc30e2ae700 1 --2- 172.21.15.146:0/839401590 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3080bcb30 0x7fc3080bd5c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fc304009d90 tx=0x7fc3040092d0).ready entity=mon.2 client_cookie=6f9b77e8514e5d6f server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:03.464 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.453+0000 7fc30d2ac700 1 -- 172.21.15.146:0/839401590 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30400bb90 con 0x7fc3080bcb30 2021-01-27T09:45:03.464 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.453+0000 7fc30d2ac700 1 -- 172.21.15.146:0/839401590 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30400bcf0 con 0x7fc3080bcb30 2021-01-27T09:45:03.464 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.453+0000 7fc30d2ac700 1 -- 172.21.15.146:0/839401590 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc304011610 con 0x7fc3080bcb30 2021-01-27T09:45:03.465 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.457+0000 7fc30f2b0700 1 -- 172.21.15.146:0/839401590 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3080bcb30 msgr2=0x7fc3080bd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:03.465 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.457+0000 7fc30f2b0700 1 --2- 172.21.15.146:0/839401590 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3080bcb30 0x7fc3080bd5c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fc304009d90 tx=0x7fc3040092d0).stop 2021-01-27T09:45:03.466 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.457+0000 7fc30f2b0700 1 -- 172.21.15.146:0/839401590 shutdown_connections 2021-01-27T09:45:03.467 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.457+0000 7fc30f2b0700 1 --2- 172.21.15.146:0/839401590 >> v2:172.21.15.146:3300/0 conn(0x7fc3080bcf10 0x7fc30814efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.467 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.457+0000 7fc30f2b0700 1 --2- 172.21.15.146:0/839401590 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3080bcb30 0x7fc3080bd5c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.468 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.457+0000 7fc30f2b0700 1 -- 172.21.15.146:0/839401590 >> 172.21.15.146:0/839401590 conn(0x7fc308069ba0 msgr2=0x7fc308062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:03.469 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.457+0000 7fc30f2b0700 1 -- 172.21.15.146:0/839401590 shutdown_connections 2021-01-27T09:45:03.469 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.457+0000 7fc30f2b0700 1 -- 172.21.15.146:0/839401590 wait complete. 2021-01-27T09:45:03.475 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.461+0000 7fc30f2b0700 1 Processor -- start 2021-01-27T09:45:03.475 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.461+0000 7fc30f2b0700 1 -- start start 2021-01-27T09:45:03.476 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.461+0000 7fc30f2b0700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc308062f30 0x7fc3080b1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:03.476 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.461+0000 7fc30f2b0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3080bcb30 0x7fc308162930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:03.476 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.461+0000 7fc30f2b0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3080bcf10 0x7fc308161eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:03.477 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.461+0000 7fc30f2b0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3080b1310 con 0x7fc3080bcf10 2021-01-27T09:45:03.477 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.461+0000 7fc30f2b0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3081623a0 con 0x7fc3080bcb30 2021-01-27T09:45:03.478 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.461+0000 7fc30f2b0700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3080b92d0 con 0x7fc308062f30 2021-01-27T09:45:03.478 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.465+0000 7fc30daad700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3080bcb30 0x7fc308162930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:03.478 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.465+0000 7fc30e2ae700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc308062f30 0x7fc3080b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:03.479 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.465+0000 7fc30eaaf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3080bcf10 0x7fc308161eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:03.479 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.465+0000 7fc30daad700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3080bcb30 0x7fc308162930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47046/0 (socket says 172.21.15.146:47046) 2021-01-27T09:45:03.480 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.465+0000 7fc30daad700 1 -- 172.21.15.146:0/1556798964 learned_addr learned my addr 172.21.15.146:0/1556798964 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:03.480 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.465+0000 7fc30e2ae700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc308062f30 0x7fc3080b1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36534/0 (socket says 172.21.15.146:36534) 2021-01-27T09:45:03.480 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.465+0000 7fc30e2ae700 1 -- 172.21.15.146:0/1556798964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3080bcb30 msgr2=0x7fc308162930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:03.481 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.465+0000 7fc30e2ae700 1 --2- 172.21.15.146:0/1556798964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3080bcb30 0x7fc308162930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.481 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.465+0000 7fc30e2ae700 1 -- 172.21.15.146:0/1556798964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3080bcf10 msgr2=0x7fc308161eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:03.482 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.465+0000 7fc30e2ae700 1 --2- 172.21.15.146:0/1556798964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3080bcf10 0x7fc308161eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.483 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.465+0000 7fc30e2ae700 1 -- 172.21.15.146:0/1556798964 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3080b9570 con 0x7fc308062f30 2021-01-27T09:45:03.483 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.465+0000 7fc30daad700 1 --2- 172.21.15.146:0/1556798964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3080bcb30 0x7fc308162930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:45:03.483 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.465+0000 7fc30eaaf700 1 --2- 172.21.15.146:0/1556798964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3080bcf10 0x7fc308161eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:45:03.484 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.465+0000 7fc30e2ae700 1 --2- 172.21.15.146:0/1556798964 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc308062f30 0x7fc3080b1740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc3080c00b0 tx=0x7fc304017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:03.484 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.465+0000 7fc2f67fc700 1 -- 172.21.15.146:0/1556798964 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30400bee0 con 0x7fc308062f30 2021-01-27T09:45:03.485 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.465+0000 7fc2f67fc700 1 -- 172.21.15.146:0/1556798964 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30401b620 con 0x7fc308062f30 2021-01-27T09:45:03.485 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.465+0000 7fc2f67fc700 1 -- 172.21.15.146:0/1556798964 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30401b9a0 con 0x7fc308062f30 2021-01-27T09:45:03.485 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.465+0000 7fc30f2b0700 1 -- 172.21.15.146:0/1556798964 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3080b9810 con 0x7fc308062f30 2021-01-27T09:45:03.486 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.465+0000 7fc30f2b0700 1 -- 172.21.15.146:0/1556798964 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc30814d450 con 0x7fc308062f30 2021-01-27T09:45:03.486 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.469+0000 7fc30f2b0700 1 -- 172.21.15.146:0/1556798964 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc308044680 con 0x7fc308062f30 2021-01-27T09:45:03.486 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.469+0000 7fc2f67fc700 1 -- 172.21.15.146:0/1556798964 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fc30400f070 con 0x7fc308062f30 2021-01-27T09:45:03.487 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.469+0000 7fc2f67fc700 1 --2- 172.21.15.146:0/1556798964 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc2e80561b0 0x7fc2e8058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:03.487 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.469+0000 7fc2f67fc700 1 -- 172.21.15.146:0/1556798964 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fc304071320 con 0x7fc308062f30 2021-01-27T09:45:03.488 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.469+0000 7fc30daad700 1 --2- 172.21.15.146:0/1556798964 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc2e80561b0 0x7fc2e8058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:03.488 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.473+0000 7fc30daad700 1 --2- 172.21.15.146:0/1556798964 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc2e80561b0 0x7fc2e8058670 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fc3080bebe0 tx=0x7fc2f8008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:03.489 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.477+0000 7fc2f67fc700 1 -- 172.21.15.146:0/1556798964 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fc304046940 con 0x7fc308062f30 2021-01-27T09:45:03.628 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.625+0000 7fc30f2b0700 1 -- 172.21.15.146:0/1556798964 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc3080b9cb0 con 0x7fc308062f30 2021-01-27T09:45:03.629 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.625+0000 7fc2f67fc700 1 -- 172.21.15.146:0/1556798964 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc304024360 con 0x7fc308062f30 2021-01-27T09:45:03.630 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:45:03.633 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.629+0000 7fc30f2b0700 1 -- 172.21.15.146:0/1556798964 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc2e80561b0 msgr2=0x7fc2e8058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:03.633 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.629+0000 7fc30f2b0700 1 --2- 172.21.15.146:0/1556798964 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc2e80561b0 0x7fc2e8058670 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fc3080bebe0 tx=0x7fc2f8008040).stop 2021-01-27T09:45:03.634 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.629+0000 7fc30f2b0700 1 -- 172.21.15.146:0/1556798964 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc308062f30 msgr2=0x7fc3080b1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:03.634 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.629+0000 7fc30f2b0700 1 --2- 172.21.15.146:0/1556798964 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc308062f30 0x7fc3080b1740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc3080c00b0 tx=0x7fc304017000).stop 2021-01-27T09:45:03.635 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.629+0000 7fc30f2b0700 1 -- 172.21.15.146:0/1556798964 shutdown_connections 2021-01-27T09:45:03.635 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.629+0000 7fc30f2b0700 1 --2- 172.21.15.146:0/1556798964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3080bcf10 0x7fc308161eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.635 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.629+0000 7fc30f2b0700 1 --2- 172.21.15.146:0/1556798964 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc2e80561b0 0x7fc2e8058670 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.635 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.629+0000 7fc30f2b0700 1 --2- 172.21.15.146:0/1556798964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3080bcb30 0x7fc308162930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.636 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.629+0000 7fc30f2b0700 1 --2- 172.21.15.146:0/1556798964 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc308062f30 0x7fc3080b1740 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.636 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.629+0000 7fc30f2b0700 1 -- 172.21.15.146:0/1556798964 >> 172.21.15.146:0/1556798964 conn(0x7fc308069ba0 msgr2=0x7fc30814efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:03.636 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.633+0000 7fc30f2b0700 1 -- 172.21.15.146:0/1556798964 shutdown_connections 2021-01-27T09:45:03.636 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.633+0000 7fc30f2b0700 1 -- 172.21.15.146:0/1556798964 wait complete. 2021-01-27T09:45:03.661 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2021-01-27T09:45:03.831 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.829+0000 7f0dee18e700 1 Processor -- start 2021-01-27T09:45:03.832 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.829+0000 7f0dee18e700 1 -- start start 2021-01-27T09:45:03.835 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0dee18e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0de80b9910 0x7f0de80bb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:03.836 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0dee18e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0de80b9cf0 0x7f0de814bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:03.836 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0dee18e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de814f180 con 0x7f0de80bf2b0 2021-01-27T09:45:03.837 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0dee18e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de814f3b0 con 0x7f0de80b9910 2021-01-27T09:45:03.837 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0dee18e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de814f650 con 0x7f0de80b9cf0 2021-01-27T09:45:03.843 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0ded18c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0de80b9910 0x7f0de80bb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:03.844 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0ded98d700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0de80bf2b0 0x7f0de8145930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:34664/0 (socket says 172.21.15.146:34664) 2021-01-27T09:45:03.844 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0ded98d700 1 -- 172.21.15.146:0/405057292 learned_addr learned my addr 172.21.15.146:0/405057292 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:03.844 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0dec98b700 1 --2- 172.21.15.146:0/405057292 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0de80b9cf0 0x7f0de814bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:03.845 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0dd7fff700 1 -- 172.21.15.146:0/405057292 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254326856 0 0) 0x7f0de814f180 con 0x7f0de80bf2b0 2021-01-27T09:45:03.845 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0dd7fff700 1 -- 172.21.15.146:0/405057292 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dd0003270 con 0x7f0de80bf2b0 2021-01-27T09:45:03.846 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0dd7fff700 1 -- 172.21.15.146:0/405057292 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1088311929 0 0) 0x7f0dd0003270 con 0x7f0de80bf2b0 2021-01-27T09:45:03.846 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0dd7fff700 1 -- 172.21.15.146:0/405057292 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0de80b9cf0 msgr2=0x7f0de814bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:03.846 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0dd7fff700 1 --2- 172.21.15.146:0/405057292 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0de80b9cf0 0x7f0de814bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.847 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0dd7fff700 1 -- 172.21.15.146:0/405057292 >> v2:172.21.15.146:3300/0 conn(0x7f0de80b9910 msgr2=0x7f0de80bb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:03.847 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0dd7fff700 1 --2- 172.21.15.146:0/405057292 >> v2:172.21.15.146:3300/0 conn(0x7f0de80b9910 0x7f0de80bb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.848 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0dd7fff700 1 -- 172.21.15.146:0/405057292 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de814f8f0 con 0x7f0de80bf2b0 2021-01-27T09:45:03.848 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0dd7fff700 1 -- 172.21.15.146:0/405057292 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3890990827 0 0) 0x7f0de00018a0 con 0x7f0de80bf2b0 2021-01-27T09:45:03.848 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0dd7fff700 1 -- 172.21.15.146:0/405057292 >> v1:172.21.15.78:6789/0 conn(0x7f0de80bf2b0 legacy=0x7f0de8145930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:03.849 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0dd7fff700 1 --2- 172.21.15.146:0/405057292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd00037e0 0x7f0dd0003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:03.849 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0dd7fff700 1 --2- 172.21.15.146:0/405057292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dd0004510 0x7f0dd0004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:03.850 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0dd7fff700 1 --2- 172.21.15.146:0/405057292 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0de80b9cf0 0x7f0dd0004e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:03.850 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0dd7fff700 1 -- 172.21.15.146:0/405057292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de814f3b0 con 0x7f0dd00037e0 2021-01-27T09:45:03.850 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0dd7fff700 1 -- 172.21.15.146:0/405057292 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de814f650 con 0x7f0dd0004510 2021-01-27T09:45:03.851 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0dd7fff700 1 -- 172.21.15.146:0/405057292 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd0005370 con 0x7f0de80b9cf0 2021-01-27T09:45:03.851 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.833+0000 7f0ded18c700 1 --2- 172.21.15.146:0/405057292 >> v2:172.21.15.146:3300/0 conn(0x7f0de80b9910 0x7f0de80bb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:45:03.852 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.837+0000 7f0ded98d700 1 --2- 172.21.15.146:0/405057292 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0de80b9cf0 0x7f0dd0004e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:03.852 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.837+0000 7f0dec98b700 1 --2- 172.21.15.146:0/405057292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dd0004510 0x7f0dd0004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:03.853 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.837+0000 7f0ded18c700 1 --2- 172.21.15.146:0/405057292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd00037e0 0x7f0dd0003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:03.853 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.837+0000 7f0ded98d700 1 -- 172.21.15.146:0/405057292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dd0004510 msgr2=0x7f0dd0004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:03.854 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.837+0000 7f0ded98d700 1 --2- 172.21.15.146:0/405057292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dd0004510 0x7f0dd0004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.854 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.837+0000 7f0ded98d700 1 -- 172.21.15.146:0/405057292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd00037e0 msgr2=0x7f0dd0003c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:03.855 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.837+0000 7f0ded98d700 1 --2- 172.21.15.146:0/405057292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd00037e0 0x7f0dd0003c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.855 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.837+0000 7f0ded98d700 1 -- 172.21.15.146:0/405057292 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd0003270 con 0x7f0de80b9cf0 2021-01-27T09:45:03.855 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.837+0000 7f0ded18c700 1 --2- 172.21.15.146:0/405057292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd00037e0 0x7f0dd0003c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:45:03.856 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.837+0000 7f0ded98d700 1 --2- 172.21.15.146:0/405057292 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0de80b9cf0 0x7f0dd0004e80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f0de000c840 tx=0x7f0de80bbe30).ready entity=mon.2 client_cookie=1c2a696858335040 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:03.856 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.837+0000 7f0dd7fff700 1 -- 172.21.15.146:0/405057292 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de0005bb0 con 0x7f0de80b9cf0 2021-01-27T09:45:03.857 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.837+0000 7f0dd7fff700 1 -- 172.21.15.146:0/405057292 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de0005d10 con 0x7f0de80b9cf0 2021-01-27T09:45:03.857 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.837+0000 7f0dd7fff700 1 -- 172.21.15.146:0/405057292 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de0007320 con 0x7f0de80b9cf0 2021-01-27T09:45:03.857 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.837+0000 7f0dee18e700 1 -- 172.21.15.146:0/405057292 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0de80b9cf0 msgr2=0x7f0dd0004e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:03.858 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.837+0000 7f0dee18e700 1 --2- 172.21.15.146:0/405057292 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0de80b9cf0 0x7f0dd0004e80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f0de000c840 tx=0x7f0de80bbe30).stop 2021-01-27T09:45:03.858 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.837+0000 7f0ded98d700 1 -- 172.21.15.146:0/405057292 reap_dead start 2021-01-27T09:45:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.837+0000 7f0dee18e700 1 -- 172.21.15.146:0/405057292 shutdown_connections 2021-01-27T09:45:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.837+0000 7f0dee18e700 1 -- 172.21.15.146:0/405057292 >> 172.21.15.146:0/405057292 conn(0x7f0de80644f0 msgr2=0x7f0de8067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.837+0000 7f0dee18e700 1 -- 172.21.15.146:0/405057292 shutdown_connections 2021-01-27T09:45:03.860 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.841+0000 7f0dee18e700 1 -- 172.21.15.146:0/405057292 wait complete. 2021-01-27T09:45:03.866 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.841+0000 7f0dee18e700 1 Processor -- start 2021-01-27T09:45:03.867 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.841+0000 7f0dee18e700 1 -- start start 2021-01-27T09:45:03.867 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.841+0000 7f0dee18e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0de80b9cf0 0x7f0de8067260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:03.867 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.845+0000 7f0dee18e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0de80be0f0 0x7f0de8066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:03.868 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.845+0000 7f0dee18e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0de80be550 0x7f0de8066680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:03.868 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.845+0000 7f0dee18e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de813e720 con 0x7f0de80be0f0 2021-01-27T09:45:03.869 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.845+0000 7f0dee18e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de8066b70 con 0x7f0de80b9cf0 2021-01-27T09:45:03.869 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.845+0000 7f0dee18e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de8067e10 con 0x7f0de80be550 2021-01-27T09:45:03.870 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.845+0000 7f0ded18c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0de80b9cf0 0x7f0de8067260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:03.871 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.845+0000 7f0ded18c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0de80b9cf0 0x7f0de8067260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47066/0 (socket says 172.21.15.146:47066) 2021-01-27T09:45:03.871 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.845+0000 7f0ded18c700 1 -- 172.21.15.146:0/3927016928 learned_addr learned my addr 172.21.15.146:0/3927016928 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:03.871 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.845+0000 7f0ded98d700 1 --2- 172.21.15.146:0/3927016928 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0de80be550 0x7f0de8066680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:03.871 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.845+0000 7f0dec98b700 1 --2- 172.21.15.146:0/3927016928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0de80be0f0 0x7f0de8066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:03.872 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.845+0000 7f0ded18c700 1 -- 172.21.15.146:0/3927016928 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0de80be550 msgr2=0x7f0de8066680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:03.872 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.845+0000 7f0ded18c700 1 --2- 172.21.15.146:0/3927016928 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0de80be550 0x7f0de8066680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.872 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.845+0000 7f0ded18c700 1 -- 172.21.15.146:0/3927016928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0de80be0f0 msgr2=0x7f0de8066190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:03.872 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.845+0000 7f0ded18c700 1 --2- 172.21.15.146:0/3927016928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0de80be0f0 0x7f0de8066190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:03.873 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.845+0000 7f0ded18c700 1 -- 172.21.15.146:0/3927016928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de80680b0 con 0x7f0de80b9cf0 2021-01-27T09:45:03.873 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.845+0000 7f0ded18c700 1 --2- 172.21.15.146:0/3927016928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0de80b9cf0 0x7f0de8067260 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f0de4006df0 tx=0x7f0de4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:03.873 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.845+0000 7f0dd57fa700 1 -- 172.21.15.146:0/3927016928 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de4013610 con 0x7f0de80b9cf0 2021-01-27T09:45:03.873 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.845+0000 7f0dd57fa700 1 -- 172.21.15.146:0/3927016928 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de4013770 con 0x7f0de80b9cf0 2021-01-27T09:45:03.873 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.845+0000 7f0dd57fa700 1 -- 172.21.15.146:0/3927016928 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de4013af0 con 0x7f0de80b9cf0 2021-01-27T09:45:03.874 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.845+0000 7f0dee18e700 1 -- 172.21.15.146:0/3927016928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de8140c20 con 0x7f0de80b9cf0 2021-01-27T09:45:03.874 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.845+0000 7f0dee18e700 1 -- 172.21.15.146:0/3927016928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de8141160 con 0x7f0de80b9cf0 2021-01-27T09:45:03.874 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.849+0000 7f0dee18e700 1 -- 172.21.15.146:0/3927016928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de8062a10 con 0x7f0de80b9cf0 2021-01-27T09:45:03.874 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.849+0000 7f0dd57fa700 1 -- 172.21.15.146:0/3927016928 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f0de4023070 con 0x7f0de80b9cf0 2021-01-27T09:45:03.874 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.849+0000 7f0dd57fa700 1 --2- 172.21.15.146:0/3927016928 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0dc80561e0 0x7f0dc80586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:03.875 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.849+0000 7f0dd57fa700 1 -- 172.21.15.146:0/3927016928 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f0de406f780 con 0x7f0de80b9cf0 2021-01-27T09:45:03.875 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.849+0000 7f0dec98b700 1 --2- 172.21.15.146:0/3927016928 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0dc80561e0 0x7f0dc80586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:03.875 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.849+0000 7f0dec98b700 1 --2- 172.21.15.146:0/3927016928 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0dc80561e0 0x7f0dc80586a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f0dd8006ac0 tx=0x7f0dd8006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:03.875 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:03.853+0000 7f0dd57fa700 1 -- 172.21.15.146:0/3927016928 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f0de4044e30 con 0x7f0de80b9cf0 2021-01-27T09:45:04.002 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.001+0000 7f0dee18e700 1 -- 172.21.15.146:0/3927016928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0de8149620 con 0x7f0de80b9cf0 2021-01-27T09:45:04.003 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.001+0000 7f0dd57fa700 1 -- 172.21.15.146:0/3927016928 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+10 (secure 0 0 0) 0x7f0de4017070 con 0x7f0de80b9cf0 2021-01-27T09:45:04.004 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:45:04.005 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.001+0000 7f0dee18e700 1 -- 172.21.15.146:0/3927016928 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0dc80561e0 msgr2=0x7f0dc80586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:04.005 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.001+0000 7f0dee18e700 1 --2- 172.21.15.146:0/3927016928 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0dc80561e0 0x7f0dc80586a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f0dd8006ac0 tx=0x7f0dd8006e20).stop 2021-01-27T09:45:04.006 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.001+0000 7f0dee18e700 1 -- 172.21.15.146:0/3927016928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0de80b9cf0 msgr2=0x7f0de8067260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:04.006 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.001+0000 7f0dee18e700 1 --2- 172.21.15.146:0/3927016928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0de80b9cf0 0x7f0de8067260 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f0de4006df0 tx=0x7f0de4008040).stop 2021-01-27T09:45:04.007 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.005+0000 7f0dee18e700 1 -- 172.21.15.146:0/3927016928 shutdown_connections 2021-01-27T09:45:04.007 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.005+0000 7f0dee18e700 1 --2- 172.21.15.146:0/3927016928 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0de80be550 0x7f0de8066680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:04.007 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.005+0000 7f0dee18e700 1 --2- 172.21.15.146:0/3927016928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0de80be0f0 0x7f0de8066190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:04.007 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.005+0000 7f0dee18e700 1 --2- 172.21.15.146:0/3927016928 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0dc80561e0 0x7f0dc80586a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:04.007 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.005+0000 7f0dee18e700 1 --2- 172.21.15.146:0/3927016928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0de80b9cf0 0x7f0de8067260 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:04.008 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.005+0000 7f0dee18e700 1 -- 172.21.15.146:0/3927016928 >> 172.21.15.146:0/3927016928 conn(0x7f0de80644f0 msgr2=0x7f0de814bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:04.008 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.005+0000 7f0dee18e700 1 -- 172.21.15.146:0/3927016928 shutdown_connections 2021-01-27T09:45:04.008 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.005+0000 7f0dee18e700 1 -- 172.21.15.146:0/3927016928 wait complete. 2021-01-27T09:45:04.033 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:45:04.203 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.201+0000 7fd2216e2700 1 Processor -- start 2021-01-27T09:45:04.203 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.201+0000 7fd2216e2700 1 -- start start 2021-01-27T09:45:04.205 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.201+0000 7fd2216e2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd21c061430 0x7fd21c062c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:04.205 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.201+0000 7fd2216e2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd21c061810 0x7fd21c151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:04.205 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.201+0000 7fd2216e2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21c0b14a0 con 0x7fd21c14e990 2021-01-27T09:45:04.205 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.201+0000 7fd2216e2700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd21c063110 con 0x7fd21c061430 2021-01-27T09:45:04.206 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.201+0000 7fd2216e2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c1521a0 con 0x7fd21c061810 2021-01-27T09:45:04.207 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.201+0000 7fd213fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd21c061810 0x7fd21c151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:04.207 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.201+0000 7fd213fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd21c061810 0x7fd21c151cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36560/0 (socket says 172.21.15.146:36560) 2021-01-27T09:45:04.208 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.201+0000 7fd213fff700 1 -- 172.21.15.146:0/1304080732 learned_addr learned my addr 172.21.15.146:0/1304080732 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:04.208 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.205+0000 7fd21affd700 1 --2- 172.21.15.146:0/1304080732 >> v2:172.21.15.78:3300/0 conn(0x7fd21c061430 0x7fd21c062c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:04.208 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.205+0000 7fd213fff700 1 -- 172.21.15.146:0/1304080732 >> v2:172.21.15.78:3300/0 conn(0x7fd21c061430 msgr2=0x7fd21c062c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:04.208 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.205+0000 7fd213fff700 1 --2- 172.21.15.146:0/1304080732 >> v2:172.21.15.78:3300/0 conn(0x7fd21c061430 0x7fd21c062c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:04.209 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.205+0000 7fd213fff700 1 -- 172.21.15.146:0/1304080732 >> v1:172.21.15.146:6789/0 conn(0x7fd21c14e990 legacy=0x7fd21c147750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:04.209 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.205+0000 7fd213fff700 1 -- 172.21.15.146:0/1304080732 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c0b1740 con 0x7fd21c061810 2021-01-27T09:45:04.209 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.205+0000 7fd213fff700 1 --2- 172.21.15.146:0/1304080732 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd21c061810 0x7fd21c151cb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fd20400ba20 tx=0x7fd204006ee0).ready entity=mon.2 client_cookie=3107dc7132144141 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:04.210 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.205+0000 7fd21a7fc700 1 -- 172.21.15.146:0/1304080732 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd204009840 con 0x7fd21c061810 2021-01-27T09:45:04.210 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.205+0000 7fd21a7fc700 1 -- 172.21.15.146:0/1304080732 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2040099a0 con 0x7fd21c061810 2021-01-27T09:45:04.211 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.205+0000 7fd21a7fc700 1 -- 172.21.15.146:0/1304080732 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd204009d20 con 0x7fd21c061810 2021-01-27T09:45:04.211 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.205+0000 7fd2216e2700 1 -- 172.21.15.146:0/1304080732 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd21c061810 msgr2=0x7fd21c151cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:04.211 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.205+0000 7fd2216e2700 1 --2- 172.21.15.146:0/1304080732 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd21c061810 0x7fd21c151cb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fd20400ba20 tx=0x7fd204006ee0).stop 2021-01-27T09:45:04.211 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.205+0000 7fd2216e2700 1 -- 172.21.15.146:0/1304080732 shutdown_connections 2021-01-27T09:45:04.212 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.205+0000 7fd2216e2700 1 --2- 172.21.15.146:0/1304080732 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd21c061810 0x7fd21c151cb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:04.212 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.205+0000 7fd2216e2700 1 --2- 172.21.15.146:0/1304080732 >> v2:172.21.15.78:3300/0 conn(0x7fd21c061430 0x7fd21c062c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:04.212 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.205+0000 7fd2216e2700 1 -- 172.21.15.146:0/1304080732 >> 172.21.15.146:0/1304080732 conn(0x7fd21c062810 msgr2=0x7fd21c067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:04.212 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.205+0000 7fd2216e2700 1 -- 172.21.15.146:0/1304080732 shutdown_connections 2021-01-27T09:45:04.212 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.205+0000 7fd2216e2700 1 -- 172.21.15.146:0/1304080732 wait complete. 2021-01-27T09:45:04.214 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.209+0000 7fd2216e2700 1 Processor -- start 2021-01-27T09:45:04.216 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.209+0000 7fd2216e2700 1 -- start start 2021-01-27T09:45:04.216 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.209+0000 7fd2216e2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd21c061430 0x7fd21c147b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:04.216 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.209+0000 7fd2216e2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd21c061810 0x7fd21c1515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:04.216 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.209+0000 7fd2216e2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd21c14e990 0x7fd21c160710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:04.216 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.209+0000 7fd2216e2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c15d0f0 con 0x7fd21c061810 2021-01-27T09:45:04.217 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.209+0000 7fd2216e2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c0bc110 con 0x7fd21c061430 2021-01-27T09:45:04.217 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.209+0000 7fd2216e2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c15d2e0 con 0x7fd21c14e990 2021-01-27T09:45:04.217 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.213+0000 7fd21affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd21c061430 0x7fd21c147b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:04.217 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.213+0000 7fd21affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd21c061430 0x7fd21c147b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47080/0 (socket says 172.21.15.146:47080) 2021-01-27T09:45:04.218 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.213+0000 7fd21affd700 1 -- 172.21.15.146:0/247264621 learned_addr learned my addr 172.21.15.146:0/247264621 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:04.218 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.213+0000 7fd213fff700 1 --2- 172.21.15.146:0/247264621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd21c061810 0x7fd21c1515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:04.218 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.213+0000 7fd21bfff700 1 --2- 172.21.15.146:0/247264621 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd21c14e990 0x7fd21c160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:04.220 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.213+0000 7fd21affd700 1 -- 172.21.15.146:0/247264621 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd21c14e990 msgr2=0x7fd21c160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:04.220 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.213+0000 7fd21affd700 1 --2- 172.21.15.146:0/247264621 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd21c14e990 0x7fd21c160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:04.220 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.213+0000 7fd21affd700 1 -- 172.21.15.146:0/247264621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd21c061810 msgr2=0x7fd21c1515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:04.220 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.213+0000 7fd21affd700 1 --2- 172.21.15.146:0/247264621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd21c061810 0x7fd21c1515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:04.220 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.213+0000 7fd21affd700 1 -- 172.21.15.146:0/247264621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c15d580 con 0x7fd21c061430 2021-01-27T09:45:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.213+0000 7fd21affd700 1 --2- 172.21.15.146:0/247264621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd21c061430 0x7fd21c147b60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fd20c00ebd0 tx=0x7fd20c006e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.213+0000 7fd212ffd700 1 -- 172.21.15.146:0/247264621 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c00c850 con 0x7fd21c061430 2021-01-27T09:45:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.213+0000 7fd212ffd700 1 -- 172.21.15.146:0/247264621 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c00c9b0 con 0x7fd21c061430 2021-01-27T09:45:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.213+0000 7fd2216e2700 1 -- 172.21.15.146:0/247264621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21c15d820 con 0x7fd21c061430 2021-01-27T09:45:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.213+0000 7fd212ffd700 1 -- 172.21.15.146:0/247264621 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c00cd30 con 0x7fd21c061430 2021-01-27T09:45:04.222 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.213+0000 7fd2216e2700 1 -- 172.21.15.146:0/247264621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21c15dd60 con 0x7fd21c061430 2021-01-27T09:45:04.222 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.213+0000 7fd2216e2700 1 -- 172.21.15.146:0/247264621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd21c1480b0 con 0x7fd21c061430 2021-01-27T09:45:04.222 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.217+0000 7fd212ffd700 1 -- 172.21.15.146:0/247264621 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fd20c012600 con 0x7fd21c061430 2021-01-27T09:45:04.222 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.217+0000 7fd212ffd700 1 --2- 172.21.15.146:0/247264621 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd2000561e0 0x7fd2000586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:04.222 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.217+0000 7fd212ffd700 1 -- 172.21.15.146:0/247264621 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fd20c06f7c0 con 0x7fd21c061430 2021-01-27T09:45:04.223 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.217+0000 7fd213fff700 1 --2- 172.21.15.146:0/247264621 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd2000561e0 0x7fd2000586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:04.223 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.217+0000 7fd213fff700 1 --2- 172.21.15.146:0/247264621 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd2000561e0 0x7fd2000586a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fd20400b1d0 tx=0x7fd204016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:04.226 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.225+0000 7fd212ffd700 1 -- 172.21.15.146:0/247264621 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fd20c044e10 con 0x7fd21c061430 2021-01-27T09:45:04.402 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.401+0000 7fd2216e2700 1 -- 172.21.15.146:0/247264621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd21c05c790 con 0x7fd21c061430 2021-01-27T09:45:04.403 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.401+0000 7fd212ffd700 1 -- 172.21.15.146:0/247264621 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3574 (secure 0 0 0) 0x7fd20c048430 con 0x7fd21c061430 2021-01-27T09:45:04.404 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:45:04.404 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:44:52.595879+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6837/745099427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":745099427},{"type":"v1","addr":"172.21.15.146:6837","nonce":745099427}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:45:04.406 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.401+0000 7fd2216e2700 1 -- 172.21.15.146:0/247264621 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd2000561e0 msgr2=0x7fd2000586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:04.406 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.401+0000 7fd2216e2700 1 --2- 172.21.15.146:0/247264621 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd2000561e0 0x7fd2000586a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fd20400b1d0 tx=0x7fd204016000).stop 2021-01-27T09:45:04.406 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.401+0000 7fd2216e2700 1 -- 172.21.15.146:0/247264621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd21c061430 msgr2=0x7fd21c147b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:04.407 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.401+0000 7fd2216e2700 1 --2- 172.21.15.146:0/247264621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd21c061430 0x7fd21c147b60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fd20c00ebd0 tx=0x7fd20c006e20).stop 2021-01-27T09:45:04.407 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.405+0000 7fd2216e2700 1 -- 172.21.15.146:0/247264621 shutdown_connections 2021-01-27T09:45:04.407 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.405+0000 7fd2216e2700 1 --2- 172.21.15.146:0/247264621 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd21c14e990 0x7fd21c160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:04.408 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.405+0000 7fd2216e2700 1 --2- 172.21.15.146:0/247264621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd21c061810 0x7fd21c1515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:04.408 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.405+0000 7fd2216e2700 1 --2- 172.21.15.146:0/247264621 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd2000561e0 0x7fd2000586a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:04.408 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.405+0000 7fd2216e2700 1 --2- 172.21.15.146:0/247264621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd21c061430 0x7fd21c147b60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:04.408 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.405+0000 7fd2216e2700 1 -- 172.21.15.146:0/247264621 >> 172.21.15.146:0/247264621 conn(0x7fd21c062810 msgr2=0x7fd21c146910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:04.409 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.405+0000 7fd2216e2700 1 -- 172.21.15.146:0/247264621 shutdown_connections 2021-01-27T09:45:04.409 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:04.405+0000 7fd2216e2700 1 -- 172.21.15.146:0/247264621 wait complete. 2021-01-27T09:45:04.409 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 13 2021-01-27T09:45:05.038 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-27T09:44:29.315988+0000', 'modified': '2021-01-27T09:44:52.595879+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4275, 'mds_1': 4287, 'mds_2': 4241}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4241': {'gid': 4241, 'name': 'e', 'rank': 2, 'incarnation': 12, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.146:6837/745099427', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6836', 'nonce': 745099427}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 745099427}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}, 'gid_4275': {'gid': 4275, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.78:6837/1117292103', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 1117292103}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 1117292103}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}, 'gid_4287': {'gid': 4287, 'name': 'c', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.146:6834/2738812606', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 2738812606}, {'type': 'v1', 'addr': '172.21.15.146:6834', 'nonce': 2738812606}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-27T09:45:05.038 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2021-01-27T09:45:05.039 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.e.asok --format=json status 2021-01-27T09:45:05.227 INFO:teuthology.orchestra.run.smithi146.stdout:{"cluster_fsid":"968a1bec-aac5-444e-b70f-7770587be945","whoami":2,"id":4241,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":13.615413679,"mdsmap_epoch":13,"osdmap_epoch":26,"osdmap_epoch_barrier":26,"uptime":39.323157041999998} 2021-01-27T09:45:05.228 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "968a1bec-aac5-444e-b70f-7770587be945", "fs_name": "cephfs", "id": 4241, "mdsmap_epoch": 13, "osdmap_epoch": 26, "osdmap_epoch_barrier": 26, "rank_uptime": 13.615413679, "state": "up:active", "uptime": 39.323157042, "want_state": "up:active", "whoami": 2 } 2021-01-27T09:45:05.228 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-01-27T09:45:05.346 INFO:teuthology.orchestra.run.smithi078.stdout:{"cluster_fsid":"968a1bec-aac5-444e-b70f-7770587be945","whoami":0,"id":4275,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":36.017230128000001,"mdsmap_epoch":13,"osdmap_epoch":26,"osdmap_epoch_barrier":26,"uptime":39.476839968999997} 2021-01-27T09:45:05.346 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "968a1bec-aac5-444e-b70f-7770587be945", "fs_name": "cephfs", "id": 4275, "mdsmap_epoch": 13, "osdmap_epoch": 26, "osdmap_epoch_barrier": 26, "rank_uptime": 36.017230128, "state": "up:active", "uptime": 39.476839969, "want_state": "up:active", "whoami": 0 } 2021-01-27T09:45:05.347 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-01-27T09:45:05.528 INFO:teuthology.orchestra.run.smithi146.stdout:{"cluster_fsid":"968a1bec-aac5-444e-b70f-7770587be945","whoami":1,"id":4287,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":14.926027532999999,"mdsmap_epoch":13,"osdmap_epoch":26,"osdmap_epoch_barrier":26,"uptime":39.629160679999998} 2021-01-27T09:45:05.529 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "968a1bec-aac5-444e-b70f-7770587be945", "fs_name": "cephfs", "id": 4287, "mdsmap_epoch": 13, "osdmap_epoch": 26, "osdmap_epoch_barrier": 26, "rank_uptime": 14.926027533, "state": "up:active", "uptime": 39.62916068, "want_state": "up:active", "whoami": 1 } 2021-01-27T09:45:05.529 INFO:teuthology.run_tasks:Running task kclient... 2021-01-27T09:45:05.544 INFO:tasks.kclient:Mounting kernel clients... 2021-01-27T09:45:05.544 INFO:tasks.kclient:config is {'client.0': {}} 2021-01-27T09:45:05.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:45:05.545 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2021-01-27T09:45:05.564 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2021-01-27T09:45:05.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:45:05.565 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2021-01-27T09:45:05.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:45:05.600 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2021-01-27T09:45:05.916 INFO:tasks.kclient:client.0 config is {} 2021-01-27T09:45:05.916 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2021-01-27T09:45:05.916 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2021-01-27T09:45:05.917 INFO:tasks.cephfs.mount:self.client.name = client.0 2021-01-27T09:45:05.917 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2021-01-27T09:45:05.917 INFO:tasks.cephfs.mount:self.cephfs_name = None 2021-01-27T09:45:05.918 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2021-01-27T09:45:05.918 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2021-01-27T09:45:05.918 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2021-01-27T09:45:05.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:45:05.919 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2021-01-27T09:45:05.938 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2021-01-27T09:45:05.938 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2021-01-27T09:45:05.938 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2021-01-27T09:45:05.938 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2021-01-27T09:45:05.939 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2021-01-27T09:45:05.939 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2021-01-27T09:45:05.939 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2021-01-27T09:45:05.939 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2021-01-27T09:45:05.940 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2021-01-27T09:45:05.940 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2021-01-27T09:45:05.940 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2021-01-27T09:45:05.940 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2021-01-27T09:45:05.940 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2021-01-27T09:45:05.941 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2021-01-27T09:45:05.941 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2021-01-27T09:45:05.941 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2021-01-27T09:45:05.941 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2021-01-27T09:45:05.942 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42762sec preferred_lft 42762sec 2021-01-27T09:45:05.942 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2021-01-27T09:45:05.942 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2021-01-27T09:45:05.942 INFO:teuthology.orchestra.run.smithi146.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2021-01-27T09:45:05.943 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 02:42:d4:7b:a0:1b brd ff:ff:ff:ff:ff:ff 2021-01-27T09:45:05.943 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2021-01-27T09:45:05.943 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2021-01-27T09:45:05.944 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2021-01-27T09:45:05.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:45:05.945 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec sudo bash -c ' 2021-01-27T09:45:05.945 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2021-01-27T09:45:05.945 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add name ceph-brx type bridge 2021-01-27T09:45:05.946 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr flush dev ceph-brx 2021-01-27T09:45:05.946 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set ceph-brx up 2021-01-27T09:45:05.946 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2021-01-27T09:45:05.947 DEBUG:teuthology.orchestra.run.smithi146:> ') 2021-01-27T09:45:06.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:45:06.119 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2021-01-27T09:45:06.151 INFO:teuthology.orchestra.run.smithi146.stdout:1 2021-01-27T09:45:06.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:45:06.156 DEBUG:teuthology.orchestra.run.smithi146:> route 2021-01-27T09:45:06.172 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2021-01-27T09:45:06.172 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2021-01-27T09:45:06.173 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2021-01-27T09:45:06.173 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2021-01-27T09:45:06.173 INFO:teuthology.orchestra.run.smithi146.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2021-01-27T09:45:06.173 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2021-01-27T09:45:06.174 INFO:teuthology.orchestra.run.smithi146.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2021-01-27T09:45:06.174 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2021-01-27T09:45:06.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:45:06.175 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec sudo bash -c ' 2021-01-27T09:45:06.176 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2021-01-27T09:45:06.176 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2021-01-27T09:45:06.176 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2021-01-27T09:45:06.177 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2021-01-27T09:45:06.177 DEBUG:teuthology.orchestra.run.smithi146:> ') 2021-01-27T09:45:06.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:45:06.387 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2021-01-27T09:45:06.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:45:06.405 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list-id 2021-01-27T09:45:06.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:45:06.422 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec sudo bash -c ' 2021-01-27T09:45:06.422 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2021-01-27T09:45:06.423 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2021-01-27T09:45:06.423 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2021-01-27T09:45:06.424 DEBUG:teuthology.orchestra.run.smithi146:> ') 2021-01-27T09:45:06.521 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2021-01-27T09:45:06.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:45:06.522 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec sudo bash -c ' 2021-01-27T09:45:06.523 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2021-01-27T09:45:06.523 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2021-01-27T09:45:06.523 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2021-01-27T09:45:06.524 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2021-01-27T09:45:06.524 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2021-01-27T09:45:06.524 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2021-01-27T09:45:06.525 DEBUG:teuthology.orchestra.run.smithi146:> ') 2021-01-27T09:45:06.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:45:06.702 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec sudo bash -c ' 2021-01-27T09:45:06.702 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2021-01-27T09:45:06.702 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2021-01-27T09:45:06.703 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set dev brx.0 master ceph-brx 2021-01-27T09:45:06.703 DEBUG:teuthology.orchestra.run.smithi146:> ') 2021-01-27T09:45:06.795 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-01-27T09:45:06.958 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.957+0000 7f4fc28de700 1 Processor -- start 2021-01-27T09:45:09.703 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.957+0000 7f4fc28de700 1 -- start start 2021-01-27T09:45:09.711 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:45:09.711 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.957+0000 7f4fc28de700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4fbc0be7f0 0x7f4fbc0bcf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:09.712 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.957+0000 7f4fc28de700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4fbc0b9e70 0x7f4fbc0bd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:09.712 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.957+0000 7f4fc28de700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fbc0698b0 con 0x7f4fbc0b9a90 2021-01-27T09:45:09.712 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.957+0000 7f4fc28de700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fbc14bc80 con 0x7f4fbc0be7f0 2021-01-27T09:45:09.712 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.957+0000 7f4fc28de700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fbc14be70 con 0x7f4fbc0b9e70 2021-01-27T09:45:09.712 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.957+0000 7f4fc0e7b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4fbc0b9e70 0x7f4fbc0bd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.957+0000 7f4fbb7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4fbc0be7f0 0x7f4fbc0bcf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.957+0000 7f4fc0e7b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4fbc0b9e70 0x7f4fbc0bd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47090/0 (socket says 172.21.15.146:47090) 2021-01-27T09:45:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.957+0000 7f4fc0e7b700 1 -- 172.21.15.146:0/3351078457 learned_addr learned my addr 172.21.15.146:0/3351078457 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.957+0000 7f4fbbfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4fbc0b9a90 0x7f4fbc0be0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46660/0 (socket says 172.21.15.146:46660) 2021-01-27T09:45:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.961+0000 7f4fbb7fe700 1 -- 172.21.15.146:0/3351078457 >> v2:172.21.15.146:3300/0 conn(0x7f4fbc0b9e70 msgr2=0x7f4fbc0bd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.961+0000 7f4fbb7fe700 1 --2- 172.21.15.146:0/3351078457 >> v2:172.21.15.146:3300/0 conn(0x7f4fbc0b9e70 0x7f4fbc0bd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.961+0000 7f4fbb7fe700 1 -- 172.21.15.146:0/3351078457 >> v1:172.21.15.146:6789/0 conn(0x7f4fbc0b9a90 legacy=0x7f4fbc0be0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.961+0000 7f4fbb7fe700 1 -- 172.21.15.146:0/3351078457 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc14c110 con 0x7f4fbc0be7f0 2021-01-27T09:45:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.961+0000 7f4fc0e7b700 1 --2- 172.21.15.146:0/3351078457 >> v2:172.21.15.146:3300/0 conn(0x7f4fbc0b9e70 0x7f4fbc0bd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:45:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.961+0000 7f4fbb7fe700 1 --2- 172.21.15.146:0/3351078457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fbc0be7f0 0x7f4fbc0bcf70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f4fbc0bccd0 tx=0x7f4fb0006e20).ready entity=mon.0 client_cookie=7defe854ab3e70ff server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.961+0000 7f4fbaffd700 1 -- 172.21.15.146:0/3351078457 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb000be80 con 0x7f4fbc0be7f0 2021-01-27T09:45:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.961+0000 7f4fbaffd700 1 -- 172.21.15.146:0/3351078457 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb0009870 con 0x7f4fbc0be7f0 2021-01-27T09:45:09.716 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.961+0000 7f4fbaffd700 1 -- 172.21.15.146:0/3351078457 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0009bf0 con 0x7f4fbc0be7f0 2021-01-27T09:45:09.716 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.961+0000 7f4fc28de700 1 -- 172.21.15.146:0/3351078457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fbc0be7f0 msgr2=0x7f4fbc0bcf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:09.716 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.961+0000 7f4fc28de700 1 --2- 172.21.15.146:0/3351078457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fbc0be7f0 0x7f4fbc0bcf70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f4fbc0bccd0 tx=0x7f4fb0006e20).stop 2021-01-27T09:45:09.716 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.961+0000 7f4fc28de700 1 -- 172.21.15.146:0/3351078457 shutdown_connections 2021-01-27T09:45:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.961+0000 7f4fc28de700 1 --2- 172.21.15.146:0/3351078457 >> v2:172.21.15.146:3300/0 conn(0x7f4fbc0b9e70 0x7f4fbc0bd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.961+0000 7f4fc28de700 1 --2- 172.21.15.146:0/3351078457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fbc0be7f0 0x7f4fbc0bcf70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.961+0000 7f4fc28de700 1 -- 172.21.15.146:0/3351078457 >> 172.21.15.146:0/3351078457 conn(0x7f4fbc069110 msgr2=0x7f4fbc067e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.961+0000 7f4fc28de700 1 -- 172.21.15.146:0/3351078457 shutdown_connections 2021-01-27T09:45:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.961+0000 7f4fc28de700 1 -- 172.21.15.146:0/3351078457 wait complete. 2021-01-27T09:45:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.961+0000 7f4fc28de700 1 Processor -- start 2021-01-27T09:45:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.965+0000 7f4fc28de700 1 -- start start 2021-01-27T09:45:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.965+0000 7f4fc28de700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fbc0b9a90 0x7f4fbc14e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:09.719 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.965+0000 7f4fc28de700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fbc0b9e70 0x7f4fbc15dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:09.719 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.965+0000 7f4fc28de700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4fbc0be7f0 0x7f4fbc066140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:09.719 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.965+0000 7f4fc28de700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc15e250 con 0x7f4fbc0b9e70 2021-01-27T09:45:09.719 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.965+0000 7f4fc28de700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc1474f0 con 0x7f4fbc0b9a90 2021-01-27T09:45:09.720 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.965+0000 7f4fc28de700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc14e0d0 con 0x7f4fbc0be7f0 2021-01-27T09:45:09.720 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.965+0000 7f4fbbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fbc0b9a90 0x7f4fbc14e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:09.720 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.965+0000 7f4fbbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fbc0b9a90 0x7f4fbc14e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47094/0 (socket says 172.21.15.146:47094) 2021-01-27T09:45:09.720 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.965+0000 7f4fbbfff700 1 -- 172.21.15.146:0/1912680493 learned_addr learned my addr 172.21.15.146:0/1912680493 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:09.721 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.965+0000 7f4fbb7fe700 1 --2- 172.21.15.146:0/1912680493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fbc0b9e70 0x7f4fbc15dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:09.721 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.965+0000 7f4fc0e7b700 1 --2- 172.21.15.146:0/1912680493 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4fbc0be7f0 0x7f4fbc066140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:09.721 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.965+0000 7f4fbbfff700 1 -- 172.21.15.146:0/1912680493 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4fbc0be7f0 msgr2=0x7f4fbc066140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:09.721 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.965+0000 7f4fbbfff700 1 --2- 172.21.15.146:0/1912680493 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4fbc0be7f0 0x7f4fbc066140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:09.722 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.965+0000 7f4fbbfff700 1 -- 172.21.15.146:0/1912680493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fbc0b9e70 msgr2=0x7f4fbc15dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:09.722 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.965+0000 7f4fbbfff700 1 --2- 172.21.15.146:0/1912680493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fbc0b9e70 0x7f4fbc15dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:09.722 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.965+0000 7f4fbbfff700 1 -- 172.21.15.146:0/1912680493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc147720 con 0x7f4fbc0b9a90 2021-01-27T09:45:09.722 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.965+0000 7f4fbbfff700 1 --2- 172.21.15.146:0/1912680493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fbc0b9a90 0x7f4fbc14e750 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f4fac00c740 tx=0x7f4fac007c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.965+0000 7f4fa3fff700 1 -- 172.21.15.146:0/1912680493 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac0072e0 con 0x7f4fbc0b9a90 2021-01-27T09:45:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.965+0000 7f4fa3fff700 1 -- 172.21.15.146:0/1912680493 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fac007440 con 0x7f4fbc0b9a90 2021-01-27T09:45:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.965+0000 7f4fc28de700 1 -- 172.21.15.146:0/1912680493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fbc1479c0 con 0x7f4fbc0b9a90 2021-01-27T09:45:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.965+0000 7f4fa3fff700 1 -- 172.21.15.146:0/1912680493 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac005770 con 0x7f4fbc0b9a90 2021-01-27T09:45:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.965+0000 7f4fc28de700 1 -- 172.21.15.146:0/1912680493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fbc0bb9b0 con 0x7f4fbc0b9a90 2021-01-27T09:45:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.969+0000 7f4fc28de700 1 -- 172.21.15.146:0/1912680493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fbc044ee0 con 0x7f4fbc0b9a90 2021-01-27T09:45:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.969+0000 7f4fa3fff700 1 -- 172.21.15.146:0/1912680493 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f4fac01a060 con 0x7f4fbc0b9a90 2021-01-27T09:45:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.969+0000 7f4fa3fff700 1 --2- 172.21.15.146:0/1912680493 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4f9c056210 0x7f4f9c0586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.969+0000 7f4fa3fff700 1 -- 172.21.15.146:0/1912680493 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f4fac06ede0 con 0x7f4fbc0b9a90 2021-01-27T09:45:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.969+0000 7f4fbb7fe700 1 --2- 172.21.15.146:0/1912680493 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4f9c056210 0x7f4f9c0586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.973+0000 7f4fbb7fe700 1 --2- 172.21.15.146:0/1912680493 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4f9c056210 0x7f4f9c0586d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f4fbc0bec00 tx=0x7f4fb0016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:06.977+0000 7f4fa3fff700 1 -- 172.21.15.146:0/1912680493 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f4fac044380 con 0x7f4fbc0b9a90 2021-01-27T09:45:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:07.117+0000 7f4fc28de700 1 -- 172.21.15.146:0/1912680493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fbc063c20 con 0x7f4fbc0b9a90 2021-01-27T09:45:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:07.121+0000 7f4fa3fff700 1 -- 172.21.15.146:0/1912680493 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18638 (secure 0 0 0) 0x7f4fac018030 con 0x7f4fbc0b9a90 2021-01-27T09:45:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:07.121+0000 7f4fc28de700 1 -- 172.21.15.146:0/1912680493 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4f9c056210 msgr2=0x7f4f9c0586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:07.121+0000 7f4fc28de700 1 --2- 172.21.15.146:0/1912680493 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4f9c056210 0x7f4f9c0586d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f4fbc0bec00 tx=0x7f4fb0016000).stop 2021-01-27T09:45:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:07.121+0000 7f4fc28de700 1 -- 172.21.15.146:0/1912680493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fbc0b9a90 msgr2=0x7f4fbc14e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:09.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:07.121+0000 7f4fc28de700 1 --2- 172.21.15.146:0/1912680493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fbc0b9a90 0x7f4fbc14e750 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f4fac00c740 tx=0x7f4fac007c70).stop 2021-01-27T09:45:09.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:07.121+0000 7f4fc28de700 1 -- 172.21.15.146:0/1912680493 shutdown_connections 2021-01-27T09:45:09.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:07.121+0000 7f4fc28de700 1 --2- 172.21.15.146:0/1912680493 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4fbc0be7f0 0x7f4fbc066140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:09.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:07.121+0000 7f4fc28de700 1 --2- 172.21.15.146:0/1912680493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fbc0b9e70 0x7f4fbc15dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:09.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:07.121+0000 7f4fc28de700 1 --2- 172.21.15.146:0/1912680493 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4f9c056210 0x7f4f9c0586d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:09.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:07.121+0000 7f4fc28de700 1 --2- 172.21.15.146:0/1912680493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fbc0b9a90 0x7f4fbc14e750 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:09.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:07.121+0000 7f4fc28de700 1 -- 172.21.15.146:0/1912680493 >> 172.21.15.146:0/1912680493 conn(0x7f4fbc069110 msgr2=0x7f4fbc064570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:09.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:07.121+0000 7f4fc28de700 1 -- 172.21.15.146:0/1912680493 shutdown_connections 2021-01-27T09:45:09.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:07.121+0000 7f4fc28de700 1 -- 172.21.15.146:0/1912680493 wait complete. 2021-01-27T09:45:09.729 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:45:09.729 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":26,"fsid":"968a1bec-aac5-444e-b70f-7770587be945","created":"2021-01-27T09:44:13.797940+0000","modified":"2021-01-27T09:44:33.763400+0000","last_up_change":"2021-01-27T09:44:23.479967+0000","last_in_change":"2021-01-27T09:44:23.479967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T09:44:18.497521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-27T09:44:24.550303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-27T09:44:27.607542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-27T09:44:28.331389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-01-27T09:44:31.378452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25441909-a40b-4d82-828d-326685513ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":14470},{"type":"v1","addr":"172.21.15.146:6801","nonce":14470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":14470},{"type":"v1","addr":"172.21.15.146:6803","nonce":14470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":14470},{"type":"v1","addr":"172.21.15.146:6810","nonce":14470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":14470},{"type":"v1","addr":"172.21.15.146:6807","nonce":14470}]},"public_addr":"172.21.15.146:6801/14470","cluster_addr":"172.21.15.146:6803/14470","heartbeat_back_addr":"172.21.15.146:6810/14470","heartbeat_front_addr":"172.21.15.146:6807/14470","state":["exists","up"]},{"osd":1,"uuid":"825bbc51-2ffe-4612-a300-00960e48be02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":14472},{"type":"v1","addr":"172.21.15.146:6817","nonce":14472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":14472},{"type":"v1","addr":"172.21.15.146:6819","nonce":14472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":14472},{"type":"v1","addr":"172.21.15.146:6827","nonce":14472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":14472},{"type":"v1","addr":"172.21.15.146:6823","nonce":14472}]},"public_addr":"172.21.15.146:6817/14472","cluster_addr":"172.21.15.146:6819/14472","heartbeat_back_addr":"172.21.15.146:6827/14472","heartbeat_front_addr":"172.21.15.146:6823/14472","state":["exists","up"]},{"osd":2,"uuid":"e568b97a-8e71-4ab9-bd64-056892110b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":14474},{"type":"v1","addr":"172.21.15.146:6822","nonce":14474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":14474},{"type":"v1","addr":"172.21.15.146:6826","nonce":14474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":14474},{"type":"v1","addr":"172.21.15.146:6831","nonce":14474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":14474},{"type":"v1","addr":"172.21.15.146:6829","nonce":14474}]},"public_addr":"172.21.15.146:6822/14474","cluster_addr":"172.21.15.146:6826/14474","heartbeat_back_addr":"172.21.15.146:6831/14474","heartbeat_front_addr":"172.21.15.146:6829/14474","state":["exists","up"]},{"osd":3,"uuid":"f5d50f63-f74a-4aea-a62d-51c38db4d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":14471},{"type":"v1","addr":"172.21.15.146:6806","nonce":14471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":14471},{"type":"v1","addr":"172.21.15.146:6811","nonce":14471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":14471},{"type":"v1","addr":"172.21.15.146:6815","nonce":14471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":14471},{"type":"v1","addr":"172.21.15.146:6813","nonce":14471}]},"public_addr":"172.21.15.146:6806/14471","cluster_addr":"172.21.15.146:6811/14471","heartbeat_back_addr":"172.21.15.146:6815/14471","heartbeat_front_addr":"172.21.15.146:6813/14471","state":["exists","up"]},{"osd":4,"uuid":"782458d7-6f52-48f4-9466-67b61ef27016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":15826},{"type":"v1","addr":"172.21.15.78:6817","nonce":15826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":15826},{"type":"v1","addr":"172.21.15.78:6819","nonce":15826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":15826},{"type":"v1","addr":"172.21.15.78:6823","nonce":15826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":15826},{"type":"v1","addr":"172.21.15.78:6821","nonce":15826}]},"public_addr":"172.21.15.78:6817/15826","cluster_addr":"172.21.15.78:6819/15826","heartbeat_back_addr":"172.21.15.78:6823/15826","heartbeat_front_addr":"172.21.15.78:6821/15826","state":["exists","up"]},{"osd":5,"uuid":"1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":15827},{"type":"v1","addr":"172.21.15.78:6801","nonce":15827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":15827},{"type":"v1","addr":"172.21.15.78:6803","nonce":15827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":15827},{"type":"v1","addr":"172.21.15.78:6807","nonce":15827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":15827},{"type":"v1","addr":"172.21.15.78:6805","nonce":15827}]},"public_addr":"172.21.15.78:6801/15827","cluster_addr":"172.21.15.78:6803/15827","heartbeat_back_addr":"172.21.15.78:6807/15827","heartbeat_front_addr":"172.21.15.78:6805/15827","state":["exists","up"]},{"osd":6,"uuid":"4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":15825},{"type":"v1","addr":"172.21.15.78:6809","nonce":15825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":15825},{"type":"v1","addr":"172.21.15.78:6811","nonce":15825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":15825},{"type":"v1","addr":"172.21.15.78:6815","nonce":15825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":15825},{"type":"v1","addr":"172.21.15.78:6813","nonce":15825}]},"public_addr":"172.21.15.78:6809/15825","cluster_addr":"172.21.15.78:6811/15825","heartbeat_back_addr":"172.21.15.78:6815/15825","heartbeat_front_addr":"172.21.15.78:6813/15825","state":["exists","up"]},{"osd":7,"uuid":"851aeaf3-bcdc-4ac6-b578-c42e1bf87c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":15828},{"type":"v1","addr":"172.21.15.78:6825","nonce":15828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":15828},{"type":"v1","addr":"172.21.15.78:6827","nonce":15828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":15828},{"type":"v1","addr":"172.21.15.78:6831","nonce":15828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":15828},{"type":"v1","addr":"172.21.15.78:6829","nonce":15828}]},"public_addr":"172.21.15.78:6825/15828","cluster_addr":"172.21.15.78:6827/15828","heartbeat_back_addr":"172.21.15.78:6831/15828","heartbeat_front_addr":"172.21.15.78:6829/15828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.573930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.718144+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.641838+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.551598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.374444+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.171108+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.360910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.356020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:45:09.730 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-27T09:44:18.497521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-27T09:44:24.550303+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-27T09:44:27.607542+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-01-27T09:44:28.331389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2021-01-27T09:44:31.378452+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-27T09:45:09.731 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-01-27T09:45:09.733 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:45:09.903 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.901+0000 7f1950f82700 1 Processor -- start 2021-01-27T09:45:09.903 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.901+0000 7f1950f82700 1 -- start start 2021-01-27T09:45:09.905 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.901+0000 7f1950f82700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f194c067ab0 0x7f194c14f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.901+0000 7f1950f82700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f194c066f60 con 0x7f194c0629b0 2021-01-27T09:45:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.901+0000 7f1950f82700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f194c155980 con 0x7f194c062d90 2021-01-27T09:45:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.901+0000 7f1950f82700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194c0bd4c0 con 0x7f194c067ab0 2021-01-27T09:45:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.901+0000 7f194b7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f194c0629b0 0x7f194c064360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:34708/0 (socket says 172.21.15.146:34708) 2021-01-27T09:45:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.901+0000 7f194b7fe700 1 -- 172.21.15.146:0/1575897180 learned_addr learned my addr 172.21.15.146:0/1575897180 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:09.907 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.901+0000 7f194bfff700 1 --2- 172.21.15.146:0/1575897180 >> v2:172.21.15.146:3300/0 conn(0x7f194c067ab0 0x7f194c14f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:09.908 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.905+0000 7f194a7fc700 1 -- 172.21.15.146:0/1575897180 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154389000 0 0) 0x7f194c066f60 con 0x7f194c0629b0 2021-01-27T09:45:09.908 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.905+0000 7f194a7fc700 1 -- 172.21.15.146:0/1575897180 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f192c003270 con 0x7f194c0629b0 2021-01-27T09:45:09.908 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.905+0000 7f194bfff700 1 -- 172.21.15.146:0/1575897180 >> v1:172.21.15.146:6789/0 conn(0x7f194c062d90 legacy=0x7f194c067390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:09.908 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.905+0000 7f194a7fc700 1 -- 172.21.15.146:0/1575897180 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2711709195 0 0) 0x7f194c155980 con 0x7f194c062d90 2021-01-27T09:45:09.909 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.905+0000 7f194bfff700 1 -- 172.21.15.146:0/1575897180 >> v1:172.21.15.78:6789/0 conn(0x7f194c0629b0 legacy=0x7f194c064360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:09.909 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.905+0000 7f194bfff700 1 -- 172.21.15.146:0/1575897180 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c155c20 con 0x7f194c067ab0 2021-01-27T09:45:09.909 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.905+0000 7f194bfff700 1 --2- 172.21.15.146:0/1575897180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f194c067ab0 0x7f194c14f090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f194400b9c0 tx=0x7f1944006e20).ready entity=mon.1 client_cookie=80165533741008ab server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:09.909 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.905+0000 7f194a7fc700 1 -- 172.21.15.146:0/1575897180 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194400beb0 con 0x7f194c067ab0 2021-01-27T09:45:09.909 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.905+0000 7f194a7fc700 1 -- 172.21.15.146:0/1575897180 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1944009870 con 0x7f194c067ab0 2021-01-27T09:45:09.910 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.905+0000 7f194a7fc700 1 -- 172.21.15.146:0/1575897180 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1944009bf0 con 0x7f194c067ab0 2021-01-27T09:45:09.911 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.905+0000 7f1950f82700 1 -- 172.21.15.146:0/1575897180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f194c067ab0 msgr2=0x7f194c14f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:09.911 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.905+0000 7f1950f82700 1 --2- 172.21.15.146:0/1575897180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f194c067ab0 0x7f194c14f090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f194400b9c0 tx=0x7f1944006e20).stop 2021-01-27T09:45:09.911 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.905+0000 7f1950f82700 1 -- 172.21.15.146:0/1575897180 shutdown_connections 2021-01-27T09:45:09.911 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.905+0000 7f1950f82700 1 --2- 172.21.15.146:0/1575897180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f194c067ab0 0x7f194c14f090 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:09.912 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.905+0000 7f1950f82700 1 -- 172.21.15.146:0/1575897180 >> 172.21.15.146:0/1575897180 conn(0x7f194c0c11a0 msgr2=0x7f194c0c15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:09.912 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.905+0000 7f1950f82700 1 -- 172.21.15.146:0/1575897180 shutdown_connections 2021-01-27T09:45:09.912 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.905+0000 7f1950f82700 1 -- 172.21.15.146:0/1575897180 wait complete. 2021-01-27T09:45:09.913 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.909+0000 7f1950f82700 1 Processor -- start 2021-01-27T09:45:09.913 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.909+0000 7f1950f82700 1 -- start start 2021-01-27T09:45:09.914 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.913+0000 7f1950f82700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f194c0629b0 0x7f194c14bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:09.915 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.913+0000 7f1950f82700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f194c062d90 0x7f194c0bb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:09.915 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.913+0000 7f1950f82700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f194c067ab0 0x7f194c0bbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:09.915 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.913+0000 7f1950f82700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c161430 con 0x7f194c067ab0 2021-01-27T09:45:09.915 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.913+0000 7f1950f82700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c061db0 con 0x7f194c0629b0 2021-01-27T09:45:09.916 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.913+0000 7f1950f82700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194c14c840 con 0x7f194c062d90 2021-01-27T09:45:09.918 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.913+0000 7f194b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f194c0629b0 0x7f194c14bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:09.918 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.913+0000 7f194b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f194c0629b0 0x7f194c14bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47108/0 (socket says 172.21.15.146:47108) 2021-01-27T09:45:09.918 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.913+0000 7f194b7fe700 1 -- 172.21.15.146:0/2423404658 learned_addr learned my addr 172.21.15.146:0/2423404658 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:09.918 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.913+0000 7f194affd700 1 --2- 172.21.15.146:0/2423404658 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f194c062d90 0x7f194c0bb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:09.918 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.913+0000 7f194bfff700 1 --2- 172.21.15.146:0/2423404658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f194c067ab0 0x7f194c0bbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:09.919 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.913+0000 7f194b7fe700 1 -- 172.21.15.146:0/2423404658 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f194c062d90 msgr2=0x7f194c0bb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:09.919 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.913+0000 7f194b7fe700 1 --2- 172.21.15.146:0/2423404658 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f194c062d90 0x7f194c0bb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:09.919 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.913+0000 7f194b7fe700 1 -- 172.21.15.146:0/2423404658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f194c067ab0 msgr2=0x7f194c0bbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:09.919 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.913+0000 7f194b7fe700 1 --2- 172.21.15.146:0/2423404658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f194c067ab0 0x7f194c0bbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:09.920 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.913+0000 7f194b7fe700 1 -- 172.21.15.146:0/2423404658 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c14cae0 con 0x7f194c0629b0 2021-01-27T09:45:09.921 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.913+0000 7f194b7fe700 1 --2- 172.21.15.146:0/2423404658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f194c0629b0 0x7f194c14bcd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f193400c740 tx=0x7f1934007af0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:09.921 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.913+0000 7f19437fe700 1 -- 172.21.15.146:0/2423404658 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19340072e0 con 0x7f194c0629b0 2021-01-27T09:45:09.921 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.913+0000 7f19437fe700 1 -- 172.21.15.146:0/2423404658 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1934007440 con 0x7f194c0629b0 2021-01-27T09:45:09.921 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.913+0000 7f1950f82700 1 -- 172.21.15.146:0/2423404658 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194c14cd80 con 0x7f194c0629b0 2021-01-27T09:45:09.922 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.913+0000 7f19437fe700 1 -- 172.21.15.146:0/2423404658 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1934005850 con 0x7f194c0629b0 2021-01-27T09:45:09.922 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.913+0000 7f1950f82700 1 -- 172.21.15.146:0/2423404658 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194c14d340 con 0x7f194c0629b0 2021-01-27T09:45:09.923 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.917+0000 7f1950f82700 1 -- 172.21.15.146:0/2423404658 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194c14f4f0 con 0x7f194c0629b0 2021-01-27T09:45:09.923 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.917+0000 7f19437fe700 1 -- 172.21.15.146:0/2423404658 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f1934010070 con 0x7f194c0629b0 2021-01-27T09:45:09.923 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.917+0000 7f19437fe700 1 --2- 172.21.15.146:0/2423404658 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f1930056210 0x7f19300586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:09.923 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.917+0000 7f19437fe700 1 -- 172.21.15.146:0/2423404658 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f193406eaf0 con 0x7f194c0629b0 2021-01-27T09:45:09.924 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.921+0000 7f194affd700 1 --2- 172.21.15.146:0/2423404658 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f1930056210 0x7f19300586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:09.924 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.921+0000 7f194affd700 1 --2- 172.21.15.146:0/2423404658 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f1930056210 0x7f19300586d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f193c007fd0 tx=0x7f193c007db0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:09.925 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:09.921+0000 7f19437fe700 1 -- 172.21.15.146:0/2423404658 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f1934044120 con 0x7f194c0629b0 2021-01-27T09:45:10.066 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.065+0000 7f1950f82700 1 -- 172.21.15.146:0/2423404658 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f194c044680 con 0x7f194c0629b0 2021-01-27T09:45:10.067 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.065+0000 7f19437fe700 1 -- 172.21.15.146:0/2423404658 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7f193406ee60 con 0x7f194c0629b0 2021-01-27T09:45:10.067 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2021-01-27T09:45:10.069 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.065+0000 7f1950f82700 1 -- 172.21.15.146:0/2423404658 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f1930056210 msgr2=0x7f19300586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:10.070 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.065+0000 7f1950f82700 1 --2- 172.21.15.146:0/2423404658 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f1930056210 0x7f19300586d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f193c007fd0 tx=0x7f193c007db0).stop 2021-01-27T09:45:10.070 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.065+0000 7f1950f82700 1 -- 172.21.15.146:0/2423404658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f194c0629b0 msgr2=0x7f194c14bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:10.070 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.065+0000 7f1950f82700 1 --2- 172.21.15.146:0/2423404658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f194c0629b0 0x7f194c14bcd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f193400c740 tx=0x7f1934007af0).stop 2021-01-27T09:45:10.070 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.065+0000 7f1950f82700 1 -- 172.21.15.146:0/2423404658 shutdown_connections 2021-01-27T09:45:10.071 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.065+0000 7f1950f82700 1 --2- 172.21.15.146:0/2423404658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f194c067ab0 0x7f194c0bbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:10.071 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.065+0000 7f1950f82700 1 --2- 172.21.15.146:0/2423404658 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f194c062d90 0x7f194c0bb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:10.071 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.065+0000 7f1950f82700 1 --2- 172.21.15.146:0/2423404658 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f1930056210 0x7f19300586d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:10.071 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.065+0000 7f1950f82700 1 --2- 172.21.15.146:0/2423404658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f194c0629b0 0x7f194c14bcd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:10.071 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.065+0000 7f1950f82700 1 -- 172.21.15.146:0/2423404658 >> 172.21.15.146:0/2423404658 conn(0x7f194c0c11a0 msgr2=0x7f194c14a850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:10.072 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.065+0000 7f1950f82700 1 -- 172.21.15.146:0/2423404658 shutdown_connections 2021-01-27T09:45:10.072 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.069+0000 7f1950f82700 1 -- 172.21.15.146:0/2423404658 wait complete. 2021-01-27T09:45:10.095 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-01-27T09:45:10.262 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.257+0000 7f732af95700 1 Processor -- start 2021-01-27T09:45:10.262 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.257+0000 7f732af95700 1 -- start start 2021-01-27T09:45:10.264 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.261+0000 7f732af95700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7324065260 0x7f73240bf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:10.264 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.261+0000 7f732af95700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7324065640 0x7f7324151d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:10.264 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.261+0000 7f732af95700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73240bf5c0 con 0x7f73240bbb20 2021-01-27T09:45:10.264 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.261+0000 7f732af95700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7324063830 con 0x7f7324065260 2021-01-27T09:45:10.265 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.261+0000 7f732af95700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73240bfda0 con 0x7f7324065640 2021-01-27T09:45:10.266 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.261+0000 7f7328d31700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7324065260 0x7f73240bf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:10.266 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.261+0000 7f7323fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7324065640 0x7f7324151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:10.266 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.261+0000 7f7328d31700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7324065260 0x7f73240bf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:49990/0 (socket says 172.21.15.146:49990) 2021-01-27T09:45:10.266 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.261+0000 7f7328d31700 1 -- 172.21.15.146:0/2322969150 learned_addr learned my addr 172.21.15.146:0/2322969150 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:10.267 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.261+0000 7f7329532700 1 --1- 172.21.15.146:0/2322969150 >> v1:172.21.15.146:6789/0 conn(0x7f73240bbb20 0x7f732414af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46692/0 (socket says 172.21.15.146:46692) 2021-01-27T09:45:10.267 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.261+0000 7f73237fe700 1 -- 172.21.15.146:0/2322969150 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848881875 0 0) 0x7f73240bf5c0 con 0x7f73240bbb20 2021-01-27T09:45:10.267 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.265+0000 7f73237fe700 1 -- 172.21.15.146:0/2322969150 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7308003270 con 0x7f73240bbb20 2021-01-27T09:45:10.267 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.265+0000 7f7323fff700 1 -- 172.21.15.146:0/2322969150 >> v2:172.21.15.78:3300/0 conn(0x7f7324065260 msgr2=0x7f73240bf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:10.267 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.265+0000 7f7323fff700 1 --2- 172.21.15.146:0/2322969150 >> v2:172.21.15.78:3300/0 conn(0x7f7324065260 0x7f73240bf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:10.268 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.265+0000 7f7323fff700 1 -- 172.21.15.146:0/2322969150 >> v1:172.21.15.146:6789/0 conn(0x7f73240bbb20 legacy=0x7f732414af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:10.268 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.265+0000 7f7323fff700 1 -- 172.21.15.146:0/2322969150 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73240bf860 con 0x7f7324065640 2021-01-27T09:45:10.269 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.265+0000 7f7323fff700 1 --2- 172.21.15.146:0/2322969150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7324065640 0x7f7324151d50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f7324062160 tx=0x7f7310006e20).ready entity=mon.1 client_cookie=f5cbdedc5ffd0f80 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:10.269 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.265+0000 7f73237fe700 1 -- 172.21.15.146:0/2322969150 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73100095c0 con 0x7f7324065640 2021-01-27T09:45:10.270 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.265+0000 7f73237fe700 1 -- 172.21.15.146:0/2322969150 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7310009720 con 0x7f7324065640 2021-01-27T09:45:10.270 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.265+0000 7f73237fe700 1 -- 172.21.15.146:0/2322969150 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7310009aa0 con 0x7f7324065640 2021-01-27T09:45:10.270 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.265+0000 7f732af95700 1 -- 172.21.15.146:0/2322969150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7324065640 msgr2=0x7f7324151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:10.270 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.265+0000 7f732af95700 1 --2- 172.21.15.146:0/2322969150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7324065640 0x7f7324151d50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f7324062160 tx=0x7f7310006e20).stop 2021-01-27T09:45:10.270 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.265+0000 7f732af95700 1 -- 172.21.15.146:0/2322969150 shutdown_connections 2021-01-27T09:45:10.271 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.265+0000 7f732af95700 1 --2- 172.21.15.146:0/2322969150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7324065640 0x7f7324151d50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:10.271 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.265+0000 7f732af95700 1 --2- 172.21.15.146:0/2322969150 >> v2:172.21.15.78:3300/0 conn(0x7f7324065260 0x7f73240bf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:10.271 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.265+0000 7f732af95700 1 -- 172.21.15.146:0/2322969150 >> 172.21.15.146:0/2322969150 conn(0x7f7324069110 msgr2=0x7f7324067e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:10.271 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.265+0000 7f732af95700 1 -- 172.21.15.146:0/2322969150 shutdown_connections 2021-01-27T09:45:10.272 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.265+0000 7f732af95700 1 -- 172.21.15.146:0/2322969150 wait complete. 2021-01-27T09:45:10.272 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.269+0000 7f732af95700 1 Processor -- start 2021-01-27T09:45:10.272 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.269+0000 7f732af95700 1 -- start start 2021-01-27T09:45:10.274 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.273+0000 7f732af95700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7324065260 0x7f7324145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:10.274 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.273+0000 7f732af95700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7324065640 0x7f732414a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:10.274 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.273+0000 7f732af95700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f73240bbb20 0x7f732415d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:10.275 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.273+0000 7f732af95700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7324160ac0 con 0x7f7324065640 2021-01-27T09:45:10.275 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.273+0000 7f732af95700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7324160cf0 con 0x7f7324065260 2021-01-27T09:45:10.275 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.273+0000 7f732af95700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7324160f90 con 0x7f73240bbb20 2021-01-27T09:45:10.276 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.273+0000 7f7329532700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f73240bbb20 0x7f732415d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:10.276 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.273+0000 7f7328d31700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7324065260 0x7f7324145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:10.277 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.273+0000 7f7323fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7324065640 0x7f732414a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:10.277 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.273+0000 7f7329532700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f73240bbb20 0x7f732415d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36608/0 (socket says 172.21.15.146:36608) 2021-01-27T09:45:10.277 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.273+0000 7f7329532700 1 -- 172.21.15.146:0/3223889506 learned_addr learned my addr 172.21.15.146:0/3223889506 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:10.277 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.273+0000 7f7328d31700 1 -- 172.21.15.146:0/3223889506 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f73240bbb20 msgr2=0x7f732415d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:10.278 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.273+0000 7f7328d31700 1 --2- 172.21.15.146:0/3223889506 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f73240bbb20 0x7f732415d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:10.278 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.273+0000 7f7328d31700 1 -- 172.21.15.146:0/3223889506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7324065640 msgr2=0x7f732414a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:10.278 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.273+0000 7f7328d31700 1 --2- 172.21.15.146:0/3223889506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7324065640 0x7f732414a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:10.278 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.273+0000 7f7328d31700 1 -- 172.21.15.146:0/3223889506 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7324161230 con 0x7f7324065260 2021-01-27T09:45:10.278 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.273+0000 7f7329532700 1 --2- 172.21.15.146:0/3223889506 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f73240bbb20 0x7f732415d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:45:10.279 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.273+0000 7f7328d31700 1 --2- 172.21.15.146:0/3223889506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7324065260 0x7f7324145610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f731800f890 tx=0x7f7318008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:10.279 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.273+0000 7f7320ff9700 1 -- 172.21.15.146:0/3223889506 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318014670 con 0x7f7324065260 2021-01-27T09:45:10.280 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.273+0000 7f7320ff9700 1 -- 172.21.15.146:0/3223889506 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73180147d0 con 0x7f7324065260 2021-01-27T09:45:10.280 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.273+0000 7f7320ff9700 1 -- 172.21.15.146:0/3223889506 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318014b70 con 0x7f7324065260 2021-01-27T09:45:10.280 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.273+0000 7f732af95700 1 -- 172.21.15.146:0/3223889506 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73241614d0 con 0x7f7324065260 2021-01-27T09:45:10.280 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.273+0000 7f732af95700 1 -- 172.21.15.146:0/3223889506 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73240c3a10 con 0x7f7324065260 2021-01-27T09:45:10.281 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.277+0000 7f732af95700 1 -- 172.21.15.146:0/3223889506 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7324044ee0 con 0x7f7324065260 2021-01-27T09:45:10.281 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.277+0000 7f7320ff9700 1 -- 172.21.15.146:0/3223889506 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f73180133c0 con 0x7f7324065260 2021-01-27T09:45:10.282 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.277+0000 7f7320ff9700 1 --2- 172.21.15.146:0/3223889506 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f73040561e0 0x7f73040586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:10.282 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.277+0000 7f7320ff9700 1 -- 172.21.15.146:0/3223889506 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f731806f760 con 0x7f7324065260 2021-01-27T09:45:10.282 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.277+0000 7f7323fff700 1 --2- 172.21.15.146:0/3223889506 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f73040561e0 0x7f73040586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:10.283 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.281+0000 7f7323fff700 1 --2- 172.21.15.146:0/3223889506 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f73040561e0 0x7f73040586a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f7310007fd0 tx=0x7f7310016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:10.287 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.285+0000 7f7320ff9700 1 -- 172.21.15.146:0/3223889506 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f7318044db0 con 0x7f7324065260 2021-01-27T09:45:10.427 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.425+0000 7f732af95700 1 -- 172.21.15.146:0/3223889506 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f732414f530 con 0x7f7324065260 2021-01-27T09:45:10.428 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.425+0000 7f7320ff9700 1 -- 172.21.15.146:0/3223889506 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7318018020 con 0x7f7324065260 2021-01-27T09:45:10.428 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:45:10.432 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.429+0000 7f732af95700 1 -- 172.21.15.146:0/3223889506 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f73040561e0 msgr2=0x7f73040586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:10.432 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.429+0000 7f732af95700 1 --2- 172.21.15.146:0/3223889506 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f73040561e0 0x7f73040586a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f7310007fd0 tx=0x7f7310016000).stop 2021-01-27T09:45:10.432 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.429+0000 7f732af95700 1 -- 172.21.15.146:0/3223889506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7324065260 msgr2=0x7f7324145610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:10.432 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.429+0000 7f732af95700 1 --2- 172.21.15.146:0/3223889506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7324065260 0x7f7324145610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f731800f890 tx=0x7f7318008040).stop 2021-01-27T09:45:10.433 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.429+0000 7f732af95700 1 -- 172.21.15.146:0/3223889506 shutdown_connections 2021-01-27T09:45:10.433 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.429+0000 7f732af95700 1 --2- 172.21.15.146:0/3223889506 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f73240bbb20 0x7f732415d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:10.433 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.429+0000 7f732af95700 1 --2- 172.21.15.146:0/3223889506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7324065640 0x7f732414a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:10.433 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.429+0000 7f732af95700 1 --2- 172.21.15.146:0/3223889506 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f73040561e0 0x7f73040586a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:10.433 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.429+0000 7f732af95700 1 --2- 172.21.15.146:0/3223889506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7324065260 0x7f7324145610 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:10.434 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.429+0000 7f732af95700 1 -- 172.21.15.146:0/3223889506 >> 172.21.15.146:0/3223889506 conn(0x7f7324069110 msgr2=0x7f73240627f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:10.434 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.429+0000 7f732af95700 1 -- 172.21.15.146:0/3223889506 shutdown_connections 2021-01-27T09:45:10.434 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.429+0000 7f732af95700 1 -- 172.21.15.146:0/3223889506 wait complete. 2021-01-27T09:45:10.459 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-01-27T09:45:10.629 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.625+0000 7f76f5453700 1 Processor -- start 2021-01-27T09:45:10.629 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.625+0000 7f76f5453700 1 -- start start 2021-01-27T09:45:10.631 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.629+0000 7f76f5453700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f76f0062c20 0x7f76f0061740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:10.631 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.629+0000 7f76f5453700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f76f00c2470 0x7f76f014ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.629+0000 7f76f5453700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f0151500 con 0x7f76f0061360 2021-01-27T09:45:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.629+0000 7f76f5453700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f00bfcd0 con 0x7f76f0062c20 2021-01-27T09:45:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.629+0000 7f76f5453700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f01517a0 con 0x7f76f00c2470 2021-01-27T09:45:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.629+0000 7f76eeffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f76f0061360 0x7f76f014afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46702/0 (socket says 172.21.15.146:46702) 2021-01-27T09:45:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.629+0000 7f76eeffd700 1 -- 172.21.15.146:0/3002066729 learned_addr learned my addr 172.21.15.146:0/3002066729 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:10.634 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.629+0000 7f76effff700 1 --2- 172.21.15.146:0/3002066729 >> v2:172.21.15.146:3300/0 conn(0x7f76f00c2470 0x7f76f014ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:10.634 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.629+0000 7f76ee7fc700 1 --2- 172.21.15.146:0/3002066729 >> v2:172.21.15.78:3300/0 conn(0x7f76f0062c20 0x7f76f0061740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:10.635 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.629+0000 7f76edffb700 1 -- 172.21.15.146:0/3002066729 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513631604 0 0) 0x7f76f0151500 con 0x7f76f0061360 2021-01-27T09:45:10.635 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.629+0000 7f76edffb700 1 -- 172.21.15.146:0/3002066729 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76dc003270 con 0x7f76f0061360 2021-01-27T09:45:10.635 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.629+0000 7f76edffb700 1 -- 172.21.15.146:0/3002066729 <== mon.1 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2969942363 0 0) 0x7f76dc003270 con 0x7f76f0061360 2021-01-27T09:45:10.635 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.629+0000 7f76ee7fc700 1 -- 172.21.15.146:0/3002066729 >> v2:172.21.15.146:3300/0 conn(0x7f76f00c2470 msgr2=0x7f76f014ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:10.636 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.629+0000 7f76ee7fc700 1 --2- 172.21.15.146:0/3002066729 >> v2:172.21.15.146:3300/0 conn(0x7f76f00c2470 0x7f76f014ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:10.636 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.629+0000 7f76ee7fc700 1 -- 172.21.15.146:0/3002066729 >> v1:172.21.15.146:6789/0 conn(0x7f76f0061360 legacy=0x7f76f014afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:10.636 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.629+0000 7f76ee7fc700 1 -- 172.21.15.146:0/3002066729 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f0151a40 con 0x7f76f0062c20 2021-01-27T09:45:10.636 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.629+0000 7f76ee7fc700 1 --2- 172.21.15.146:0/3002066729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f0062c20 0x7f76f0061740 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f76f014ef50 tx=0x7f76e4006e20).ready entity=mon.0 client_cookie=aba72a0829127b server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:10.637 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.633+0000 7f76edffb700 1 -- 172.21.15.146:0/3002066729 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e0001520 con 0x7f76f0062c20 2021-01-27T09:45:10.637 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.633+0000 7f76edffb700 1 -- 172.21.15.146:0/3002066729 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e400be80 con 0x7f76f0062c20 2021-01-27T09:45:10.637 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.633+0000 7f76edffb700 1 -- 172.21.15.146:0/3002066729 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4009770 con 0x7f76f0062c20 2021-01-27T09:45:10.638 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.633+0000 7f76f5453700 1 -- 172.21.15.146:0/3002066729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f0062c20 msgr2=0x7f76f0061740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:10.638 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.633+0000 7f76f5453700 1 --2- 172.21.15.146:0/3002066729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f0062c20 0x7f76f0061740 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f76f014ef50 tx=0x7f76e4006e20).stop 2021-01-27T09:45:10.639 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.633+0000 7f76f5453700 1 -- 172.21.15.146:0/3002066729 shutdown_connections 2021-01-27T09:45:10.639 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.633+0000 7f76f5453700 1 --2- 172.21.15.146:0/3002066729 >> v2:172.21.15.146:3300/0 conn(0x7f76f00c2470 0x7f76f014ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:10.639 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.633+0000 7f76f5453700 1 --2- 172.21.15.146:0/3002066729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f0062c20 0x7f76f0061740 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:10.639 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.633+0000 7f76f5453700 1 -- 172.21.15.146:0/3002066729 >> 172.21.15.146:0/3002066729 conn(0x7f76f0062810 msgr2=0x7f76f0067ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:10.640 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.633+0000 7f76f5453700 1 -- 172.21.15.146:0/3002066729 shutdown_connections 2021-01-27T09:45:10.640 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.633+0000 7f76f5453700 1 -- 172.21.15.146:0/3002066729 wait complete. 2021-01-27T09:45:10.640 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.637+0000 7f76f5453700 1 Processor -- start 2021-01-27T09:45:10.640 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.637+0000 7f76f5453700 1 -- start start 2021-01-27T09:45:10.643 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.637+0000 7f76f5453700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76f0061360 0x7f76f00bc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:10.643 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.637+0000 7f76f5453700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f0062c20 0x7f76f0148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:10.643 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.637+0000 7f76f5453700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76f00c2470 0x7f76f0141f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:10.643 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.637+0000 7f76f5453700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f0145840 con 0x7f76f0062c20 2021-01-27T09:45:10.644 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.637+0000 7f76f5453700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f00c3fe0 con 0x7f76f00c2470 2021-01-27T09:45:10.644 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.637+0000 7f76f5453700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f0160960 con 0x7f76f0061360 2021-01-27T09:45:10.644 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.637+0000 7f76ee7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f0062c20 0x7f76f0148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:10.644 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.637+0000 7f76effff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76f00c2470 0x7f76f0141f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:10.645 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.637+0000 7f76ee7fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f0062c20 0x7f76f0148ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:50010/0 (socket says 172.21.15.146:50010) 2021-01-27T09:45:10.645 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.637+0000 7f76ee7fc700 1 -- 172.21.15.146:0/1611082040 learned_addr learned my addr 172.21.15.146:0/1611082040 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:10.645 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.637+0000 7f76eeffd700 1 --2- 172.21.15.146:0/1611082040 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76f0061360 0x7f76f00bc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:10.645 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.637+0000 7f76ee7fc700 1 -- 172.21.15.146:0/1611082040 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76f0061360 msgr2=0x7f76f00bc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:10.646 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.637+0000 7f76ee7fc700 1 --2- 172.21.15.146:0/1611082040 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76f0061360 0x7f76f00bc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:10.646 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.637+0000 7f76ee7fc700 1 -- 172.21.15.146:0/1611082040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76f00c2470 msgr2=0x7f76f0141f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:10.646 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.637+0000 7f76ee7fc700 1 --2- 172.21.15.146:0/1611082040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76f00c2470 0x7f76f0141f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:10.647 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.637+0000 7f76ee7fc700 1 -- 172.21.15.146:0/1611082040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f0145a70 con 0x7f76f0062c20 2021-01-27T09:45:10.647 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.637+0000 7f76effff700 1 --2- 172.21.15.146:0/1611082040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76f00c2470 0x7f76f0141f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:45:10.647 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.641+0000 7f76ee7fc700 1 --2- 172.21.15.146:0/1611082040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f0062c20 0x7f76f0148ab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f76e4010000 tx=0x7f76e4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:10.648 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.641+0000 7f76d6ffd700 1 -- 172.21.15.146:0/1611082040 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4021070 con 0x7f76f0062c20 2021-01-27T09:45:10.648 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.641+0000 7f76d6ffd700 1 -- 172.21.15.146:0/1611082040 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e40118e0 con 0x7f76f0062c20 2021-01-27T09:45:10.648 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.641+0000 7f76f5453700 1 -- 172.21.15.146:0/1611082040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f00c3aa0 con 0x7f76f0062c20 2021-01-27T09:45:10.648 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.641+0000 7f76d6ffd700 1 -- 172.21.15.146:0/1611082040 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4011c80 con 0x7f76f0062c20 2021-01-27T09:45:10.648 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.641+0000 7f76f5453700 1 -- 172.21.15.146:0/1611082040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f014fcf0 con 0x7f76f0062c20 2021-01-27T09:45:10.649 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.641+0000 7f76f5453700 1 -- 172.21.15.146:0/1611082040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f00630f0 con 0x7f76f0062c20 2021-01-27T09:45:10.650 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.645+0000 7f76d6ffd700 1 -- 172.21.15.146:0/1611082040 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f76e400f070 con 0x7f76f0062c20 2021-01-27T09:45:10.650 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.645+0000 7f76d6ffd700 1 --2- 172.21.15.146:0/1611082040 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f76d00561b0 0x7f76d0058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:10.650 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.645+0000 7f76d6ffd700 1 -- 172.21.15.146:0/1611082040 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f76e4070a80 con 0x7f76f0062c20 2021-01-27T09:45:10.651 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.645+0000 7f76eeffd700 1 --2- 172.21.15.146:0/1611082040 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f76d00561b0 0x7f76d0058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:10.651 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.645+0000 7f76eeffd700 1 --2- 172.21.15.146:0/1611082040 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f76d00561b0 0x7f76d0058670 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f76e0000c00 tx=0x7f76e0001230).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.653+0000 7f76d6ffd700 1 -- 172.21.15.146:0/1611082040 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f76e40461b0 con 0x7f76f0062c20 2021-01-27T09:45:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.801+0000 7f76f5453700 1 -- 172.21.15.146:0/1611082040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f76f0044ee0 con 0x7f76f0062c20 2021-01-27T09:45:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.801+0000 7f76d6ffd700 1 -- 172.21.15.146:0/1611082040 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+10 (secure 0 0 0) 0x7f76e40069b0 con 0x7f76f0062c20 2021-01-27T09:45:10.804 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:45:10.805 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.801+0000 7f76f5453700 1 -- 172.21.15.146:0/1611082040 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f76d00561b0 msgr2=0x7f76d0058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:10.806 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.801+0000 7f76f5453700 1 --2- 172.21.15.146:0/1611082040 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f76d00561b0 0x7f76d0058670 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f76e0000c00 tx=0x7f76e0001230).stop 2021-01-27T09:45:10.806 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.801+0000 7f76f5453700 1 -- 172.21.15.146:0/1611082040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f0062c20 msgr2=0x7f76f0148ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:10.806 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.801+0000 7f76f5453700 1 --2- 172.21.15.146:0/1611082040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f0062c20 0x7f76f0148ab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f76e4010000 tx=0x7f76e4016000).stop 2021-01-27T09:45:10.806 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.805+0000 7f76f5453700 1 -- 172.21.15.146:0/1611082040 shutdown_connections 2021-01-27T09:45:10.807 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.805+0000 7f76f5453700 1 --2- 172.21.15.146:0/1611082040 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f76d00561b0 0x7f76d0058670 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:10.807 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.805+0000 7f76f5453700 1 --2- 172.21.15.146:0/1611082040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76f00c2470 0x7f76f0141f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:10.807 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.805+0000 7f76f5453700 1 --2- 172.21.15.146:0/1611082040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f0062c20 0x7f76f0148ab0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:10.807 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.805+0000 7f76f5453700 1 --2- 172.21.15.146:0/1611082040 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76f0061360 0x7f76f00bc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:10.808 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.805+0000 7f76f5453700 1 -- 172.21.15.146:0/1611082040 >> 172.21.15.146:0/1611082040 conn(0x7f76f0062810 msgr2=0x7f76f0146630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:10.808 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.805+0000 7f76f5453700 1 -- 172.21.15.146:0/1611082040 shutdown_connections 2021-01-27T09:45:10.808 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.805+0000 7f76f5453700 1 -- 172.21.15.146:0/1611082040 wait complete. 2021-01-27T09:45:10.833 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-01-27T09:45:10.998 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.993+0000 7f399b127700 1 Processor -- start 2021-01-27T09:45:10.998 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.997+0000 7f399b127700 1 -- start start 2021-01-27T09:45:11.001 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.997+0000 7f399b127700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f39940c49e0 0x7f39940c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:11.002 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.997+0000 7f399b127700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f399414dd70 0x7f39940c18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:11.002 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.997+0000 7f399b127700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399414e2b0 con 0x7f39940c4600 2021-01-27T09:45:11.003 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.997+0000 7f399b127700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3994060b70 con 0x7f399414dd70 2021-01-27T09:45:11.003 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.997+0000 7f399b127700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39940c1d90 con 0x7f39940c49e0 2021-01-27T09:45:11.003 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.997+0000 7f399a125700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f39940c4600 0x7f3994060450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46716/0 (socket says 172.21.15.146:46716) 2021-01-27T09:45:11.004 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.997+0000 7f399a125700 1 -- 172.21.15.146:0/4066119120 learned_addr learned my addr 172.21.15.146:0/4066119120 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:11.004 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.997+0000 7f399a926700 1 --2- 172.21.15.146:0/4066119120 >> v2:172.21.15.78:3300/0 conn(0x7f399414dd70 0x7f39940c18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:11.005 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:10.997+0000 7f3999924700 1 --2- 172.21.15.146:0/4066119120 >> v2:172.21.15.146:3300/0 conn(0x7f39940c49e0 0x7f39940c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:11.010 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.001+0000 7f3999123700 1 -- 172.21.15.146:0/4066119120 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1255207301 0 0) 0x7f399414e2b0 con 0x7f39940c4600 2021-01-27T09:45:11.011 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.001+0000 7f3999123700 1 -- 172.21.15.146:0/4066119120 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f397c003270 con 0x7f39940c4600 2021-01-27T09:45:11.011 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.001+0000 7f3999123700 1 -- 172.21.15.146:0/4066119120 <== mon.1 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 793232738 0 0) 0x7f397c003270 con 0x7f39940c4600 2021-01-27T09:45:11.011 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.001+0000 7f3999924700 1 -- 172.21.15.146:0/4066119120 >> v2:172.21.15.78:3300/0 conn(0x7f399414dd70 msgr2=0x7f39940c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:11.011 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.001+0000 7f3999924700 1 --2- 172.21.15.146:0/4066119120 >> v2:172.21.15.78:3300/0 conn(0x7f399414dd70 0x7f39940c18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.011 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.001+0000 7f3999924700 1 -- 172.21.15.146:0/4066119120 >> v1:172.21.15.146:6789/0 conn(0x7f39940c4600 legacy=0x7f3994060450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:11.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.001+0000 7f3999924700 1 -- 172.21.15.146:0/4066119120 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399414e550 con 0x7f39940c49e0 2021-01-27T09:45:11.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.001+0000 7f3999924700 1 --2- 172.21.15.146:0/4066119120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39940c49e0 0x7f39940c13b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f3994065ba0 tx=0x7f3984006e20).ready entity=mon.1 client_cookie=2b94a8612b22ff0a server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:11.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.001+0000 7f3999123700 1 -- 172.21.15.146:0/4066119120 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3990001520 con 0x7f39940c49e0 2021-01-27T09:45:11.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.001+0000 7f3999123700 1 -- 172.21.15.146:0/4066119120 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3984011400 con 0x7f39940c49e0 2021-01-27T09:45:11.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.001+0000 7f3999123700 1 -- 172.21.15.146:0/4066119120 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984011780 con 0x7f39940c49e0 2021-01-27T09:45:11.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.001+0000 7f399b127700 1 -- 172.21.15.146:0/4066119120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39940c49e0 msgr2=0x7f39940c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:11.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.001+0000 7f399b127700 1 --2- 172.21.15.146:0/4066119120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39940c49e0 0x7f39940c13b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f3994065ba0 tx=0x7f3984006e20).stop 2021-01-27T09:45:11.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.001+0000 7f399b127700 1 -- 172.21.15.146:0/4066119120 shutdown_connections 2021-01-27T09:45:11.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.001+0000 7f399b127700 1 --2- 172.21.15.146:0/4066119120 >> v2:172.21.15.78:3300/0 conn(0x7f399414dd70 0x7f39940c18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.001+0000 7f399b127700 1 --2- 172.21.15.146:0/4066119120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39940c49e0 0x7f39940c13b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.014 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.001+0000 7f399b127700 1 -- 172.21.15.146:0/4066119120 >> 172.21.15.146:0/4066119120 conn(0x7f3994064f90 msgr2=0x7f39940653a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:11.014 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.001+0000 7f399b127700 1 -- 172.21.15.146:0/4066119120 shutdown_connections 2021-01-27T09:45:11.014 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.001+0000 7f399b127700 1 -- 172.21.15.146:0/4066119120 wait complete. 2021-01-27T09:45:11.014 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.005+0000 7f399b127700 1 Processor -- start 2021-01-27T09:45:11.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.005+0000 7f399b127700 1 -- start start 2021-01-27T09:45:11.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.005+0000 7f399b127700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39940c4600 0x7f39941418e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:11.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.005+0000 7f399b127700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39940c49e0 0x7f3994140af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:11.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.005+0000 7f399b127700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f399414dd70 0x7f399414d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:11.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.005+0000 7f399b127700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3994140fe0 con 0x7f39940c4600 2021-01-27T09:45:11.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.005+0000 7f399b127700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3994160960 con 0x7f39940c49e0 2021-01-27T09:45:11.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.005+0000 7f399b127700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3994160c00 con 0x7f399414dd70 2021-01-27T09:45:11.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.005+0000 7f3999924700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39940c49e0 0x7f3994140af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:11.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.005+0000 7f399a125700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39940c4600 0x7f39941418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:11.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.005+0000 7f3999924700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39940c49e0 0x7f3994140af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47152/0 (socket says 172.21.15.146:47152) 2021-01-27T09:45:11.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.005+0000 7f399a125700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39940c4600 0x7f39941418e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:50024/0 (socket says 172.21.15.146:50024) 2021-01-27T09:45:11.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.005+0000 7f3999924700 1 -- 172.21.15.146:0/3663912907 learned_addr learned my addr 172.21.15.146:0/3663912907 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:11.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.005+0000 7f399a926700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f399414dd70 0x7f399414d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:11.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.009+0000 7f3999924700 1 -- 172.21.15.146:0/3663912907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f399414dd70 msgr2=0x7f399414d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:11.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.009+0000 7f3999924700 1 --2- 172.21.15.146:0/3663912907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f399414dd70 0x7f399414d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.009+0000 7f3999924700 1 -- 172.21.15.146:0/3663912907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39940c4600 msgr2=0x7f39941418e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:11.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.009+0000 7f3999924700 1 --2- 172.21.15.146:0/3663912907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39940c4600 0x7f39941418e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.009+0000 7f3999924700 1 -- 172.21.15.146:0/3663912907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3994160ea0 con 0x7f39940c49e0 2021-01-27T09:45:11.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.009+0000 7f399a125700 1 --2- 172.21.15.146:0/3663912907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39940c4600 0x7f39941418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:45:11.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.009+0000 7f3999924700 1 --2- 172.21.15.146:0/3663912907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39940c49e0 0x7f3994140af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f398400b170 tx=0x7f3984016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:11.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.009+0000 7f39827fc700 1 -- 172.21.15.146:0/3663912907 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984000c90 con 0x7f39940c49e0 2021-01-27T09:45:11.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.009+0000 7f39827fc700 1 -- 172.21.15.146:0/3663912907 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3984010aa0 con 0x7f39940c49e0 2021-01-27T09:45:11.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.009+0000 7f399b127700 1 -- 172.21.15.146:0/3663912907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3994161140 con 0x7f39940c49e0 2021-01-27T09:45:11.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.009+0000 7f39827fc700 1 -- 172.21.15.146:0/3663912907 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984010e40 con 0x7f39940c49e0 2021-01-27T09:45:11.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.009+0000 7f399b127700 1 -- 172.21.15.146:0/3663912907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f399414d7d0 con 0x7f39940c49e0 2021-01-27T09:45:11.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.009+0000 7f399b127700 1 -- 172.21.15.146:0/3663912907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3994161760 con 0x7f39940c49e0 2021-01-27T09:45:11.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.013+0000 7f39827fc700 1 -- 172.21.15.146:0/3663912907 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f398400f070 con 0x7f39940c49e0 2021-01-27T09:45:11.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.013+0000 7f39827fc700 1 --2- 172.21.15.146:0/3663912907 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f39740561e0 0x7f39740586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:11.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.013+0000 7f39827fc700 1 -- 172.21.15.146:0/3663912907 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f3984070960 con 0x7f39940c49e0 2021-01-27T09:45:11.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.013+0000 7f399a125700 1 --2- 172.21.15.146:0/3663912907 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f39740561e0 0x7f39740586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:11.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.013+0000 7f399a125700 1 --2- 172.21.15.146:0/3663912907 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f39740561e0 0x7f39740586a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f3990001ed0 tx=0x7f3990001230).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:11.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.017+0000 7f39827fc700 1 -- 172.21.15.146:0/3663912907 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f3984046010 con 0x7f39940c49e0 2021-01-27T09:45:11.158 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.157+0000 7f399b127700 1 -- 172.21.15.146:0/3663912907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3994044680 con 0x7f39940c49e0 2021-01-27T09:45:11.159 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.157+0000 7f39827fc700 1 -- 172.21.15.146:0/3663912907 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3984049630 con 0x7f39940c49e0 2021-01-27T09:45:11.160 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:45:11.163 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.161+0000 7f399b127700 1 -- 172.21.15.146:0/3663912907 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f39740561e0 msgr2=0x7f39740586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:11.163 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.161+0000 7f399b127700 1 --2- 172.21.15.146:0/3663912907 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f39740561e0 0x7f39740586a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f3990001ed0 tx=0x7f3990001230).stop 2021-01-27T09:45:11.164 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.161+0000 7f399b127700 1 -- 172.21.15.146:0/3663912907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39940c49e0 msgr2=0x7f3994140af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:11.164 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.161+0000 7f399b127700 1 --2- 172.21.15.146:0/3663912907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39940c49e0 0x7f3994140af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f398400b170 tx=0x7f3984016000).stop 2021-01-27T09:45:11.165 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.161+0000 7f399b127700 1 -- 172.21.15.146:0/3663912907 shutdown_connections 2021-01-27T09:45:11.165 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.161+0000 7f399b127700 1 --2- 172.21.15.146:0/3663912907 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f399414dd70 0x7f399414d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.165 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.161+0000 7f399b127700 1 --2- 172.21.15.146:0/3663912907 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f39740561e0 0x7f39740586a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.165 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.161+0000 7f399b127700 1 --2- 172.21.15.146:0/3663912907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39940c49e0 0x7f3994140af0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.165 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.161+0000 7f399b127700 1 --2- 172.21.15.146:0/3663912907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39940c4600 0x7f39941418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.166 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.161+0000 7f399b127700 1 -- 172.21.15.146:0/3663912907 >> 172.21.15.146:0/3663912907 conn(0x7f3994064f90 msgr2=0x7f399414c180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:11.166 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.161+0000 7f399b127700 1 -- 172.21.15.146:0/3663912907 shutdown_connections 2021-01-27T09:45:11.166 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.161+0000 7f399b127700 1 -- 172.21.15.146:0/3663912907 wait complete. 2021-01-27T09:45:11.188 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2021-01-27T09:45:11.358 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.357+0000 7f4216bf6700 1 Processor -- start 2021-01-27T09:45:11.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.357+0000 7f4216bf6700 1 -- start start 2021-01-27T09:45:11.361 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.357+0000 7f4216bf6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f421014c740 0x7f42100bf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:11.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.357+0000 7f4216bf6700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42100bb680 con 0x7f421014cb20 2021-01-27T09:45:11.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.357+0000 7f4216bf6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42100bb8b0 con 0x7f421014fa10 2021-01-27T09:45:11.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.357+0000 7f4216bf6700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42100bd780 con 0x7f421014c740 2021-01-27T09:45:11.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.361+0000 7f420ffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f421014cb20 0x7f42100bd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:34766/0 (socket says 172.21.15.146:34766) 2021-01-27T09:45:11.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.361+0000 7f4214992700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f421014c740 0x7f42100bf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:11.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.361+0000 7f420ffff700 1 -- 172.21.15.146:0/102177221 learned_addr learned my addr 172.21.15.146:0/102177221 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:11.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.361+0000 7f420f7fe700 1 -- 172.21.15.146:0/102177221 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3432419104 0 0) 0x7f42100bb680 con 0x7f421014cb20 2021-01-27T09:45:11.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.361+0000 7f420f7fe700 1 -- 172.21.15.146:0/102177221 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41f4003270 con 0x7f421014cb20 2021-01-27T09:45:11.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.361+0000 7f420f7fe700 1 -- 172.21.15.146:0/102177221 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878080199 0 0) 0x7f42100bb8b0 con 0x7f421014fa10 2021-01-27T09:45:11.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.361+0000 7f420f7fe700 1 -- 172.21.15.146:0/102177221 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42100bb680 con 0x7f421014fa10 2021-01-27T09:45:11.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.361+0000 7f4214992700 1 -- 172.21.15.146:0/102177221 >> v1:172.21.15.146:6789/0 conn(0x7f421014fa10 legacy=0x7f42100631c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:11.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.361+0000 7f4214992700 1 -- 172.21.15.146:0/102177221 >> v1:172.21.15.78:6789/0 conn(0x7f421014cb20 legacy=0x7f42100bd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:11.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.361+0000 7f4214992700 1 -- 172.21.15.146:0/102177221 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42100bbb50 con 0x7f421014c740 2021-01-27T09:45:11.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.361+0000 7f4214992700 1 --2- 172.21.15.146:0/102177221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f421014c740 0x7f42100bf430 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f420400b9f0 tx=0x7f4204006e20).ready entity=mon.0 client_cookie=f736d58805222107 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:11.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.361+0000 7f420f7fe700 1 -- 172.21.15.146:0/102177221 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42040095f0 con 0x7f421014c740 2021-01-27T09:45:11.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.361+0000 7f420f7fe700 1 -- 172.21.15.146:0/102177221 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4204009750 con 0x7f421014c740 2021-01-27T09:45:11.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.361+0000 7f420f7fe700 1 -- 172.21.15.146:0/102177221 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4204009ad0 con 0x7f421014c740 2021-01-27T09:45:11.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.361+0000 7f4216bf6700 1 -- 172.21.15.146:0/102177221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f421014c740 msgr2=0x7f42100bf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:11.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.361+0000 7f4216bf6700 1 --2- 172.21.15.146:0/102177221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f421014c740 0x7f42100bf430 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f420400b9f0 tx=0x7f4204006e20).stop 2021-01-27T09:45:11.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.361+0000 7f4216bf6700 1 -- 172.21.15.146:0/102177221 shutdown_connections 2021-01-27T09:45:11.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.361+0000 7f4216bf6700 1 --2- 172.21.15.146:0/102177221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f421014c740 0x7f42100bf430 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.361+0000 7f4216bf6700 1 -- 172.21.15.146:0/102177221 >> 172.21.15.146:0/102177221 conn(0x7f4210064240 msgr2=0x7f4210064620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:11.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.361+0000 7f4216bf6700 1 -- 172.21.15.146:0/102177221 shutdown_connections 2021-01-27T09:45:11.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.365+0000 7f4216bf6700 1 -- 172.21.15.146:0/102177221 wait complete. 2021-01-27T09:45:11.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.365+0000 7f4216bf6700 1 Processor -- start 2021-01-27T09:45:11.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.365+0000 7f4216bf6700 1 -- start start 2021-01-27T09:45:11.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.365+0000 7f4216bf6700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421014cb20 0x7f421015d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:11.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.365+0000 7f4216bf6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f421014fa10 0x7f4210067400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:11.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.365+0000 7f4216bf6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42100678f0 0x7f421014d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:11.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.365+0000 7f4216bf6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421015d9f0 con 0x7f42100678f0 2021-01-27T09:45:11.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.365+0000 7f4216bf6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42100b7a60 con 0x7f421014fa10 2021-01-27T09:45:11.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.365+0000 7f4216bf6700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421014df10 con 0x7f421014cb20 2021-01-27T09:45:11.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.365+0000 7f420ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f421014fa10 0x7f4210067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:11.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.365+0000 7f4214992700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421014cb20 0x7f421015d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:11.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.365+0000 7f420ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f421014fa10 0x7f4210067400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47166/0 (socket says 172.21.15.146:47166) 2021-01-27T09:45:11.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.369+0000 7f420ffff700 1 -- 172.21.15.146:0/3041317038 learned_addr learned my addr 172.21.15.146:0/3041317038 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:11.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.369+0000 7f4215193700 1 --2- 172.21.15.146:0/3041317038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42100678f0 0x7f421014d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:11.374 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.369+0000 7f4214992700 1 -- 172.21.15.146:0/3041317038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f421014fa10 msgr2=0x7f4210067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:11.374 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.369+0000 7f4214992700 1 --2- 172.21.15.146:0/3041317038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f421014fa10 0x7f4210067400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.374 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.369+0000 7f4214992700 1 -- 172.21.15.146:0/3041317038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42100678f0 msgr2=0x7f421014d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:11.374 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.369+0000 7f4214992700 1 --2- 172.21.15.146:0/3041317038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42100678f0 0x7f421014d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.375 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.369+0000 7f4214992700 1 -- 172.21.15.146:0/3041317038 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42100b7280 con 0x7f421014cb20 2021-01-27T09:45:11.375 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.369+0000 7f4214992700 1 --2- 172.21.15.146:0/3041317038 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421014cb20 0x7f421015d500 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f4204013000 tx=0x7f4204016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:11.375 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.369+0000 7f420cff9700 1 -- 172.21.15.146:0/3041317038 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4204011b70 con 0x7f421014cb20 2021-01-27T09:45:11.375 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.369+0000 7f420cff9700 1 -- 172.21.15.146:0/3041317038 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4204011cd0 con 0x7f421014cb20 2021-01-27T09:45:11.375 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.369+0000 7f420cff9700 1 -- 172.21.15.146:0/3041317038 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420401d610 con 0x7f421014cb20 2021-01-27T09:45:11.376 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.369+0000 7f4216bf6700 1 -- 172.21.15.146:0/3041317038 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42100b7520 con 0x7f421014cb20 2021-01-27T09:45:11.376 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.369+0000 7f4216bf6700 1 -- 172.21.15.146:0/3041317038 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4210066cc0 con 0x7f421014cb20 2021-01-27T09:45:11.376 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.369+0000 7f4216bf6700 1 -- 172.21.15.146:0/3041317038 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4210044ee0 con 0x7f421014cb20 2021-01-27T09:45:11.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.373+0000 7f420cff9700 1 -- 172.21.15.146:0/3041317038 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f420400f070 con 0x7f421014cb20 2021-01-27T09:45:11.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.373+0000 7f420cff9700 1 --2- 172.21.15.146:0/3041317038 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f41f00561e0 0x7f41f00586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:11.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.373+0000 7f420cff9700 1 -- 172.21.15.146:0/3041317038 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f4204070ae0 con 0x7f421014cb20 2021-01-27T09:45:11.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.373+0000 7f420ffff700 1 --2- 172.21.15.146:0/3041317038 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f41f00561e0 0x7f41f00586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:11.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.373+0000 7f420ffff700 1 --2- 172.21.15.146:0/3041317038 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f41f00561e0 0x7f41f00586a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f41fc007fd0 tx=0x7f41fc009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:11.385 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.381+0000 7f420cff9700 1 -- 172.21.15.146:0/3041317038 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f4204046210 con 0x7f421014cb20 2021-01-27T09:45:11.529 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.525+0000 7f4216bf6700 1 -- 172.21.15.146:0/3041317038 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f421005d1a0 con 0x7f421014cb20 2021-01-27T09:45:11.529 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.525+0000 7f420cff9700 1 -- 172.21.15.146:0/3041317038 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+10 (secure 0 0 0) 0x7f42040210a0 con 0x7f421014cb20 2021-01-27T09:45:11.530 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:45:11.531 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.529+0000 7f4216bf6700 1 -- 172.21.15.146:0/3041317038 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f41f00561e0 msgr2=0x7f41f00586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:11.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.529+0000 7f4216bf6700 1 --2- 172.21.15.146:0/3041317038 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f41f00561e0 0x7f41f00586a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f41fc007fd0 tx=0x7f41fc009040).stop 2021-01-27T09:45:11.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.529+0000 7f4216bf6700 1 -- 172.21.15.146:0/3041317038 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421014cb20 msgr2=0x7f421015d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:11.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.529+0000 7f4216bf6700 1 --2- 172.21.15.146:0/3041317038 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421014cb20 0x7f421015d500 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f4204013000 tx=0x7f4204016000).stop 2021-01-27T09:45:11.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.529+0000 7f4216bf6700 1 -- 172.21.15.146:0/3041317038 shutdown_connections 2021-01-27T09:45:11.533 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.529+0000 7f4216bf6700 1 --2- 172.21.15.146:0/3041317038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42100678f0 0x7f421014d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.533 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.529+0000 7f4216bf6700 1 --2- 172.21.15.146:0/3041317038 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f41f00561e0 0x7f41f00586a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.533 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.529+0000 7f4216bf6700 1 --2- 172.21.15.146:0/3041317038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f421014fa10 0x7f4210067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.533 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.529+0000 7f4216bf6700 1 --2- 172.21.15.146:0/3041317038 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f421014cb20 0x7f421015d500 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.533 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.529+0000 7f4216bf6700 1 -- 172.21.15.146:0/3041317038 >> 172.21.15.146:0/3041317038 conn(0x7f4210064240 msgr2=0x7f4210148950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:11.534 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.529+0000 7f4216bf6700 1 -- 172.21.15.146:0/3041317038 shutdown_connections 2021-01-27T09:45:11.534 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.529+0000 7f4216bf6700 1 -- 172.21.15.146:0/3041317038 wait complete. 2021-01-27T09:45:11.560 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-27T09:45:11.561 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:45:11.721 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.717+0000 7f3991ebe700 1 Processor -- start 2021-01-27T09:45:11.722 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.717+0000 7f3991ebe700 1 -- start start 2021-01-27T09:45:11.726 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f3991ebe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f398c14de90 0x7f398c1478c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:11.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f3991ebe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f398c069110 0x7f398c147db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:11.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f3991ebe700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c0b8a60 con 0x7f398c0b8120 2021-01-27T09:45:11.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f3991ebe700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398c067470 con 0x7f398c069110 2021-01-27T09:45:11.729 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f3991ebe700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398c067710 con 0x7f398c14de90 2021-01-27T09:45:11.729 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f398affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f398c14de90 0x7f398c1478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:11.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f398affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f398c14de90 0x7f398c1478c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47172/0 (socket says 172.21.15.146:47172) 2021-01-27T09:45:11.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f398affd700 1 -- 172.21.15.146:0/3891963784 learned_addr learned my addr 172.21.15.146:0/3891963784 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:11.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f398bfff700 1 --2- 172.21.15.146:0/3891963784 >> v2:172.21.15.78:3300/0 conn(0x7f398c069110 0x7f398c147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:11.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f398affd700 1 -- 172.21.15.146:0/3891963784 >> v2:172.21.15.78:3300/0 conn(0x7f398c069110 msgr2=0x7f398c147db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:11.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f398affd700 1 --2- 172.21.15.146:0/3891963784 >> v2:172.21.15.78:3300/0 conn(0x7f398c069110 0x7f398c147db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f398affd700 1 -- 172.21.15.146:0/3891963784 >> v1:172.21.15.146:6789/0 conn(0x7f398c0b8120 legacy=0x7f398c0bd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:11.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f398affd700 1 -- 172.21.15.146:0/3891963784 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c0679b0 con 0x7f398c14de90 2021-01-27T09:45:11.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f398bfff700 1 --2- 172.21.15.146:0/3891963784 >> v2:172.21.15.78:3300/0 conn(0x7f398c069110 0x7f398c147db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:45:11.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f398affd700 1 --2- 172.21.15.146:0/3891963784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f398c14de90 0x7f398c1478c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f398c0b76f0 tx=0x7f3980006e80).ready entity=mon.1 client_cookie=88491fe15075b160 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:11.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f398a7fc700 1 -- 172.21.15.146:0/3891963784 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3980006030 con 0x7f398c14de90 2021-01-27T09:45:11.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f398a7fc700 1 -- 172.21.15.146:0/3891963784 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3980006190 con 0x7f398c14de90 2021-01-27T09:45:11.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f398a7fc700 1 -- 172.21.15.146:0/3891963784 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3980006510 con 0x7f398c14de90 2021-01-27T09:45:11.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f3991ebe700 1 -- 172.21.15.146:0/3891963784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f398c14de90 msgr2=0x7f398c1478c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:11.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f3991ebe700 1 --2- 172.21.15.146:0/3891963784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f398c14de90 0x7f398c1478c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f398c0b76f0 tx=0x7f3980006e80).stop 2021-01-27T09:45:11.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f3991ebe700 1 -- 172.21.15.146:0/3891963784 shutdown_connections 2021-01-27T09:45:11.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f3991ebe700 1 --2- 172.21.15.146:0/3891963784 >> v2:172.21.15.78:3300/0 conn(0x7f398c069110 0x7f398c147db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f3991ebe700 1 --2- 172.21.15.146:0/3891963784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f398c14de90 0x7f398c1478c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f3991ebe700 1 -- 172.21.15.146:0/3891963784 >> 172.21.15.146:0/3891963784 conn(0x7f398c062810 msgr2=0x7f398c062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:11.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f3991ebe700 1 -- 172.21.15.146:0/3891963784 shutdown_connections 2021-01-27T09:45:11.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.721+0000 7f3991ebe700 1 -- 172.21.15.146:0/3891963784 wait complete. 2021-01-27T09:45:11.741 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.725+0000 7f3991ebe700 1 Processor -- start 2021-01-27T09:45:11.741 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.725+0000 7f3991ebe700 1 -- start start 2021-01-27T09:45:11.742 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.729+0000 7f3991ebe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f398c069110 0x7f398c14a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:11.742 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.729+0000 7f3991ebe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f398c0b8120 0x7f398c142200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:11.742 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.729+0000 7f3991ebe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f398c0bb410 0x7f398c13f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:11.742 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.729+0000 7f3991ebe700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c1452b0 con 0x7f398c0bb410 2021-01-27T09:45:11.743 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.729+0000 7f3991ebe700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c165b60 con 0x7f398c069110 2021-01-27T09:45:11.743 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.729+0000 7f3991ebe700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c1658c0 con 0x7f398c0b8120 2021-01-27T09:45:11.743 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.729+0000 7f398b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f398c069110 0x7f398c14a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:11.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.729+0000 7f398b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f398c069110 0x7f398c14a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47178/0 (socket says 172.21.15.146:47178) 2021-01-27T09:45:11.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.729+0000 7f398b7fe700 1 -- 172.21.15.146:0/3394144790 learned_addr learned my addr 172.21.15.146:0/3394144790 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:11.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.729+0000 7f398affd700 1 --2- 172.21.15.146:0/3394144790 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f398c0b8120 0x7f398c142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:11.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.729+0000 7f398bfff700 1 --2- 172.21.15.146:0/3394144790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f398c0bb410 0x7f398c13f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:11.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.729+0000 7f398b7fe700 1 -- 172.21.15.146:0/3394144790 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f398c0b8120 msgr2=0x7f398c142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:11.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.729+0000 7f398b7fe700 1 --2- 172.21.15.146:0/3394144790 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f398c0b8120 0x7f398c142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.729+0000 7f398b7fe700 1 -- 172.21.15.146:0/3394144790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f398c0bb410 msgr2=0x7f398c13f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:11.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.729+0000 7f398b7fe700 1 --2- 172.21.15.146:0/3394144790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f398c0bb410 0x7f398c13f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.729+0000 7f398b7fe700 1 -- 172.21.15.146:0/3394144790 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c141560 con 0x7f398c069110 2021-01-27T09:45:11.750 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.729+0000 7f398affd700 1 --2- 172.21.15.146:0/3394144790 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f398c0b8120 0x7f398c142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:45:11.750 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.729+0000 7f398b7fe700 1 --2- 172.21.15.146:0/3394144790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f398c069110 0x7f398c14a170 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f397c00c710 tx=0x7f397c007c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:11.750 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.729+0000 7f39737fe700 1 -- 172.21.15.146:0/3394144790 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c007020 con 0x7f398c069110 2021-01-27T09:45:11.750 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.729+0000 7f39737fe700 1 -- 172.21.15.146:0/3394144790 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c007180 con 0x7f398c069110 2021-01-27T09:45:11.750 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.729+0000 7f3991ebe700 1 -- 172.21.15.146:0/3394144790 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398c141800 con 0x7f398c069110 2021-01-27T09:45:11.751 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.729+0000 7f39737fe700 1 -- 172.21.15.146:0/3394144790 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c006520 con 0x7f398c069110 2021-01-27T09:45:11.751 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.729+0000 7f3991ebe700 1 -- 172.21.15.146:0/3394144790 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398c0be310 con 0x7f398c069110 2021-01-27T09:45:11.751 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.733+0000 7f3991ebe700 1 -- 172.21.15.146:0/3394144790 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398c044ee0 con 0x7f398c069110 2021-01-27T09:45:11.751 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.733+0000 7f39737fe700 1 -- 172.21.15.146:0/3394144790 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f397c018020 con 0x7f398c069110 2021-01-27T09:45:11.752 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.733+0000 7f39737fe700 1 --2- 172.21.15.146:0/3394144790 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f396c0561e0 0x7f396c0586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:11.752 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.733+0000 7f39737fe700 1 -- 172.21.15.146:0/3394144790 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f397c06ef10 con 0x7f398c069110 2021-01-27T09:45:11.752 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.733+0000 7f398affd700 1 --2- 172.21.15.146:0/3394144790 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f396c0561e0 0x7f396c0586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:11.752 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.733+0000 7f398affd700 1 --2- 172.21.15.146:0/3394144790 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f396c0561e0 0x7f396c0586a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f3980006ec0 tx=0x7f3980015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.741+0000 7f39737fe700 1 -- 172.21.15.146:0/3394144790 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f397c0444b0 con 0x7f398c069110 2021-01-27T09:45:11.911 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.909+0000 7f3991ebe700 1 -- 172.21.15.146:0/3394144790 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f398c063940 con 0x7f398c069110 2021-01-27T09:45:11.912 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.909+0000 7f39737fe700 1 -- 172.21.15.146:0/3394144790 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3574 (secure 0 0 0) 0x7f397c019310 con 0x7f398c069110 2021-01-27T09:45:11.913 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:45:11.913 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:44:52.595879+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6837/745099427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":745099427},{"type":"v1","addr":"172.21.15.146:6837","nonce":745099427}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:45:11.915 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.913+0000 7f3991ebe700 1 -- 172.21.15.146:0/3394144790 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f396c0561e0 msgr2=0x7f396c0586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:11.915 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.913+0000 7f3991ebe700 1 --2- 172.21.15.146:0/3394144790 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f396c0561e0 0x7f396c0586a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f3980006ec0 tx=0x7f3980015000).stop 2021-01-27T09:45:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.913+0000 7f3991ebe700 1 -- 172.21.15.146:0/3394144790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f398c069110 msgr2=0x7f398c14a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.913+0000 7f3991ebe700 1 --2- 172.21.15.146:0/3394144790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f398c069110 0x7f398c14a170 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f397c00c710 tx=0x7f397c007c80).stop 2021-01-27T09:45:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.913+0000 7f3991ebe700 1 -- 172.21.15.146:0/3394144790 shutdown_connections 2021-01-27T09:45:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.913+0000 7f3991ebe700 1 --2- 172.21.15.146:0/3394144790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f398c0bb410 0x7f398c13f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.913+0000 7f3991ebe700 1 --2- 172.21.15.146:0/3394144790 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f398c0b8120 0x7f398c142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.917 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.913+0000 7f3991ebe700 1 --2- 172.21.15.146:0/3394144790 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f396c0561e0 0x7f396c0586a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.917 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.913+0000 7f3991ebe700 1 --2- 172.21.15.146:0/3394144790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f398c069110 0x7f398c14a170 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:11.917 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.913+0000 7f3991ebe700 1 -- 172.21.15.146:0/3394144790 >> 172.21.15.146:0/3394144790 conn(0x7f398c062810 msgr2=0x7f398c14ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:11.917 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.913+0000 7f3991ebe700 1 -- 172.21.15.146:0/3394144790 shutdown_connections 2021-01-27T09:45:11.918 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:11.913+0000 7f3991ebe700 1 -- 172.21.15.146:0/3394144790 wait complete. 2021-01-27T09:45:11.918 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 13 2021-01-27T09:45:12.546 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-27T09:44:29.315988+0000', 'modified': '2021-01-27T09:44:52.595879+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4275, 'mds_1': 4287, 'mds_2': 4241}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4241': {'gid': 4241, 'name': 'e', 'rank': 2, 'incarnation': 12, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.146:6837/745099427', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6836', 'nonce': 745099427}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 745099427}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}, 'gid_4275': {'gid': 4275, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.78:6837/1117292103', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 1117292103}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 1117292103}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}, 'gid_4287': {'gid': 4287, 'name': 'c', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.146:6834/2738812606', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 2738812606}, {'type': 'v1', 'addr': '172.21.15.146:6834', 'nonce': 2738812606}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-27T09:45:12.546 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2021-01-27T09:45:12.547 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.e.asok --format=json status 2021-01-27T09:45:12.726 INFO:teuthology.orchestra.run.smithi146.stdout:{"cluster_fsid":"968a1bec-aac5-444e-b70f-7770587be945","whoami":2,"id":4241,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":21.113151192,"mdsmap_epoch":13,"osdmap_epoch":26,"osdmap_epoch_barrier":26,"uptime":46.820898259000003} 2021-01-27T09:45:12.727 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "968a1bec-aac5-444e-b70f-7770587be945", "fs_name": "cephfs", "id": 4241, "mdsmap_epoch": 13, "osdmap_epoch": 26, "osdmap_epoch_barrier": 26, "rank_uptime": 21.113151192, "state": "up:active", "uptime": 46.820898259, "want_state": "up:active", "whoami": 2 } 2021-01-27T09:45:12.727 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-01-27T09:45:12.847 INFO:teuthology.orchestra.run.smithi078.stdout:{"cluster_fsid":"968a1bec-aac5-444e-b70f-7770587be945","whoami":0,"id":4275,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":43.516368301,"mdsmap_epoch":13,"osdmap_epoch":26,"osdmap_epoch_barrier":26,"uptime":46.975988911999998} 2021-01-27T09:45:12.847 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "968a1bec-aac5-444e-b70f-7770587be945", "fs_name": "cephfs", "id": 4275, "mdsmap_epoch": 13, "osdmap_epoch": 26, "osdmap_epoch_barrier": 26, "rank_uptime": 43.516368301, "state": "up:active", "uptime": 46.975988912, "want_state": "up:active", "whoami": 0 } 2021-01-27T09:45:12.848 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-01-27T09:45:13.038 INFO:teuthology.orchestra.run.smithi146.stdout:{"cluster_fsid":"968a1bec-aac5-444e-b70f-7770587be945","whoami":1,"id":4287,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":22.434791660999998,"mdsmap_epoch":13,"osdmap_epoch":26,"osdmap_epoch_barrier":26,"uptime":47.137936555000003} 2021-01-27T09:45:13.039 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "968a1bec-aac5-444e-b70f-7770587be945", "fs_name": "cephfs", "id": 4287, "mdsmap_epoch": 13, "osdmap_epoch": 26, "osdmap_epoch_barrier": 26, "rank_uptime": 22.434791661, "state": "up:active", "uptime": 47.137936555, "want_state": "up:active", "whoami": 1 } 2021-01-27T09:45:13.039 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2021-01-27T09:45:13.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:45:13.040 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p /home/ubuntu/cephtest/mnt.0 2021-01-27T09:45:13.059 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-27T09:45:13.060 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2021-01-27T09:45:13.138 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2021-01-27T09:45:13.138 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2021-01-27T09:45:13.506 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2021-01-27T09:45:13.506 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2021-01-27T09:45:13.516 INFO:tasks.cephfs.kernel_mount:mount command passed 2021-01-27T09:45:13.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:45:13.517 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2021-01-27T09:45:13.561 INFO:teuthology.run_tasks:Running task mds_thrash... 2021-01-27T09:45:13.648 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-01-27T09:45:13.821 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.817+0000 7efd11b62700 1 Processor -- start 2021-01-27T09:45:13.822 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.817+0000 7efd11b62700 1 -- start start 2021-01-27T09:45:13.823 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.821+0000 7efd11b62700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efd0c0bf050 0x7efd0c0bf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:13.824 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.821+0000 7efd11b62700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0c065e10 con 0x7efd0c14dc70 2021-01-27T09:45:13.824 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.821+0000 7efd11b62700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0c066580 con 0x7efd0c151cc0 2021-01-27T09:45:13.824 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.821+0000 7efd11b62700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0c4b50 con 0x7efd0c0bf050 2021-01-27T09:45:13.824 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.821+0000 7efd0bfff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7efd0c14dc70 0x7efd0c14ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:34808/0 (socket says 172.21.15.146:34808) 2021-01-27T09:45:13.825 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.821+0000 7efd0bfff700 1 -- 172.21.15.146:0/1445413041 learned_addr learned my addr 172.21.15.146:0/1445413041 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:13.825 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.821+0000 7efd10b60700 1 --2- 172.21.15.146:0/1445413041 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efd0c0bf050 0x7efd0c0bf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:13.826 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.821+0000 7efd0b7fe700 1 -- 172.21.15.146:0/1445413041 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632564846 0 0) 0x7efd0c065e10 con 0x7efd0c14dc70 2021-01-27T09:45:13.826 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.821+0000 7efd0b7fe700 1 -- 172.21.15.146:0/1445413041 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcf0003270 con 0x7efd0c14dc70 2021-01-27T09:45:13.826 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.821+0000 7efd0b7fe700 1 -- 172.21.15.146:0/1445413041 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 17948119 0 0) 0x7efd0c066580 con 0x7efd0c151cc0 2021-01-27T09:45:13.826 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.821+0000 7efd0b7fe700 1 -- 172.21.15.146:0/1445413041 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd0c065e10 con 0x7efd0c151cc0 2021-01-27T09:45:13.827 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.821+0000 7efd10b60700 1 -- 172.21.15.146:0/1445413041 >> v1:172.21.15.146:6789/0 conn(0x7efd0c151cc0 legacy=0x7efd0c1585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:13.827 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.821+0000 7efd10b60700 1 -- 172.21.15.146:0/1445413041 >> v1:172.21.15.78:6789/0 conn(0x7efd0c14dc70 legacy=0x7efd0c14ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:13.827 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.821+0000 7efd10b60700 1 -- 172.21.15.146:0/1445413041 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c066040 con 0x7efd0c0bf050 2021-01-27T09:45:13.828 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.825+0000 7efd10b60700 1 --2- 172.21.15.146:0/1445413041 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efd0c0bf050 0x7efd0c0bf430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7efd0000b9f0 tx=0x7efd00006e20).ready entity=mon.2 client_cookie=13bb5f0e15cdf9f0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:13.828 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.825+0000 7efd0b7fe700 1 -- 172.21.15.146:0/1445413041 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd000096c0 con 0x7efd0c0bf050 2021-01-27T09:45:13.829 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.825+0000 7efd0b7fe700 1 -- 172.21.15.146:0/1445413041 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd00009820 con 0x7efd0c0bf050 2021-01-27T09:45:13.830 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.825+0000 7efd0b7fe700 1 -- 172.21.15.146:0/1445413041 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd00009ba0 con 0x7efd0c0bf050 2021-01-27T09:45:13.830 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.825+0000 7efd11b62700 1 -- 172.21.15.146:0/1445413041 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efd0c0bf050 msgr2=0x7efd0c0bf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:13.831 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.825+0000 7efd11b62700 1 --2- 172.21.15.146:0/1445413041 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efd0c0bf050 0x7efd0c0bf430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7efd0000b9f0 tx=0x7efd00006e20).stop 2021-01-27T09:45:13.831 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.825+0000 7efd11b62700 1 -- 172.21.15.146:0/1445413041 shutdown_connections 2021-01-27T09:45:13.831 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.825+0000 7efd11b62700 1 --2- 172.21.15.146:0/1445413041 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efd0c0bf050 0x7efd0c0bf430 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:13.831 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.825+0000 7efd11b62700 1 -- 172.21.15.146:0/1445413041 >> 172.21.15.146:0/1445413041 conn(0x7efd0c064f30 msgr2=0x7efd0c065340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:13.832 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.825+0000 7efd11b62700 1 -- 172.21.15.146:0/1445413041 shutdown_connections 2021-01-27T09:45:13.832 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.825+0000 7efd11b62700 1 -- 172.21.15.146:0/1445413041 wait complete. 2021-01-27T09:45:13.832 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.829+0000 7efd11b62700 1 Processor -- start 2021-01-27T09:45:13.833 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.829+0000 7efd11b62700 1 -- start start 2021-01-27T09:45:13.834 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd11b62700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd0c14dc70 0x7efd0c0c2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:13.834 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd11b62700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd0c151cc0 0x7efd0c15dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:13.834 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd11b62700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efd0c0bcdd0 0x7efd0c15e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:13.834 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd11b62700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c15e670 con 0x7efd0c151cc0 2021-01-27T09:45:13.835 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd11b62700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0be6b0 con 0x7efd0c14dc70 2021-01-27T09:45:13.835 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd11b62700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0b3850 con 0x7efd0c0bcdd0 2021-01-27T09:45:13.836 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd10b60700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd0c14dc70 0x7efd0c0c2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:13.837 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd0bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd0c151cc0 0x7efd0c15dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:13.837 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd10b60700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd0c14dc70 0x7efd0c0c2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47208/0 (socket says 172.21.15.146:47208) 2021-01-27T09:45:13.837 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd10b60700 1 -- 172.21.15.146:0/607505535 learned_addr learned my addr 172.21.15.146:0/607505535 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:13.837 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd11361700 1 --2- 172.21.15.146:0/607505535 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efd0c0bcdd0 0x7efd0c15e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:13.837 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd10b60700 1 -- 172.21.15.146:0/607505535 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efd0c0bcdd0 msgr2=0x7efd0c15e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:13.838 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd10b60700 1 --2- 172.21.15.146:0/607505535 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efd0c0bcdd0 0x7efd0c15e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:13.838 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd10b60700 1 -- 172.21.15.146:0/607505535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd0c151cc0 msgr2=0x7efd0c15dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:13.838 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd10b60700 1 --2- 172.21.15.146:0/607505535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd0c151cc0 0x7efd0c15dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:13.838 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd10b60700 1 -- 172.21.15.146:0/607505535 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c0b3af0 con 0x7efd0c14dc70 2021-01-27T09:45:13.838 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd0bfff700 1 --2- 172.21.15.146:0/607505535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd0c151cc0 0x7efd0c15dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:45:13.839 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd11361700 1 --2- 172.21.15.146:0/607505535 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efd0c0bcdd0 0x7efd0c15e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:45:13.839 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd10b60700 1 --2- 172.21.15.146:0/607505535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd0c14dc70 0x7efd0c0c2f30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7efd0c067860 tx=0x7efd00016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:13.839 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd08ff9700 1 -- 172.21.15.146:0/607505535 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd00011b70 con 0x7efd0c14dc70 2021-01-27T09:45:13.839 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd08ff9700 1 -- 172.21.15.146:0/607505535 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd00011cd0 con 0x7efd0c14dc70 2021-01-27T09:45:13.839 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd11b62700 1 -- 172.21.15.146:0/607505535 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0c0b3d90 con 0x7efd0c14dc70 2021-01-27T09:45:13.840 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd08ff9700 1 -- 172.21.15.146:0/607505535 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0001d610 con 0x7efd0c14dc70 2021-01-27T09:45:13.840 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.833+0000 7efd11b62700 1 -- 172.21.15.146:0/607505535 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0c0be370 con 0x7efd0c14dc70 2021-01-27T09:45:13.841 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.837+0000 7efd11b62700 1 -- 172.21.15.146:0/607505535 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0c044ee0 con 0x7efd0c14dc70 2021-01-27T09:45:13.841 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.837+0000 7efd08ff9700 1 -- 172.21.15.146:0/607505535 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7efd0000f070 con 0x7efd0c14dc70 2021-01-27T09:45:13.841 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.837+0000 7efd08ff9700 1 --2- 172.21.15.146:0/607505535 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7efcec0561e0 0x7efcec0586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:13.841 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.837+0000 7efd08ff9700 1 -- 172.21.15.146:0/607505535 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7efd00070820 con 0x7efd0c14dc70 2021-01-27T09:45:13.842 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.837+0000 7efd0bfff700 1 --2- 172.21.15.146:0/607505535 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7efcec0561e0 0x7efcec0586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:13.842 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.841+0000 7efd0bfff700 1 --2- 172.21.15.146:0/607505535 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7efcec0561e0 0x7efcec0586a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7efd0c0bea90 tx=0x7efcf8009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:13.847 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.845+0000 7efd08ff9700 1 -- 172.21.15.146:0/607505535 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7efd00045e90 con 0x7efd0c14dc70 2021-01-27T09:45:13.992 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.989+0000 7efd11b62700 1 -- 172.21.15.146:0/607505535 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd0c044680 con 0x7efd0c14dc70 2021-01-27T09:45:13.994 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.993+0000 7efd08ff9700 1 -- 172.21.15.146:0/607505535 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18638 (secure 0 0 0) 0x7efd000494b0 con 0x7efd0c14dc70 2021-01-27T09:45:13.995 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:45:13.995 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":26,"fsid":"968a1bec-aac5-444e-b70f-7770587be945","created":"2021-01-27T09:44:13.797940+0000","modified":"2021-01-27T09:44:33.763400+0000","last_up_change":"2021-01-27T09:44:23.479967+0000","last_in_change":"2021-01-27T09:44:23.479967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T09:44:18.497521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-27T09:44:24.550303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-27T09:44:27.607542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-27T09:44:28.331389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-01-27T09:44:31.378452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25441909-a40b-4d82-828d-326685513ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":14470},{"type":"v1","addr":"172.21.15.146:6801","nonce":14470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":14470},{"type":"v1","addr":"172.21.15.146:6803","nonce":14470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":14470},{"type":"v1","addr":"172.21.15.146:6810","nonce":14470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":14470},{"type":"v1","addr":"172.21.15.146:6807","nonce":14470}]},"public_addr":"172.21.15.146:6801/14470","cluster_addr":"172.21.15.146:6803/14470","heartbeat_back_addr":"172.21.15.146:6810/14470","heartbeat_front_addr":"172.21.15.146:6807/14470","state":["exists","up"]},{"osd":1,"uuid":"825bbc51-2ffe-4612-a300-00960e48be02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":14472},{"type":"v1","addr":"172.21.15.146:6817","nonce":14472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":14472},{"type":"v1","addr":"172.21.15.146:6819","nonce":14472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":14472},{"type":"v1","addr":"172.21.15.146:6827","nonce":14472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":14472},{"type":"v1","addr":"172.21.15.146:6823","nonce":14472}]},"public_addr":"172.21.15.146:6817/14472","cluster_addr":"172.21.15.146:6819/14472","heartbeat_back_addr":"172.21.15.146:6827/14472","heartbeat_front_addr":"172.21.15.146:6823/14472","state":["exists","up"]},{"osd":2,"uuid":"e568b97a-8e71-4ab9-bd64-056892110b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":14474},{"type":"v1","addr":"172.21.15.146:6822","nonce":14474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":14474},{"type":"v1","addr":"172.21.15.146:6826","nonce":14474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":14474},{"type":"v1","addr":"172.21.15.146:6831","nonce":14474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":14474},{"type":"v1","addr":"172.21.15.146:6829","nonce":14474}]},"public_addr":"172.21.15.146:6822/14474","cluster_addr":"172.21.15.146:6826/14474","heartbeat_back_addr":"172.21.15.146:6831/14474","heartbeat_front_addr":"172.21.15.146:6829/14474","state":["exists","up"]},{"osd":3,"uuid":"f5d50f63-f74a-4aea-a62d-51c38db4d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":14471},{"type":"v1","addr":"172.21.15.146:6806","nonce":14471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":14471},{"type":"v1","addr":"172.21.15.146:6811","nonce":14471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":14471},{"type":"v1","addr":"172.21.15.146:6815","nonce":14471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":14471},{"type":"v1","addr":"172.21.15.146:6813","nonce":14471}]},"public_addr":"172.21.15.146:6806/14471","cluster_addr":"172.21.15.146:6811/14471","heartbeat_back_addr":"172.21.15.146:6815/14471","heartbeat_front_addr":"172.21.15.146:6813/14471","state":["exists","up"]},{"osd":4,"uuid":"782458d7-6f52-48f4-9466-67b61ef27016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":15826},{"type":"v1","addr":"172.21.15.78:6817","nonce":15826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":15826},{"type":"v1","addr":"172.21.15.78:6819","nonce":15826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":15826},{"type":"v1","addr":"172.21.15.78:6823","nonce":15826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":15826},{"type":"v1","addr":"172.21.15.78:6821","nonce":15826}]},"public_addr":"172.21.15.78:6817/15826","cluster_addr":"172.21.15.78:6819/15826","heartbeat_back_addr":"172.21.15.78:6823/15826","heartbeat_front_addr":"172.21.15.78:6821/15826","state":["exists","up"]},{"osd":5,"uuid":"1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":15827},{"type":"v1","addr":"172.21.15.78:6801","nonce":15827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":15827},{"type":"v1","addr":"172.21.15.78:6803","nonce":15827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":15827},{"type":"v1","addr":"172.21.15.78:6807","nonce":15827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":15827},{"type":"v1","addr":"172.21.15.78:6805","nonce":15827}]},"public_addr":"172.21.15.78:6801/15827","cluster_addr":"172.21.15.78:6803/15827","heartbeat_back_addr":"172.21.15.78:6807/15827","heartbeat_front_addr":"172.21.15.78:6805/15827","state":["exists","up"]},{"osd":6,"uuid":"4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":15825},{"type":"v1","addr":"172.21.15.78:6809","nonce":15825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":15825},{"type":"v1","addr":"172.21.15.78:6811","nonce":15825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":15825},{"type":"v1","addr":"172.21.15.78:6815","nonce":15825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":15825},{"type":"v1","addr":"172.21.15.78:6813","nonce":15825}]},"public_addr":"172.21.15.78:6809/15825","cluster_addr":"172.21.15.78:6811/15825","heartbeat_back_addr":"172.21.15.78:6815/15825","heartbeat_front_addr":"172.21.15.78:6813/15825","state":["exists","up"]},{"osd":7,"uuid":"851aeaf3-bcdc-4ac6-b578-c42e1bf87c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":15828},{"type":"v1","addr":"172.21.15.78:6825","nonce":15828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":15828},{"type":"v1","addr":"172.21.15.78:6827","nonce":15828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":15828},{"type":"v1","addr":"172.21.15.78:6831","nonce":15828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":15828},{"type":"v1","addr":"172.21.15.78:6829","nonce":15828}]},"public_addr":"172.21.15.78:6825/15828","cluster_addr":"172.21.15.78:6827/15828","heartbeat_back_addr":"172.21.15.78:6831/15828","heartbeat_front_addr":"172.21.15.78:6829/15828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.573930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.718144+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.641838+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.551598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.374444+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.171108+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.360910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.356020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:45:13.997 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.993+0000 7efd11b62700 1 -- 172.21.15.146:0/607505535 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7efcec0561e0 msgr2=0x7efcec0586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:13.997 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.993+0000 7efd11b62700 1 --2- 172.21.15.146:0/607505535 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7efcec0561e0 0x7efcec0586a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7efd0c0bea90 tx=0x7efcf8009040).stop 2021-01-27T09:45:13.998 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.993+0000 7efd11b62700 1 -- 172.21.15.146:0/607505535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd0c14dc70 msgr2=0x7efd0c0c2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:13.998 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.993+0000 7efd11b62700 1 --2- 172.21.15.146:0/607505535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd0c14dc70 0x7efd0c0c2f30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7efd0c067860 tx=0x7efd00016000).stop 2021-01-27T09:45:13.998 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.993+0000 7efd11b62700 1 -- 172.21.15.146:0/607505535 shutdown_connections 2021-01-27T09:45:13.998 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.993+0000 7efd11b62700 1 --2- 172.21.15.146:0/607505535 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efd0c0bcdd0 0x7efd0c15e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:13.999 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.993+0000 7efd11b62700 1 --2- 172.21.15.146:0/607505535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd0c151cc0 0x7efd0c15dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:13.999 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.993+0000 7efd11b62700 1 --2- 172.21.15.146:0/607505535 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7efcec0561e0 0x7efcec0586a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:13.999 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.993+0000 7efd11b62700 1 --2- 172.21.15.146:0/607505535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd0c14dc70 0x7efd0c0c2f30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:13.999 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.993+0000 7efd11b62700 1 -- 172.21.15.146:0/607505535 >> 172.21.15.146:0/607505535 conn(0x7efd0c064f30 msgr2=0x7efd0c0c0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:14.000 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.997+0000 7efd11b62700 1 -- 172.21.15.146:0/607505535 shutdown_connections 2021-01-27T09:45:14.000 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:13.997+0000 7efd11b62700 1 -- 172.21.15.146:0/607505535 wait complete. 2021-01-27T09:45:14.022 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-27T09:44:18.497521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-27T09:44:24.550303+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-27T09:44:27.607542+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-01-27T09:44:28.331389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2021-01-27T09:44:31.378452+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-27T09:45:14.023 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-01-27T09:45:14.184 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.181+0000 7f6ddb38f700 1 Processor -- start 2021-01-27T09:45:14.185 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.181+0000 7f6ddb38f700 1 -- start start 2021-01-27T09:45:14.188 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.185+0000 7f6ddb38f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6dd4065640 0x7f6dd40bf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:14.188 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.185+0000 7f6ddb38f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6dd40bbb20 0x7f6dd414af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:14.188 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.185+0000 7f6ddb38f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd40bf5c0 con 0x7f6dd4065260 2021-01-27T09:45:14.189 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.185+0000 7f6ddb38f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd4063830 con 0x7f6dd4065640 2021-01-27T09:45:14.189 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.185+0000 7f6ddb38f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd40bfda0 con 0x7f6dd40bbb20 2021-01-27T09:45:14.190 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.185+0000 7f6dd892a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6dd4065640 0x7f6dd40bf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:14.190 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.185+0000 7f6dd912b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6dd4065260 0x7f6dd4151d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46788/0 (socket says 172.21.15.146:46788) 2021-01-27T09:45:14.190 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.185+0000 7f6dd912b700 1 -- 172.21.15.146:0/3968634826 learned_addr learned my addr 172.21.15.146:0/3968634826 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:14.191 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.185+0000 7f6dd992c700 1 --2- 172.21.15.146:0/3968634826 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6dd40bbb20 0x7f6dd414af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:14.191 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.185+0000 7f6dd992c700 1 -- 172.21.15.146:0/3968634826 >> v2:172.21.15.146:3300/0 conn(0x7f6dd4065640 msgr2=0x7f6dd40bf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:14.191 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.189+0000 7f6dd992c700 1 --2- 172.21.15.146:0/3968634826 >> v2:172.21.15.146:3300/0 conn(0x7f6dd4065640 0x7f6dd40bf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:14.191 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.189+0000 7f6dd992c700 1 -- 172.21.15.146:0/3968634826 >> v1:172.21.15.146:6789/0 conn(0x7f6dd4065260 legacy=0x7f6dd4151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:14.191 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.189+0000 7f6dd992c700 1 -- 172.21.15.146:0/3968634826 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd40bf860 con 0x7f6dd40bbb20 2021-01-27T09:45:14.192 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.189+0000 7f6dd992c700 1 --2- 172.21.15.146:0/3968634826 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6dd40bbb20 0x7f6dd414af70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f6dcc009cc0 tx=0x7f6dcc009220).ready entity=mon.2 client_cookie=a81c00f16c9693f0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:14.193 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.189+0000 7f6dc3fff700 1 -- 172.21.15.146:0/3968634826 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc00b9b0 con 0x7f6dd40bbb20 2021-01-27T09:45:14.193 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.189+0000 7f6dc3fff700 1 -- 172.21.15.146:0/3968634826 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dcc00bb10 con 0x7f6dd40bbb20 2021-01-27T09:45:14.193 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.189+0000 7f6dc3fff700 1 -- 172.21.15.146:0/3968634826 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc00be90 con 0x7f6dd40bbb20 2021-01-27T09:45:14.193 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.189+0000 7f6ddb38f700 1 -- 172.21.15.146:0/3968634826 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6dd40bbb20 msgr2=0x7f6dd414af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:14.194 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.189+0000 7f6ddb38f700 1 --2- 172.21.15.146:0/3968634826 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6dd40bbb20 0x7f6dd414af70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f6dcc009cc0 tx=0x7f6dcc009220).stop 2021-01-27T09:45:14.194 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.189+0000 7f6ddb38f700 1 -- 172.21.15.146:0/3968634826 shutdown_connections 2021-01-27T09:45:14.194 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.189+0000 7f6ddb38f700 1 --2- 172.21.15.146:0/3968634826 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6dd40bbb20 0x7f6dd414af70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:14.194 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.189+0000 7f6ddb38f700 1 --2- 172.21.15.146:0/3968634826 >> v2:172.21.15.146:3300/0 conn(0x7f6dd4065640 0x7f6dd40bf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:14.194 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.189+0000 7f6ddb38f700 1 -- 172.21.15.146:0/3968634826 >> 172.21.15.146:0/3968634826 conn(0x7f6dd4069110 msgr2=0x7f6dd4067e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:14.195 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.189+0000 7f6ddb38f700 1 -- 172.21.15.146:0/3968634826 shutdown_connections 2021-01-27T09:45:14.195 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.189+0000 7f6ddb38f700 1 -- 172.21.15.146:0/3968634826 wait complete. 2021-01-27T09:45:14.195 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.193+0000 7f6ddb38f700 1 Processor -- start 2021-01-27T09:45:14.196 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.193+0000 7f6ddb38f700 1 -- start start 2021-01-27T09:45:14.199 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.197+0000 7f6ddb38f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd4065260 0x7f6dd40b8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:14.199 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.197+0000 7f6ddb38f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd4065640 0x7f6dd40bae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:14.199 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.197+0000 7f6ddb38f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6dd40bbb20 0x7f6dd40bdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:14.200 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.197+0000 7f6ddb38f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd41510c0 con 0x7f6dd4065260 2021-01-27T09:45:14.200 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.197+0000 7f6ddb38f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd40b9f00 con 0x7f6dd4065640 2021-01-27T09:45:14.200 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.197+0000 7f6ddb38f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd415ebf0 con 0x7f6dd40bbb20 2021-01-27T09:45:14.201 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.197+0000 7f6dd912b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd4065260 0x7f6dd40b8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:14.201 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.197+0000 7f6dd892a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd4065640 0x7f6dd40bae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:14.202 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.197+0000 7f6dd912b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd4065260 0x7f6dd40b8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:50098/0 (socket says 172.21.15.146:50098) 2021-01-27T09:45:14.202 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.197+0000 7f6dd992c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6dd40bbb20 0x7f6dd40bdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:14.203 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.197+0000 7f6dd912b700 1 -- 172.21.15.146:0/2758387933 learned_addr learned my addr 172.21.15.146:0/2758387933 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:14.204 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.197+0000 7f6dd912b700 1 -- 172.21.15.146:0/2758387933 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6dd40bbb20 msgr2=0x7f6dd40bdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:14.204 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.197+0000 7f6dd912b700 1 --2- 172.21.15.146:0/2758387933 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6dd40bbb20 0x7f6dd40bdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:14.205 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.197+0000 7f6dd912b700 1 -- 172.21.15.146:0/2758387933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd4065640 msgr2=0x7f6dd40bae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:14.205 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.197+0000 7f6dd912b700 1 --2- 172.21.15.146:0/2758387933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd4065640 0x7f6dd40bae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:14.205 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.197+0000 7f6dd912b700 1 -- 172.21.15.146:0/2758387933 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd40ba130 con 0x7f6dd4065260 2021-01-27T09:45:14.205 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.197+0000 7f6dd912b700 1 --2- 172.21.15.146:0/2758387933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd4065260 0x7f6dd40b8480 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f6dd0001eb0 tx=0x7f6dd0007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:14.206 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.197+0000 7f6dc17fa700 1 -- 172.21.15.146:0/2758387933 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd00072e0 con 0x7f6dd4065260 2021-01-27T09:45:14.206 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.197+0000 7f6dc17fa700 1 -- 172.21.15.146:0/2758387933 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd0007440 con 0x7f6dd4065260 2021-01-27T09:45:14.206 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.197+0000 7f6ddb38f700 1 -- 172.21.15.146:0/2758387933 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd40ba3d0 con 0x7f6dd4065260 2021-01-27T09:45:14.206 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.197+0000 7f6dc17fa700 1 -- 172.21.15.146:0/2758387933 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0005830 con 0x7f6dd4065260 2021-01-27T09:45:14.206 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.197+0000 7f6ddb38f700 1 -- 172.21.15.146:0/2758387933 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd40bd5e0 con 0x7f6dd4065260 2021-01-27T09:45:14.207 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.201+0000 7f6ddb38f700 1 -- 172.21.15.146:0/2758387933 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd40c4160 con 0x7f6dd4065260 2021-01-27T09:45:14.207 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.201+0000 7f6dc17fa700 1 -- 172.21.15.146:0/2758387933 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f6dd0010070 con 0x7f6dd4065260 2021-01-27T09:45:14.208 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.201+0000 7f6dc17fa700 1 --2- 172.21.15.146:0/2758387933 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6db4056210 0x7f6db40586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:14.208 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.201+0000 7f6dc17fa700 1 -- 172.21.15.146:0/2758387933 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f6dd006ecf0 con 0x7f6dd4065260 2021-01-27T09:45:14.208 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.205+0000 7f6dd892a700 1 --2- 172.21.15.146:0/2758387933 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6db4056210 0x7f6db40586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:14.209 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.205+0000 7f6dd892a700 1 --2- 172.21.15.146:0/2758387933 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6db4056210 0x7f6db40586d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f6dd4065a90 tx=0x7f6dc4006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:14.217 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.213+0000 7f6dc17fa700 1 -- 172.21.15.146:0/2758387933 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f6dd40c4160 con 0x7f6dd4065260 2021-01-27T09:45:14.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.361+0000 7f6ddb38f700 1 -- 172.21.15.146:0/2758387933 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6dd40c4160 con 0x7f6dd4065260 2021-01-27T09:45:14.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.361+0000 7f6dc17fa700 1 -- 172.21.15.146:0/2758387933 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6dd40c4160 con 0x7f6dd4065260 2021-01-27T09:45:14.364 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2021-01-27T09:45:14.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.365+0000 7f6ddb38f700 1 -- 172.21.15.146:0/2758387933 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6db4056210 msgr2=0x7f6db40586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:14.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.365+0000 7f6ddb38f700 1 --2- 172.21.15.146:0/2758387933 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6db4056210 0x7f6db40586d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f6dd4065a90 tx=0x7f6dc4006e20).stop 2021-01-27T09:45:14.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.365+0000 7f6ddb38f700 1 -- 172.21.15.146:0/2758387933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd4065260 msgr2=0x7f6dd40b8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:14.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.365+0000 7f6ddb38f700 1 --2- 172.21.15.146:0/2758387933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd4065260 0x7f6dd40b8480 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f6dd0001eb0 tx=0x7f6dd0007c70).stop 2021-01-27T09:45:14.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.365+0000 7f6ddb38f700 1 -- 172.21.15.146:0/2758387933 shutdown_connections 2021-01-27T09:45:14.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.365+0000 7f6ddb38f700 1 --2- 172.21.15.146:0/2758387933 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6dd40bbb20 0x7f6dd40bdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:14.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.365+0000 7f6ddb38f700 1 --2- 172.21.15.146:0/2758387933 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6db4056210 0x7f6db40586d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:14.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.365+0000 7f6ddb38f700 1 --2- 172.21.15.146:0/2758387933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd4065640 0x7f6dd40bae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:14.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.365+0000 7f6ddb38f700 1 --2- 172.21.15.146:0/2758387933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd4065260 0x7f6dd40b8480 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:14.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.365+0000 7f6ddb38f700 1 -- 172.21.15.146:0/2758387933 >> 172.21.15.146:0/2758387933 conn(0x7f6dd4069110 msgr2=0x7f6dd414e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:14.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.365+0000 7f6ddb38f700 1 -- 172.21.15.146:0/2758387933 shutdown_connections 2021-01-27T09:45:14.374 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.365+0000 7f6ddb38f700 1 -- 172.21.15.146:0/2758387933 wait complete. 2021-01-27T09:45:14.393 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-01-27T09:45:14.567 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.565+0000 7ff2a484e700 1 Processor -- start 2021-01-27T09:45:14.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.565+0000 7ff2a484e700 1 -- start start 2021-01-27T09:45:14.570 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.565+0000 7ff2a484e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff2a00bd670 0x7ff2a0067920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:14.571 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.565+0000 7ff2a484e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff2a00bda50 0x7ff2a0155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:14.571 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.565+0000 7ff2a484e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff2a00b8e10 0x7ff2a0069910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:14.571 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.565+0000 7ff2a484e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a00b72f0 con 0x7ff2a00b8e10 2021-01-27T09:45:14.572 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff2a484e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a00b9280 con 0x7ff2a00bda50 2021-01-27T09:45:14.572 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff2a484e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a0064810 con 0x7ff2a00bd670 2021-01-27T09:45:14.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff29f59e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff2a00b8e10 0x7ff2a0069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:14.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff29e59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff2a00bda50 0x7ff2a0155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:14.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff29f59e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff2a00b8e10 0x7ff2a0069910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:50106/0 (socket says 172.21.15.146:50106) 2021-01-27T09:45:14.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff29f59e700 1 -- 172.21.15.146:0/815446041 learned_addr learned my addr 172.21.15.146:0/815446041 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:14.574 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff29ed9d700 1 --2- 172.21.15.146:0/815446041 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff2a00bd670 0x7ff2a0067920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:14.576 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff29f59e700 1 -- 172.21.15.146:0/815446041 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff2a00bd670 msgr2=0x7ff2a0067920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:14.576 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff29f59e700 1 --2- 172.21.15.146:0/815446041 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff2a00bd670 0x7ff2a0067920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:14.576 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff29f59e700 1 -- 172.21.15.146:0/815446041 >> v2:172.21.15.146:3300/0 conn(0x7ff2a00bda50 msgr2=0x7ff2a0155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:14.577 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff29f59e700 1 --2- 172.21.15.146:0/815446041 >> v2:172.21.15.146:3300/0 conn(0x7ff2a00bda50 0x7ff2a0155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:14.577 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff29f59e700 1 -- 172.21.15.146:0/815446041 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a0064ab0 con 0x7ff2a00b8e10 2021-01-27T09:45:14.577 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff29e59c700 1 --2- 172.21.15.146:0/815446041 >> v2:172.21.15.146:3300/0 conn(0x7ff2a00bda50 0x7ff2a0155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:45:14.578 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff29f59e700 1 --2- 172.21.15.146:0/815446041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2a00b8e10 0x7ff2a0069910 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7ff2a0061390 tx=0x7ff2980092d0).ready entity=mon.0 client_cookie=fe3e09983cdba682 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:14.578 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff29dd9b700 1 -- 172.21.15.146:0/815446041 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29800bbf0 con 0x7ff2a00b8e10 2021-01-27T09:45:14.578 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff29dd9b700 1 -- 172.21.15.146:0/815446041 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29800bd50 con 0x7ff2a00b8e10 2021-01-27T09:45:14.579 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff29dd9b700 1 -- 172.21.15.146:0/815446041 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff298011610 con 0x7ff2a00b8e10 2021-01-27T09:45:14.579 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff2a484e700 1 -- 172.21.15.146:0/815446041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2a00b8e10 msgr2=0x7ff2a0069910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:14.579 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff2a484e700 1 --2- 172.21.15.146:0/815446041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2a00b8e10 0x7ff2a0069910 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7ff2a0061390 tx=0x7ff2980092d0).stop 2021-01-27T09:45:14.579 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff2a484e700 1 -- 172.21.15.146:0/815446041 shutdown_connections 2021-01-27T09:45:14.580 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff2a484e700 1 --2- 172.21.15.146:0/815446041 >> v2:172.21.15.146:3300/0 conn(0x7ff2a00bda50 0x7ff2a0155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:14.581 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff2a484e700 1 --2- 172.21.15.146:0/815446041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2a00b8e10 0x7ff2a0069910 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:14.581 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff2a484e700 1 --2- 172.21.15.146:0/815446041 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff2a00bd670 0x7ff2a0067920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:14.581 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff2a484e700 1 -- 172.21.15.146:0/815446041 >> 172.21.15.146:0/815446041 conn(0x7ff2a0064240 msgr2=0x7ff2a0069110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:14.581 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.569+0000 7ff2a484e700 1 -- 172.21.15.146:0/815446041 shutdown_connections 2021-01-27T09:45:14.582 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.573+0000 7ff2a484e700 1 -- 172.21.15.146:0/815446041 wait complete. 2021-01-27T09:45:14.582 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.573+0000 7ff2a484e700 1 Processor -- start 2021-01-27T09:45:14.582 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.573+0000 7ff2a484e700 1 -- start start 2021-01-27T09:45:14.585 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.573+0000 7ff2a484e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff2a00b8e10 0x7ff2a01455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:14.586 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.573+0000 7ff2a484e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2a00bd670 0x7ff2a01655a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:14.586 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.573+0000 7ff2a484e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2a00bda50 0x7ff2a0154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:14.586 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.573+0000 7ff2a484e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a0164c30 con 0x7ff2a00bd670 2021-01-27T09:45:14.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.573+0000 7ff2a484e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a00c13d0 con 0x7ff2a00bda50 2021-01-27T09:45:14.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.573+0000 7ff2a484e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a00c1630 con 0x7ff2a00b8e10 2021-01-27T09:45:14.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.573+0000 7ff29f59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2a00bda50 0x7ff2a0154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:14.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.573+0000 7ff29e59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2a00bd670 0x7ff2a01655a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:14.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.573+0000 7ff29f59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2a00bda50 0x7ff2a0154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47240/0 (socket says 172.21.15.146:47240) 2021-01-27T09:45:14.588 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.573+0000 7ff29f59e700 1 -- 172.21.15.146:0/4265795994 learned_addr learned my addr 172.21.15.146:0/4265795994 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:14.588 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.573+0000 7ff29ed9d700 1 --2- 172.21.15.146:0/4265795994 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff2a00b8e10 0x7ff2a01455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:14.588 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.577+0000 7ff29f59e700 1 -- 172.21.15.146:0/4265795994 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff2a00b8e10 msgr2=0x7ff2a01455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:14.589 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.577+0000 7ff29f59e700 1 --2- 172.21.15.146:0/4265795994 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff2a00b8e10 0x7ff2a01455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:14.589 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.577+0000 7ff29f59e700 1 -- 172.21.15.146:0/4265795994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2a00bd670 msgr2=0x7ff2a01655a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:14.589 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.577+0000 7ff29f59e700 1 --2- 172.21.15.146:0/4265795994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2a00bd670 0x7ff2a01655a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:14.589 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.577+0000 7ff29f59e700 1 -- 172.21.15.146:0/4265795994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a00c18d0 con 0x7ff2a00bda50 2021-01-27T09:45:14.590 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.577+0000 7ff29ed9d700 1 --2- 172.21.15.146:0/4265795994 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff2a00b8e10 0x7ff2a01455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:45:14.590 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.577+0000 7ff29f59e700 1 --2- 172.21.15.146:0/4265795994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2a00bda50 0x7ff2a0154b80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7ff2a00c2290 tx=0x7ff298017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:14.590 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.577+0000 7ff286ffd700 1 -- 172.21.15.146:0/4265795994 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29801b650 con 0x7ff2a00bda50 2021-01-27T09:45:14.590 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.577+0000 7ff286ffd700 1 -- 172.21.15.146:0/4265795994 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29801b7b0 con 0x7ff2a00bda50 2021-01-27T09:45:14.591 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.577+0000 7ff2a484e700 1 -- 172.21.15.146:0/4265795994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a0164e60 con 0x7ff2a00bda50 2021-01-27T09:45:14.591 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.577+0000 7ff286ffd700 1 -- 172.21.15.146:0/4265795994 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29801bb50 con 0x7ff2a00bda50 2021-01-27T09:45:14.591 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.577+0000 7ff2a484e700 1 -- 172.21.15.146:0/4265795994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a00c0ff0 con 0x7ff2a00bda50 2021-01-27T09:45:14.591 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.577+0000 7ff2a484e700 1 -- 172.21.15.146:0/4265795994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a0062a10 con 0x7ff2a00bda50 2021-01-27T09:45:14.592 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.581+0000 7ff286ffd700 1 -- 172.21.15.146:0/4265795994 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7ff29800f070 con 0x7ff2a00bda50 2021-01-27T09:45:14.592 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.581+0000 7ff286ffd700 1 --2- 172.21.15.146:0/4265795994 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff2800561b0 0x7ff280058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:14.592 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.581+0000 7ff286ffd700 1 -- 172.21.15.146:0/4265795994 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7ff298070d60 con 0x7ff2a00bda50 2021-01-27T09:45:14.592 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.581+0000 7ff29ed9d700 1 --2- 172.21.15.146:0/4265795994 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff2800561b0 0x7ff280058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:14.593 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.581+0000 7ff29ed9d700 1 --2- 172.21.15.146:0/4265795994 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff2800561b0 0x7ff280058670 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7ff29000b9d0 tx=0x7ff290008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:14.593 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.585+0000 7ff286ffd700 1 -- 172.21.15.146:0/4265795994 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7ff298046410 con 0x7ff2a00bda50 2021-01-27T09:45:14.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.729+0000 7ff2a484e700 1 -- 172.21.15.146:0/4265795994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff2a005d810 con 0x7ff2a00bda50 2021-01-27T09:45:14.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.733+0000 7ff286ffd700 1 -- 172.21.15.146:0/4265795994 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff298049a30 con 0x7ff2a00bda50 2021-01-27T09:45:14.735 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:45:14.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.733+0000 7ff2a484e700 1 -- 172.21.15.146:0/4265795994 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff2800561b0 msgr2=0x7ff280058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:14.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.733+0000 7ff2a484e700 1 --2- 172.21.15.146:0/4265795994 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff2800561b0 0x7ff280058670 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7ff29000b9d0 tx=0x7ff290008040).stop 2021-01-27T09:45:14.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.733+0000 7ff2a484e700 1 -- 172.21.15.146:0/4265795994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2a00bda50 msgr2=0x7ff2a0154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:14.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.733+0000 7ff2a484e700 1 --2- 172.21.15.146:0/4265795994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2a00bda50 0x7ff2a0154b80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7ff2a00c2290 tx=0x7ff298017000).stop 2021-01-27T09:45:14.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.733+0000 7ff2a484e700 1 -- 172.21.15.146:0/4265795994 shutdown_connections 2021-01-27T09:45:14.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.733+0000 7ff2a484e700 1 --2- 172.21.15.146:0/4265795994 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff2800561b0 0x7ff280058670 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:14.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.733+0000 7ff2a484e700 1 --2- 172.21.15.146:0/4265795994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2a00bda50 0x7ff2a0154b80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:14.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.733+0000 7ff2a484e700 1 --2- 172.21.15.146:0/4265795994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2a00bd670 0x7ff2a01655a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:14.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.733+0000 7ff2a484e700 1 --2- 172.21.15.146:0/4265795994 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff2a00b8e10 0x7ff2a01455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:14.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.733+0000 7ff2a484e700 1 -- 172.21.15.146:0/4265795994 >> 172.21.15.146:0/4265795994 conn(0x7ff2a0064240 msgr2=0x7ff2a014ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:14.740 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.737+0000 7ff2a484e700 1 -- 172.21.15.146:0/4265795994 shutdown_connections 2021-01-27T09:45:14.740 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.737+0000 7ff2a484e700 1 -- 172.21.15.146:0/4265795994 wait complete. 2021-01-27T09:45:14.768 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-01-27T09:45:14.943 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.941+0000 7f0d9e5d8700 1 Processor -- start 2021-01-27T09:45:14.943 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.941+0000 7f0d9e5d8700 1 -- start start 2021-01-27T09:45:14.945 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.941+0000 7f0d9e5d8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0d980bce70 0x7f0d98152800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:14.945 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.941+0000 7f0d9e5d8700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d981523d0 con 0x7f0d980bd250 2021-01-27T09:45:14.945 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.941+0000 7f0d9e5d8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d98155c40 con 0x7f0d980651f0 2021-01-27T09:45:14.945 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.941+0000 7f0d9e5d8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d980bc600 con 0x7f0d980bce70 2021-01-27T09:45:14.946 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.941+0000 7f0d977fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0d980651f0 0x7f0d9813b190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46816/0 (socket says 172.21.15.146:46816) 2021-01-27T09:45:14.946 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.941+0000 7f0d977fe700 1 -- 172.21.15.146:0/3894695699 learned_addr learned my addr 172.21.15.146:0/3894695699 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:14.947 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.941+0000 7f0d97fff700 1 --2- 172.21.15.146:0/3894695699 >> v2:172.21.15.146:3300/0 conn(0x7f0d980bce70 0x7f0d98152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:14.947 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.945+0000 7f0d96ffd700 1 -- 172.21.15.146:0/3894695699 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012477341 0 0) 0x7f0d98155c40 con 0x7f0d980651f0 2021-01-27T09:45:14.947 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.945+0000 7f0d96ffd700 1 -- 172.21.15.146:0/3894695699 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d84003270 con 0x7f0d980651f0 2021-01-27T09:45:14.948 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.945+0000 7f0d97fff700 1 -- 172.21.15.146:0/3894695699 >> v1:172.21.15.146:6789/0 conn(0x7f0d980651f0 legacy=0x7f0d9813b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:14.948 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.945+0000 7f0d96ffd700 1 -- 172.21.15.146:0/3894695699 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885615531 0 0) 0x7f0d981523d0 con 0x7f0d980bd250 2021-01-27T09:45:14.948 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.945+0000 7f0d97fff700 1 -- 172.21.15.146:0/3894695699 >> v1:172.21.15.78:6789/0 conn(0x7f0d980bd250 legacy=0x7f0d9815cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:14.948 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.945+0000 7f0d97fff700 1 -- 172.21.15.146:0/3894695699 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d98155ee0 con 0x7f0d980bce70 2021-01-27T09:45:14.949 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.945+0000 7f0d97fff700 1 --2- 172.21.15.146:0/3894695699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d980bce70 0x7f0d98152800 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f0d8800b9c0 tx=0x7f0d88006e20).ready entity=mon.1 client_cookie=7b0e9428880953ad server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:14.949 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.945+0000 7f0d96ffd700 1 -- 172.21.15.146:0/3894695699 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8800beb0 con 0x7f0d980bce70 2021-01-27T09:45:14.949 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.945+0000 7f0d96ffd700 1 -- 172.21.15.146:0/3894695699 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d880097e0 con 0x7f0d980bce70 2021-01-27T09:45:14.949 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.945+0000 7f0d96ffd700 1 -- 172.21.15.146:0/3894695699 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d88009b60 con 0x7f0d980bce70 2021-01-27T09:45:14.951 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.945+0000 7f0d9e5d8700 1 -- 172.21.15.146:0/3894695699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d980bce70 msgr2=0x7f0d98152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:14.951 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.945+0000 7f0d9e5d8700 1 --2- 172.21.15.146:0/3894695699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d980bce70 0x7f0d98152800 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f0d8800b9c0 tx=0x7f0d88006e20).stop 2021-01-27T09:45:14.951 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.945+0000 7f0d9e5d8700 1 -- 172.21.15.146:0/3894695699 shutdown_connections 2021-01-27T09:45:14.951 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.945+0000 7f0d9e5d8700 1 --2- 172.21.15.146:0/3894695699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d980bce70 0x7f0d98152800 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:14.951 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.945+0000 7f0d9e5d8700 1 -- 172.21.15.146:0/3894695699 >> 172.21.15.146:0/3894695699 conn(0x7f0d98060910 msgr2=0x7f0d98064ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:14.952 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.945+0000 7f0d9e5d8700 1 -- 172.21.15.146:0/3894695699 shutdown_connections 2021-01-27T09:45:14.952 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.945+0000 7f0d9e5d8700 1 -- 172.21.15.146:0/3894695699 wait complete. 2021-01-27T09:45:14.952 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.949+0000 7f0d9e5d8700 1 Processor -- start 2021-01-27T09:45:14.953 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.949+0000 7f0d9e5d8700 1 -- start start 2021-01-27T09:45:14.953 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.949+0000 7f0d9e5d8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d980651f0 0x7f0d980b6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:14.954 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.949+0000 7f0d9e5d8700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d980bce70 0x7f0d980ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:14.954 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.949+0000 7f0d9e5d8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d980bd250 0x7f0d981392b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:14.954 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.949+0000 7f0d9e5d8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d980ad920 con 0x7f0d980bd250 2021-01-27T09:45:14.954 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.949+0000 7f0d9e5d8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d980b10d0 con 0x7f0d980651f0 2021-01-27T09:45:14.955 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.949+0000 7f0d9e5d8700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d980adb80 con 0x7f0d980bce70 2021-01-27T09:45:14.955 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.949+0000 7f0d977fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d980bce70 0x7f0d980ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:14.955 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.949+0000 7f0d9cb75700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d980bd250 0x7f0d981392b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:14.955 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.949+0000 7f0d97fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d980651f0 0x7f0d980b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:14.955 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.949+0000 7f0d9cb75700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d980bd250 0x7f0d981392b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:50128/0 (socket says 172.21.15.146:50128) 2021-01-27T09:45:14.956 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.949+0000 7f0d9cb75700 1 -- 172.21.15.146:0/4210943173 learned_addr learned my addr 172.21.15.146:0/4210943173 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:14.957 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.953+0000 7f0d9cb75700 1 -- 172.21.15.146:0/4210943173 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d980bce70 msgr2=0x7f0d980ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:14.957 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.953+0000 7f0d9cb75700 1 --2- 172.21.15.146:0/4210943173 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d980bce70 0x7f0d980ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:14.957 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.953+0000 7f0d9cb75700 1 -- 172.21.15.146:0/4210943173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d980651f0 msgr2=0x7f0d980b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:14.957 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.953+0000 7f0d9cb75700 1 --2- 172.21.15.146:0/4210943173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d980651f0 0x7f0d980b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:14.958 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.953+0000 7f0d9cb75700 1 -- 172.21.15.146:0/4210943173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d980ade20 con 0x7f0d980bd250 2021-01-27T09:45:14.958 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.953+0000 7f0d9cb75700 1 --2- 172.21.15.146:0/4210943173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d980bd250 0x7f0d981392b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f0d9000cab0 tx=0x7f0d900013c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:14.958 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.953+0000 7f0d7ffff700 1 -- 172.21.15.146:0/4210943173 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9000a590 con 0x7f0d980bd250 2021-01-27T09:45:14.958 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.953+0000 7f0d7ffff700 1 -- 172.21.15.146:0/4210943173 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9000a6f0 con 0x7f0d980bd250 2021-01-27T09:45:14.958 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.953+0000 7f0d9e5d8700 1 -- 172.21.15.146:0/4210943173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d980ae0c0 con 0x7f0d980bd250 2021-01-27T09:45:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.953+0000 7f0d7ffff700 1 -- 172.21.15.146:0/4210943173 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9000aa90 con 0x7f0d980bd250 2021-01-27T09:45:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.953+0000 7f0d9e5d8700 1 -- 172.21.15.146:0/4210943173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d980b0c30 con 0x7f0d980bd250 2021-01-27T09:45:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.953+0000 7f0d9e5d8700 1 -- 172.21.15.146:0/4210943173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d98044ee0 con 0x7f0d980bd250 2021-01-27T09:45:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.953+0000 7f0d7ffff700 1 -- 172.21.15.146:0/4210943173 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f0d90019030 con 0x7f0d980bd250 2021-01-27T09:45:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.957+0000 7f0d7ffff700 1 --2- 172.21.15.146:0/4210943173 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0d780561e0 0x7f0d780586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:14.961 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.957+0000 7f0d7ffff700 1 -- 172.21.15.146:0/4210943173 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f0d9006eca0 con 0x7f0d980bd250 2021-01-27T09:45:14.961 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.957+0000 7f0d97fff700 1 --2- 172.21.15.146:0/4210943173 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0d780561e0 0x7f0d780586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:14.961 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.957+0000 7f0d97fff700 1 --2- 172.21.15.146:0/4210943173 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0d780561e0 0x7f0d780586a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f0d88006bb0 tx=0x7f0d88016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:14.969 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:14.965+0000 7f0d7ffff700 1 -- 172.21.15.146:0/4210943173 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f0d90073070 con 0x7f0d980bd250 2021-01-27T09:45:15.114 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.109+0000 7f0d9e5d8700 1 -- 172.21.15.146:0/4210943173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0d980008d0 con 0x7f0d980bd250 2021-01-27T09:45:15.115 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.113+0000 7f0d7ffff700 1 -- 172.21.15.146:0/4210943173 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+10 (secure 0 0 0) 0x7f0d90044400 con 0x7f0d980bd250 2021-01-27T09:45:15.115 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:45:15.117 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.113+0000 7f0d9e5d8700 1 -- 172.21.15.146:0/4210943173 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0d780561e0 msgr2=0x7f0d780586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:15.117 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.113+0000 7f0d9e5d8700 1 --2- 172.21.15.146:0/4210943173 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0d780561e0 0x7f0d780586a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f0d88006bb0 tx=0x7f0d88016000).stop 2021-01-27T09:45:15.117 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.113+0000 7f0d9e5d8700 1 -- 172.21.15.146:0/4210943173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d980bd250 msgr2=0x7f0d981392b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:15.117 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.113+0000 7f0d9e5d8700 1 --2- 172.21.15.146:0/4210943173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d980bd250 0x7f0d981392b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f0d9000cab0 tx=0x7f0d900013c0).stop 2021-01-27T09:45:15.118 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.113+0000 7f0d9e5d8700 1 -- 172.21.15.146:0/4210943173 shutdown_connections 2021-01-27T09:45:15.118 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.113+0000 7f0d9e5d8700 1 --2- 172.21.15.146:0/4210943173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d980bd250 0x7f0d981392b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:15.118 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.113+0000 7f0d9e5d8700 1 --2- 172.21.15.146:0/4210943173 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d980bce70 0x7f0d980ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:15.118 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.113+0000 7f0d9e5d8700 1 --2- 172.21.15.146:0/4210943173 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0d780561e0 0x7f0d780586a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:15.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.113+0000 7f0d9e5d8700 1 --2- 172.21.15.146:0/4210943173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d980651f0 0x7f0d980b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:15.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.113+0000 7f0d9e5d8700 1 -- 172.21.15.146:0/4210943173 >> 172.21.15.146:0/4210943173 conn(0x7f0d98060910 msgr2=0x7f0d9813a690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:15.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.117+0000 7f0d9e5d8700 1 -- 172.21.15.146:0/4210943173 shutdown_connections 2021-01-27T09:45:15.120 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.117+0000 7f0d9e5d8700 1 -- 172.21.15.146:0/4210943173 wait complete. 2021-01-27T09:45:15.144 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-01-27T09:45:15.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.309+0000 7fbd50c8a700 1 Processor -- start 2021-01-27T09:45:15.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.309+0000 7fbd50c8a700 1 -- start start 2021-01-27T09:45:15.313 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.309+0000 7fbd50c8a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbd4c0bd090 0x7fbd4c14b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:15.313 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.309+0000 7fbd50c8a700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4c063050 con 0x7fbd4c0bccb0 2021-01-27T09:45:15.313 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.309+0000 7fbd50c8a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4c0632f0 con 0x7fbd4c0bd710 2021-01-27T09:45:15.314 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.309+0000 7fbd50c8a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4c0bc7f0 con 0x7fbd4c0bd090 2021-01-27T09:45:15.315 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.313+0000 7fbd4b7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbd4c0bccb0 0x7fbd4c066b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:34864/0 (socket says 172.21.15.146:34864) 2021-01-27T09:45:15.315 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.313+0000 7fbd43fff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbd4c0bd090 0x7fbd4c14b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:15.315 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.313+0000 7fbd4bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbd4c0bd710 0x7fbd4c1477e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46834/0 (socket says 172.21.15.146:46834) 2021-01-27T09:45:15.316 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.313+0000 7fbd4b7fe700 1 -- 172.21.15.146:0/1475818297 learned_addr learned my addr 172.21.15.146:0/1475818297 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:15.316 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.313+0000 7fbd4affd700 1 -- 172.21.15.146:0/1475818297 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816582139 0 0) 0x7fbd4c063050 con 0x7fbd4c0bccb0 2021-01-27T09:45:15.316 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.313+0000 7fbd4affd700 1 -- 172.21.15.146:0/1475818297 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd2c003270 con 0x7fbd4c0bccb0 2021-01-27T09:45:15.316 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.313+0000 7fbd43fff700 1 -- 172.21.15.146:0/1475818297 >> v1:172.21.15.146:6789/0 conn(0x7fbd4c0bd710 legacy=0x7fbd4c1477e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:15.317 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.313+0000 7fbd43fff700 1 -- 172.21.15.146:0/1475818297 >> v1:172.21.15.78:6789/0 conn(0x7fbd4c0bccb0 legacy=0x7fbd4c066b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:15.317 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.313+0000 7fbd43fff700 1 -- 172.21.15.146:0/1475818297 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c063590 con 0x7fbd4c0bd090 2021-01-27T09:45:15.319 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.313+0000 7fbd43fff700 1 --2- 172.21.15.146:0/1475818297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd4c0bd090 0x7fbd4c14b310 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fbd3400b9c0 tx=0x7fbd34006e20).ready entity=mon.0 client_cookie=5f0528409b184ddb server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:15.319 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.313+0000 7fbd4affd700 1 -- 172.21.15.146:0/1475818297 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd340097e0 con 0x7fbd4c0bd090 2021-01-27T09:45:15.319 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.313+0000 7fbd4affd700 1 -- 172.21.15.146:0/1475818297 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd34009940 con 0x7fbd4c0bd090 2021-01-27T09:45:15.319 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.313+0000 7fbd4affd700 1 -- 172.21.15.146:0/1475818297 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd34009cc0 con 0x7fbd4c0bd090 2021-01-27T09:45:15.320 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.313+0000 7fbd50c8a700 1 -- 172.21.15.146:0/1475818297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd4c0bd090 msgr2=0x7fbd4c14b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:15.320 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.313+0000 7fbd50c8a700 1 --2- 172.21.15.146:0/1475818297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd4c0bd090 0x7fbd4c14b310 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fbd3400b9c0 tx=0x7fbd34006e20).stop 2021-01-27T09:45:15.320 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.313+0000 7fbd50c8a700 1 -- 172.21.15.146:0/1475818297 shutdown_connections 2021-01-27T09:45:15.320 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.313+0000 7fbd50c8a700 1 --2- 172.21.15.146:0/1475818297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd4c0bd090 0x7fbd4c14b310 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:15.320 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.313+0000 7fbd50c8a700 1 -- 172.21.15.146:0/1475818297 >> 172.21.15.146:0/1475818297 conn(0x7fbd4c069ba0 msgr2=0x7fbd4c062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:15.321 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.313+0000 7fbd50c8a700 1 -- 172.21.15.146:0/1475818297 shutdown_connections 2021-01-27T09:45:15.321 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.313+0000 7fbd50c8a700 1 -- 172.21.15.146:0/1475818297 wait complete. 2021-01-27T09:45:15.322 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.317+0000 7fbd50c8a700 1 Processor -- start 2021-01-27T09:45:15.323 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.317+0000 7fbd50c8a700 1 -- start start 2021-01-27T09:45:15.323 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.317+0000 7fbd50c8a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbd4c0bccb0 0x7fbd4c146390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:15.323 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.317+0000 7fbd50c8a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd4c0bd090 0x7fbd4c140a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:15.323 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.317+0000 7fbd50c8a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4c0bd710 0x7fbd4c14f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:15.324 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.317+0000 7fbd50c8a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c0bf560 con 0x7fbd4c0bd090 2021-01-27T09:45:15.324 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.317+0000 7fbd50c8a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c161520 con 0x7fbd4c0bd710 2021-01-27T09:45:15.324 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.317+0000 7fbd50c8a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c1617c0 con 0x7fbd4c0bccb0 2021-01-27T09:45:15.324 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.321+0000 7fbd4bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4c0bd710 0x7fbd4c14f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:15.325 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.321+0000 7fbd4b7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbd4c0bccb0 0x7fbd4c146390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:15.325 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.321+0000 7fbd43fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd4c0bd090 0x7fbd4c140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:15.325 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.321+0000 7fbd4bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4c0bd710 0x7fbd4c14f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47268/0 (socket says 172.21.15.146:47268) 2021-01-27T09:45:15.325 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.321+0000 7fbd4b7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbd4c0bccb0 0x7fbd4c146390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36750/0 (socket says 172.21.15.146:36750) 2021-01-27T09:45:15.325 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.321+0000 7fbd4b7fe700 1 -- 172.21.15.146:0/1157910892 learned_addr learned my addr 172.21.15.146:0/1157910892 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:15.326 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.321+0000 7fbd43fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd4c0bd090 0x7fbd4c140a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:50140/0 (socket says 172.21.15.146:50140) 2021-01-27T09:45:15.327 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.321+0000 7fbd4bfff700 1 -- 172.21.15.146:0/1157910892 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbd4c0bccb0 msgr2=0x7fbd4c146390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:15.327 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.321+0000 7fbd4bfff700 1 --2- 172.21.15.146:0/1157910892 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbd4c0bccb0 0x7fbd4c146390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:15.328 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.321+0000 7fbd4bfff700 1 -- 172.21.15.146:0/1157910892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd4c0bd090 msgr2=0x7fbd4c140a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:15.328 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.321+0000 7fbd4bfff700 1 --2- 172.21.15.146:0/1157910892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd4c0bd090 0x7fbd4c140a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:15.328 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.321+0000 7fbd4bfff700 1 -- 172.21.15.146:0/1157910892 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c0b97c0 con 0x7fbd4c0bd710 2021-01-27T09:45:15.329 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.321+0000 7fbd4b7fe700 1 --2- 172.21.15.146:0/1157910892 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbd4c0bccb0 0x7fbd4c146390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:45:15.330 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.321+0000 7fbd4bfff700 1 --2- 172.21.15.146:0/1157910892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4c0bd710 0x7fbd4c14f2c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fbd4400cac0 tx=0x7fbd44007f10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:15.330 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.321+0000 7fbd437fe700 1 -- 172.21.15.146:0/1157910892 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd440058e0 con 0x7fbd4c0bd710 2021-01-27T09:45:15.330 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.321+0000 7fbd437fe700 1 -- 172.21.15.146:0/1157910892 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd44005a40 con 0x7fbd4c0bd710 2021-01-27T09:45:15.331 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.321+0000 7fbd50c8a700 1 -- 172.21.15.146:0/1157910892 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4c0b9a60 con 0x7fbd4c0bd710 2021-01-27T09:45:15.331 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.321+0000 7fbd437fe700 1 -- 172.21.15.146:0/1157910892 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd44005dc0 con 0x7fbd4c0bd710 2021-01-27T09:45:15.331 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.321+0000 7fbd50c8a700 1 -- 172.21.15.146:0/1157910892 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4c140f60 con 0x7fbd4c0bd710 2021-01-27T09:45:15.332 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.325+0000 7fbd50c8a700 1 -- 172.21.15.146:0/1157910892 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4c044680 con 0x7fbd4c0bd710 2021-01-27T09:45:15.332 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.325+0000 7fbd437fe700 1 -- 172.21.15.146:0/1157910892 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fbd44010030 con 0x7fbd4c0bd710 2021-01-27T09:45:15.333 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.325+0000 7fbd437fe700 1 --2- 172.21.15.146:0/1157910892 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbd300561e0 0x7fbd300586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:15.333 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.325+0000 7fbd437fe700 1 -- 172.21.15.146:0/1157910892 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fbd4406f2a0 con 0x7fbd4c0bd710 2021-01-27T09:45:15.333 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.325+0000 7fbd4b7fe700 1 --2- 172.21.15.146:0/1157910892 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbd300561e0 0x7fbd300586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:15.334 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.325+0000 7fbd4b7fe700 1 --2- 172.21.15.146:0/1157910892 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbd300561e0 0x7fbd300586a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fbd4c067210 tx=0x7fbd3c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:15.335 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.333+0000 7fbd437fe700 1 -- 172.21.15.146:0/1157910892 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fbd44044840 con 0x7fbd4c0bd710 2021-01-27T09:45:15.481 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.477+0000 7fbd50c8a700 1 -- 172.21.15.146:0/1157910892 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd4c0638d0 con 0x7fbd4c0bd710 2021-01-27T09:45:15.482 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.481+0000 7fbd437fe700 1 -- 172.21.15.146:0/1157910892 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+10 (secure 0 0 0) 0x7fbd44047e60 con 0x7fbd4c0bd710 2021-01-27T09:45:15.483 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:45:15.487 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.485+0000 7fbd50c8a700 1 -- 172.21.15.146:0/1157910892 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbd300561e0 msgr2=0x7fbd300586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:15.487 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.485+0000 7fbd50c8a700 1 --2- 172.21.15.146:0/1157910892 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbd300561e0 0x7fbd300586a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fbd4c067210 tx=0x7fbd3c009040).stop 2021-01-27T09:45:15.488 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.485+0000 7fbd50c8a700 1 -- 172.21.15.146:0/1157910892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4c0bd710 msgr2=0x7fbd4c14f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:15.488 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.485+0000 7fbd50c8a700 1 --2- 172.21.15.146:0/1157910892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4c0bd710 0x7fbd4c14f2c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fbd4400cac0 tx=0x7fbd44007f10).stop 2021-01-27T09:45:15.488 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.485+0000 7fbd50c8a700 1 -- 172.21.15.146:0/1157910892 shutdown_connections 2021-01-27T09:45:15.489 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.485+0000 7fbd50c8a700 1 --2- 172.21.15.146:0/1157910892 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbd300561e0 0x7fbd300586a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:15.490 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.485+0000 7fbd50c8a700 1 --2- 172.21.15.146:0/1157910892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4c0bd710 0x7fbd4c14f2c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:15.490 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.485+0000 7fbd50c8a700 1 --2- 172.21.15.146:0/1157910892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd4c0bd090 0x7fbd4c140a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:15.490 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.485+0000 7fbd50c8a700 1 --2- 172.21.15.146:0/1157910892 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbd4c0bccb0 0x7fbd4c146390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:15.491 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.485+0000 7fbd50c8a700 1 -- 172.21.15.146:0/1157910892 >> 172.21.15.146:0/1157910892 conn(0x7fbd4c069ba0 msgr2=0x7fbd4c0bdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:15.491 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.485+0000 7fbd50c8a700 1 -- 172.21.15.146:0/1157910892 shutdown_connections 2021-01-27T09:45:15.491 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.485+0000 7fbd50c8a700 1 -- 172.21.15.146:0/1157910892 wait complete. 2021-01-27T09:45:15.515 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2021-01-27T09:45:15.692 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.689+0000 7f84c175b700 1 Processor -- start 2021-01-27T09:45:15.692 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.689+0000 7f84c175b700 1 -- start start 2021-01-27T09:45:15.694 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.693+0000 7f84c175b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f84bc065260 0x7f84bc0bf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:15.695 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.693+0000 7f84c175b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f84bc065640 0x7f84bc151d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:15.695 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.693+0000 7f84c175b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84bc0bf5c0 con 0x7f84bc0bbb20 2021-01-27T09:45:15.695 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.693+0000 7f84c175b700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84bc063830 con 0x7f84bc065260 2021-01-27T09:45:15.695 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.693+0000 7f84c175b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84bc0bfda0 con 0x7f84bc065640 2021-01-27T09:45:15.696 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.693+0000 7f84bb7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f84bc0bbb20 0x7f84bc14af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46846/0 (socket says 172.21.15.146:46846) 2021-01-27T09:45:15.697 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.693+0000 7f84bb7fe700 1 -- 172.21.15.146:0/3346080525 learned_addr learned my addr 172.21.15.146:0/3346080525 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:15.697 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.693+0000 7f84baffd700 1 --2- 172.21.15.146:0/3346080525 >> v2:172.21.15.78:3300/0 conn(0x7f84bc065260 0x7f84bc0bf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:15.697 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.693+0000 7f84b27fc700 1 --2- 172.21.15.146:0/3346080525 >> v2:172.21.15.146:3300/0 conn(0x7f84bc065640 0x7f84bc151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:15.697 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.693+0000 7f84ba7fc700 1 -- 172.21.15.146:0/3346080525 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 97797605 0 0) 0x7f84bc0bf5c0 con 0x7f84bc0bbb20 2021-01-27T09:45:15.698 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.693+0000 7f84ba7fc700 1 -- 172.21.15.146:0/3346080525 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f849c003270 con 0x7f84bc0bbb20 2021-01-27T09:45:15.698 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.693+0000 7f84b27fc700 1 -- 172.21.15.146:0/3346080525 >> v2:172.21.15.78:3300/0 conn(0x7f84bc065260 msgr2=0x7f84bc0bf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:15.698 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.693+0000 7f84b27fc700 1 --2- 172.21.15.146:0/3346080525 >> v2:172.21.15.78:3300/0 conn(0x7f84bc065260 0x7f84bc0bf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:15.699 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.693+0000 7f84b27fc700 1 -- 172.21.15.146:0/3346080525 >> v1:172.21.15.146:6789/0 conn(0x7f84bc0bbb20 legacy=0x7f84bc14af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:15.699 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.693+0000 7f84b27fc700 1 -- 172.21.15.146:0/3346080525 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc0bf860 con 0x7f84bc065640 2021-01-27T09:45:15.699 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.693+0000 7f84b27fc700 1 --2- 172.21.15.146:0/3346080525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84bc065640 0x7f84bc151d50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f84bc062160 tx=0x7f84a4006e20).ready entity=mon.1 client_cookie=8eeeaf4174af8b97 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:15.700 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.693+0000 7f84ba7fc700 1 -- 172.21.15.146:0/3346080525 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a40095c0 con 0x7f84bc065640 2021-01-27T09:45:15.700 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.693+0000 7f84ba7fc700 1 -- 172.21.15.146:0/3346080525 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a4009720 con 0x7f84bc065640 2021-01-27T09:45:15.701 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.693+0000 7f84ba7fc700 1 -- 172.21.15.146:0/3346080525 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4009aa0 con 0x7f84bc065640 2021-01-27T09:45:15.701 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.697+0000 7f84c175b700 1 -- 172.21.15.146:0/3346080525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84bc065640 msgr2=0x7f84bc151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:15.701 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.697+0000 7f84c175b700 1 --2- 172.21.15.146:0/3346080525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84bc065640 0x7f84bc151d50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f84bc062160 tx=0x7f84a4006e20).stop 2021-01-27T09:45:15.701 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.697+0000 7f84c175b700 1 -- 172.21.15.146:0/3346080525 shutdown_connections 2021-01-27T09:45:15.702 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.697+0000 7f84c175b700 1 --2- 172.21.15.146:0/3346080525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84bc065640 0x7f84bc151d50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:15.702 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.697+0000 7f84c175b700 1 --2- 172.21.15.146:0/3346080525 >> v2:172.21.15.78:3300/0 conn(0x7f84bc065260 0x7f84bc0bf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:15.702 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.697+0000 7f84c175b700 1 -- 172.21.15.146:0/3346080525 >> 172.21.15.146:0/3346080525 conn(0x7f84bc069110 msgr2=0x7f84bc067e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:15.702 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.697+0000 7f84c175b700 1 -- 172.21.15.146:0/3346080525 shutdown_connections 2021-01-27T09:45:15.703 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.697+0000 7f84c175b700 1 -- 172.21.15.146:0/3346080525 wait complete. 2021-01-27T09:45:15.704 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.697+0000 7f84c175b700 1 Processor -- start 2021-01-27T09:45:15.704 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.697+0000 7f84c175b700 1 -- start start 2021-01-27T09:45:15.704 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.701+0000 7f84c175b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84bc065260 0x7f84bc145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:15.705 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.701+0000 7f84c175b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84bc065640 0x7f84bc14a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:15.705 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.701+0000 7f84c175b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84bc0bbb20 0x7f84bc15d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:15.705 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.701+0000 7f84c175b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc160ac0 con 0x7f84bc065260 2021-01-27T09:45:15.705 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.701+0000 7f84c175b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc160cf0 con 0x7f84bc065640 2021-01-27T09:45:15.706 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.701+0000 7f84c175b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc160f90 con 0x7f84bc0bbb20 2021-01-27T09:45:15.706 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.701+0000 7f84b27fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84bc065640 0x7f84bc14a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:15.706 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.701+0000 7f84bb7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84bc0bbb20 0x7f84bc15d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:15.706 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.701+0000 7f84baffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84bc065260 0x7f84bc145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:15.707 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.701+0000 7f84bb7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84bc0bbb20 0x7f84bc15d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36768/0 (socket says 172.21.15.146:36768) 2021-01-27T09:45:15.707 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.701+0000 7f84b27fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84bc065640 0x7f84bc14a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47280/0 (socket says 172.21.15.146:47280) 2021-01-27T09:45:15.707 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.701+0000 7f84bb7fe700 1 -- 172.21.15.146:0/3970849966 learned_addr learned my addr 172.21.15.146:0/3970849966 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:15.708 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.701+0000 7f84b27fc700 1 -- 172.21.15.146:0/3970849966 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84bc0bbb20 msgr2=0x7f84bc15d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:15.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.701+0000 7f84b27fc700 1 --2- 172.21.15.146:0/3970849966 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84bc0bbb20 0x7f84bc15d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:15.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.701+0000 7f84b27fc700 1 -- 172.21.15.146:0/3970849966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84bc065260 msgr2=0x7f84bc145610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:15.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.701+0000 7f84b27fc700 1 --2- 172.21.15.146:0/3970849966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84bc065260 0x7f84bc145610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:15.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.701+0000 7f84b27fc700 1 -- 172.21.15.146:0/3970849966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc161230 con 0x7f84bc065640 2021-01-27T09:45:15.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.701+0000 7f84b27fc700 1 --2- 172.21.15.146:0/3970849966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84bc065640 0x7f84bc14a5e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f84a4013000 tx=0x7f84a4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:15.710 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.701+0000 7f84b37fe700 1 -- 172.21.15.146:0/3970849966 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4011a70 con 0x7f84bc065640 2021-01-27T09:45:15.710 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.701+0000 7f84b37fe700 1 -- 172.21.15.146:0/3970849966 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a4011bd0 con 0x7f84bc065640 2021-01-27T09:45:15.710 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.701+0000 7f84c175b700 1 -- 172.21.15.146:0/3970849966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84bc1614d0 con 0x7f84bc065640 2021-01-27T09:45:15.710 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.701+0000 7f84b37fe700 1 -- 172.21.15.146:0/3970849966 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a401c420 con 0x7f84bc065640 2021-01-27T09:45:15.711 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.701+0000 7f84c175b700 1 -- 172.21.15.146:0/3970849966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84bc0c3a10 con 0x7f84bc065640 2021-01-27T09:45:15.711 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.705+0000 7f84c175b700 1 -- 172.21.15.146:0/3970849966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84bc044ee0 con 0x7f84bc065640 2021-01-27T09:45:15.711 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.705+0000 7f84b37fe700 1 -- 172.21.15.146:0/3970849966 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f84a400f070 con 0x7f84bc065640 2021-01-27T09:45:15.712 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.705+0000 7f84b37fe700 1 --2- 172.21.15.146:0/3970849966 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f84a00561e0 0x7f84a00586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:15.712 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.705+0000 7f84b37fe700 1 -- 172.21.15.146:0/3970849966 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f84a40709b0 con 0x7f84bc065640 2021-01-27T09:45:15.712 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.709+0000 7f84baffd700 1 --2- 172.21.15.146:0/3970849966 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f84a00561e0 0x7f84a00586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:15.712 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.709+0000 7f84baffd700 1 --2- 172.21.15.146:0/3970849966 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f84a00561e0 0x7f84a00586a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f84ac009d90 tx=0x7f84ac009220).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.713+0000 7f84b37fe700 1 -- 172.21.15.146:0/3970849966 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f84a4045f50 con 0x7f84bc065640 2021-01-27T09:45:15.860 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.857+0000 7f84c175b700 1 -- 172.21.15.146:0/3970849966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f84bc14f530 con 0x7f84bc065640 2021-01-27T09:45:15.861 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.857+0000 7f84b37fe700 1 -- 172.21.15.146:0/3970849966 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+10 (secure 0 0 0) 0x7f84a4049570 con 0x7f84bc065640 2021-01-27T09:45:15.861 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:45:15.864 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.861+0000 7f84c175b700 1 -- 172.21.15.146:0/3970849966 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f84a00561e0 msgr2=0x7f84a00586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:15.864 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.861+0000 7f84c175b700 1 --2- 172.21.15.146:0/3970849966 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f84a00561e0 0x7f84a00586a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f84ac009d90 tx=0x7f84ac009220).stop 2021-01-27T09:45:15.864 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.861+0000 7f84c175b700 1 -- 172.21.15.146:0/3970849966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84bc065640 msgr2=0x7f84bc14a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:15.864 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.861+0000 7f84c175b700 1 --2- 172.21.15.146:0/3970849966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84bc065640 0x7f84bc14a5e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f84a4013000 tx=0x7f84a4016000).stop 2021-01-27T09:45:15.865 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.861+0000 7f84c175b700 1 -- 172.21.15.146:0/3970849966 shutdown_connections 2021-01-27T09:45:15.865 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.861+0000 7f84c175b700 1 --2- 172.21.15.146:0/3970849966 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84bc0bbb20 0x7f84bc15d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:15.865 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.861+0000 7f84c175b700 1 --2- 172.21.15.146:0/3970849966 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f84a00561e0 0x7f84a00586a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:15.865 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.861+0000 7f84c175b700 1 --2- 172.21.15.146:0/3970849966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84bc065640 0x7f84bc14a5e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:15.866 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.861+0000 7f84c175b700 1 --2- 172.21.15.146:0/3970849966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84bc065260 0x7f84bc145610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:15.866 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.861+0000 7f84c175b700 1 -- 172.21.15.146:0/3970849966 >> 172.21.15.146:0/3970849966 conn(0x7f84bc069110 msgr2=0x7f84bc0627f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:15.866 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.861+0000 7f84c175b700 1 -- 172.21.15.146:0/3970849966 shutdown_connections 2021-01-27T09:45:15.866 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:15.861+0000 7f84c175b700 1 -- 172.21.15.146:0/3970849966 wait complete. 2021-01-27T09:45:15.892 INFO:tasks.mds_thrash:mds thrasher using random seed: 1611740715 2021-01-27T09:45:15.892 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-01-27T09:45:16.051 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.049+0000 7f0fea215700 1 Processor -- start 2021-01-27T09:45:16.052 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.049+0000 7f0fea215700 1 -- start start 2021-01-27T09:45:16.053 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.049+0000 7f0fea215700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0fe40bdd30 0x7f0fe4065fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:16.053 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.049+0000 7f0fea215700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fe4067830 0x7f0fe40b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:16.053 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.049+0000 7f0fea215700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fe40b1810 con 0x7f0fe40be110 2021-01-27T09:45:16.054 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.049+0000 7f0fea215700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe4065a90 con 0x7f0fe40bdd30 2021-01-27T09:45:16.054 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.049+0000 7f0fea215700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe40b3f10 con 0x7f0fe4067830 2021-01-27T09:45:16.055 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.053+0000 7f0fdaffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fe4067830 0x7f0fe40b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:16.055 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.053+0000 7f0fdaffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fe4067830 0x7f0fe40b1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36772/0 (socket says 172.21.15.146:36772) 2021-01-27T09:45:16.056 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.053+0000 7f0fdaffd700 1 -- 172.21.15.146:0/2697317925 learned_addr learned my addr 172.21.15.146:0/2697317925 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:16.056 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.053+0000 7f0fe37fe700 1 --2- 172.21.15.146:0/2697317925 >> v2:172.21.15.146:3300/0 conn(0x7f0fe40bdd30 0x7f0fe4065fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:16.056 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.053+0000 7f0fe37fe700 1 -- 172.21.15.146:0/2697317925 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fe4067830 msgr2=0x7f0fe40b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:16.056 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.053+0000 7f0fe37fe700 1 --2- 172.21.15.146:0/2697317925 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fe4067830 0x7f0fe40b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.056 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.053+0000 7f0fe37fe700 1 -- 172.21.15.146:0/2697317925 >> v1:172.21.15.146:6789/0 conn(0x7f0fe40be110 legacy=0x7f0fe414de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:16.057 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.053+0000 7f0fe2ffd700 1 -- 172.21.15.146:0/2697317925 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2355285275 0 0) 0x7f0fe40b1810 con 0x7f0fe40be110 2021-01-27T09:45:16.057 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.053+0000 7f0fe37fe700 1 -- 172.21.15.146:0/2697317925 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe40b41b0 con 0x7f0fe40bdd30 2021-01-27T09:45:16.057 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.053+0000 7f0fdaffd700 1 --2- 172.21.15.146:0/2697317925 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fe4067830 0x7f0fe40b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:45:16.060 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.053+0000 7f0fe37fe700 1 --2- 172.21.15.146:0/2697317925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fe40bdd30 0x7f0fe4065fa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f0fd400b9c0 tx=0x7f0fd4006e20).ready entity=mon.1 client_cookie=52b78a4454d060bf server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:16.061 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.053+0000 7f0fe2ffd700 1 -- 172.21.15.146:0/2697317925 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd40097e0 con 0x7f0fe40bdd30 2021-01-27T09:45:16.061 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.053+0000 7f0fe2ffd700 1 -- 172.21.15.146:0/2697317925 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd4009940 con 0x7f0fe40bdd30 2021-01-27T09:45:16.061 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.053+0000 7f0fe2ffd700 1 -- 172.21.15.146:0/2697317925 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4009cc0 con 0x7f0fe40bdd30 2021-01-27T09:45:16.061 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.053+0000 7f0fea215700 1 -- 172.21.15.146:0/2697317925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fe40bdd30 msgr2=0x7f0fe4065fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:16.062 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.053+0000 7f0fea215700 1 --2- 172.21.15.146:0/2697317925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fe40bdd30 0x7f0fe4065fa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f0fd400b9c0 tx=0x7f0fd4006e20).stop 2021-01-27T09:45:16.062 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.053+0000 7f0fea215700 1 -- 172.21.15.146:0/2697317925 shutdown_connections 2021-01-27T09:45:16.062 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.053+0000 7f0fea215700 1 --2- 172.21.15.146:0/2697317925 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fe4067830 0x7f0fe40b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.062 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.053+0000 7f0fea215700 1 --2- 172.21.15.146:0/2697317925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fe40bdd30 0x7f0fe4065fa0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.062 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.053+0000 7f0fea215700 1 -- 172.21.15.146:0/2697317925 >> 172.21.15.146:0/2697317925 conn(0x7f0fe4069110 msgr2=0x7f0fe4060860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:16.063 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.053+0000 7f0fea215700 1 -- 172.21.15.146:0/2697317925 shutdown_connections 2021-01-27T09:45:16.063 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.057+0000 7f0fea215700 1 -- 172.21.15.146:0/2697317925 wait complete. 2021-01-27T09:45:16.063 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.057+0000 7f0fea215700 1 Processor -- start 2021-01-27T09:45:16.065 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.057+0000 7f0fea215700 1 -- start start 2021-01-27T09:45:16.065 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.061+0000 7f0fea215700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fe4067830 0x7f0fe414cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:16.066 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.061+0000 7f0fea215700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fe40bdd30 0x7f0fe40bc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:16.066 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.061+0000 7f0fea215700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fe40be110 0x7f0fe415d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:16.066 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.061+0000 7f0fea215700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe4144cf0 con 0x7f0fe4067830 2021-01-27T09:45:16.066 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.061+0000 7f0fea215700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe4160b90 con 0x7f0fe40be110 2021-01-27T09:45:16.066 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.061+0000 7f0fea215700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe4160e30 con 0x7f0fe40bdd30 2021-01-27T09:45:16.067 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.061+0000 7f0fe3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fe40be110 0x7f0fe415d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:16.067 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.061+0000 7f0fe37fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fe4067830 0x7f0fe414cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:16.067 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.061+0000 7f0fdaffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fe40bdd30 0x7f0fe40bc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:16.067 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.061+0000 7f0fe37fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fe4067830 0x7f0fe414cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:50166/0 (socket says 172.21.15.146:50166) 2021-01-27T09:45:16.068 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.061+0000 7f0fdaffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fe40bdd30 0x7f0fe40bc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36780/0 (socket says 172.21.15.146:36780) 2021-01-27T09:45:16.068 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.061+0000 7f0fe37fe700 1 -- 172.21.15.146:0/581652018 learned_addr learned my addr 172.21.15.146:0/581652018 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:16.068 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.061+0000 7f0fe3fff700 1 -- 172.21.15.146:0/581652018 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fe40bdd30 msgr2=0x7f0fe40bc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:16.068 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.061+0000 7f0fe3fff700 1 --2- 172.21.15.146:0/581652018 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fe40bdd30 0x7f0fe40bc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.069 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.061+0000 7f0fe3fff700 1 -- 172.21.15.146:0/581652018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fe4067830 msgr2=0x7f0fe414cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:16.069 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.061+0000 7f0fe3fff700 1 --2- 172.21.15.146:0/581652018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fe4067830 0x7f0fe414cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.069 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.061+0000 7f0fe3fff700 1 -- 172.21.15.146:0/581652018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe41610d0 con 0x7f0fe40be110 2021-01-27T09:45:16.069 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.061+0000 7f0fe37fe700 1 --2- 172.21.15.146:0/581652018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fe4067830 0x7f0fe414cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:45:16.070 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.061+0000 7f0fe3fff700 1 --2- 172.21.15.146:0/581652018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fe40be110 0x7f0fe415d840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f0fdc00c880 tx=0x7f0fdc007f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:16.070 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.061+0000 7f0fdbfff700 1 -- 172.21.15.146:0/581652018 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc010510 con 0x7f0fe40be110 2021-01-27T09:45:16.070 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.061+0000 7f0fdbfff700 1 -- 172.21.15.146:0/581652018 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc010670 con 0x7f0fe40be110 2021-01-27T09:45:16.071 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.061+0000 7f0fea215700 1 -- 172.21.15.146:0/581652018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe4161370 con 0x7f0fe40be110 2021-01-27T09:45:16.071 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.061+0000 7f0fdbfff700 1 -- 172.21.15.146:0/581652018 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc010a30 con 0x7f0fe40be110 2021-01-27T09:45:16.072 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.065+0000 7f0fea215700 1 -- 172.21.15.146:0/581652018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe415d3a0 con 0x7f0fe40be110 2021-01-27T09:45:16.072 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.065+0000 7f0fea215700 1 -- 172.21.15.146:0/581652018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe4044ee0 con 0x7f0fe40be110 2021-01-27T09:45:16.073 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.065+0000 7f0fdbfff700 1 -- 172.21.15.146:0/581652018 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f0fdc003020 con 0x7f0fe40be110 2021-01-27T09:45:16.073 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.069+0000 7f0fdbfff700 1 --2- 172.21.15.146:0/581652018 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0fc80561e0 0x7f0fc80586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:16.073 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.069+0000 7f0fdbfff700 1 -- 172.21.15.146:0/581652018 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f0fdc06f120 con 0x7f0fe40be110 2021-01-27T09:45:16.073 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.069+0000 7f0fe37fe700 1 --2- 172.21.15.146:0/581652018 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0fc80561e0 0x7f0fc80586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:16.074 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.069+0000 7f0fe37fe700 1 --2- 172.21.15.146:0/581652018 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0fc80561e0 0x7f0fc80586a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f0fd4006e60 tx=0x7f0fd4016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:16.076 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.073+0000 7f0fdbfff700 1 -- 172.21.15.146:0/581652018 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f0fdc044770 con 0x7f0fe40be110 2021-01-27T09:45:16.220 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.217+0000 7f0fea215700 1 -- 172.21.15.146:0/581652018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fe414d940 con 0x7f0fe40be110 2021-01-27T09:45:16.222 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.221+0000 7f0fdbfff700 1 -- 172.21.15.146:0/581652018 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18638 (secure 0 0 0) 0x7f0fdc047d90 con 0x7f0fe40be110 2021-01-27T09:45:16.223 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:45:16.223 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":26,"fsid":"968a1bec-aac5-444e-b70f-7770587be945","created":"2021-01-27T09:44:13.797940+0000","modified":"2021-01-27T09:44:33.763400+0000","last_up_change":"2021-01-27T09:44:23.479967+0000","last_in_change":"2021-01-27T09:44:23.479967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T09:44:18.497521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-27T09:44:24.550303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-27T09:44:27.607542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-27T09:44:28.331389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-01-27T09:44:31.378452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25441909-a40b-4d82-828d-326685513ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":14470},{"type":"v1","addr":"172.21.15.146:6801","nonce":14470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":14470},{"type":"v1","addr":"172.21.15.146:6803","nonce":14470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":14470},{"type":"v1","addr":"172.21.15.146:6810","nonce":14470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":14470},{"type":"v1","addr":"172.21.15.146:6807","nonce":14470}]},"public_addr":"172.21.15.146:6801/14470","cluster_addr":"172.21.15.146:6803/14470","heartbeat_back_addr":"172.21.15.146:6810/14470","heartbeat_front_addr":"172.21.15.146:6807/14470","state":["exists","up"]},{"osd":1,"uuid":"825bbc51-2ffe-4612-a300-00960e48be02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":14472},{"type":"v1","addr":"172.21.15.146:6817","nonce":14472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":14472},{"type":"v1","addr":"172.21.15.146:6819","nonce":14472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":14472},{"type":"v1","addr":"172.21.15.146:6827","nonce":14472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":14472},{"type":"v1","addr":"172.21.15.146:6823","nonce":14472}]},"public_addr":"172.21.15.146:6817/14472","cluster_addr":"172.21.15.146:6819/14472","heartbeat_back_addr":"172.21.15.146:6827/14472","heartbeat_front_addr":"172.21.15.146:6823/14472","state":["exists","up"]},{"osd":2,"uuid":"e568b97a-8e71-4ab9-bd64-056892110b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":14474},{"type":"v1","addr":"172.21.15.146:6822","nonce":14474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":14474},{"type":"v1","addr":"172.21.15.146:6826","nonce":14474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":14474},{"type":"v1","addr":"172.21.15.146:6831","nonce":14474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":14474},{"type":"v1","addr":"172.21.15.146:6829","nonce":14474}]},"public_addr":"172.21.15.146:6822/14474","cluster_addr":"172.21.15.146:6826/14474","heartbeat_back_addr":"172.21.15.146:6831/14474","heartbeat_front_addr":"172.21.15.146:6829/14474","state":["exists","up"]},{"osd":3,"uuid":"f5d50f63-f74a-4aea-a62d-51c38db4d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":14471},{"type":"v1","addr":"172.21.15.146:6806","nonce":14471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":14471},{"type":"v1","addr":"172.21.15.146:6811","nonce":14471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":14471},{"type":"v1","addr":"172.21.15.146:6815","nonce":14471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":14471},{"type":"v1","addr":"172.21.15.146:6813","nonce":14471}]},"public_addr":"172.21.15.146:6806/14471","cluster_addr":"172.21.15.146:6811/14471","heartbeat_back_addr":"172.21.15.146:6815/14471","heartbeat_front_addr":"172.21.15.146:6813/14471","state":["exists","up"]},{"osd":4,"uuid":"782458d7-6f52-48f4-9466-67b61ef27016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":15826},{"type":"v1","addr":"172.21.15.78:6817","nonce":15826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":15826},{"type":"v1","addr":"172.21.15.78:6819","nonce":15826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":15826},{"type":"v1","addr":"172.21.15.78:6823","nonce":15826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":15826},{"type":"v1","addr":"172.21.15.78:6821","nonce":15826}]},"public_addr":"172.21.15.78:6817/15826","cluster_addr":"172.21.15.78:6819/15826","heartbeat_back_addr":"172.21.15.78:6823/15826","heartbeat_front_addr":"172.21.15.78:6821/15826","state":["exists","up"]},{"osd":5,"uuid":"1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":15827},{"type":"v1","addr":"172.21.15.78:6801","nonce":15827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":15827},{"type":"v1","addr":"172.21.15.78:6803","nonce":15827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":15827},{"type":"v1","addr":"172.21.15.78:6807","nonce":15827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":15827},{"type":"v1","addr":"172.21.15.78:6805","nonce":15827}]},"public_addr":"172.21.15.78:6801/15827","cluster_addr":"172.21.15.78:6803/15827","heartbeat_back_addr":"172.21.15.78:6807/15827","heartbeat_front_addr":"172.21.15.78:6805/15827","state":["exists","up"]},{"osd":6,"uuid":"4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":15825},{"type":"v1","addr":"172.21.15.78:6809","nonce":15825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":15825},{"type":"v1","addr":"172.21.15.78:6811","nonce":15825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":15825},{"type":"v1","addr":"172.21.15.78:6815","nonce":15825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":15825},{"type":"v1","addr":"172.21.15.78:6813","nonce":15825}]},"public_addr":"172.21.15.78:6809/15825","cluster_addr":"172.21.15.78:6811/15825","heartbeat_back_addr":"172.21.15.78:6815/15825","heartbeat_front_addr":"172.21.15.78:6813/15825","state":["exists","up"]},{"osd":7,"uuid":"851aeaf3-bcdc-4ac6-b578-c42e1bf87c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":15828},{"type":"v1","addr":"172.21.15.78:6825","nonce":15828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":15828},{"type":"v1","addr":"172.21.15.78:6827","nonce":15828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":15828},{"type":"v1","addr":"172.21.15.78:6831","nonce":15828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":15828},{"type":"v1","addr":"172.21.15.78:6829","nonce":15828}]},"public_addr":"172.21.15.78:6825/15828","cluster_addr":"172.21.15.78:6827/15828","heartbeat_back_addr":"172.21.15.78:6831/15828","heartbeat_front_addr":"172.21.15.78:6829/15828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.573930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.718144+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.641838+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.551598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.374444+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.171108+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.360910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.356020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:45:16.224 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.221+0000 7f0fea215700 1 -- 172.21.15.146:0/581652018 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0fc80561e0 msgr2=0x7f0fc80586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:16.224 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.221+0000 7f0fea215700 1 --2- 172.21.15.146:0/581652018 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0fc80561e0 0x7f0fc80586a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f0fd4006e60 tx=0x7f0fd4016000).stop 2021-01-27T09:45:16.224 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.221+0000 7f0fea215700 1 -- 172.21.15.146:0/581652018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fe40be110 msgr2=0x7f0fe415d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:16.225 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.221+0000 7f0fea215700 1 --2- 172.21.15.146:0/581652018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fe40be110 0x7f0fe415d840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f0fdc00c880 tx=0x7f0fdc007f00).stop 2021-01-27T09:45:16.225 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.221+0000 7f0fea215700 1 -- 172.21.15.146:0/581652018 shutdown_connections 2021-01-27T09:45:16.226 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.221+0000 7f0fea215700 1 --2- 172.21.15.146:0/581652018 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0fc80561e0 0x7f0fc80586a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.226 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.221+0000 7f0fea215700 1 --2- 172.21.15.146:0/581652018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fe40be110 0x7f0fe415d840 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.226 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.221+0000 7f0fea215700 1 --2- 172.21.15.146:0/581652018 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0fe40bdd30 0x7f0fe40bc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.227 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.221+0000 7f0fea215700 1 --2- 172.21.15.146:0/581652018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fe4067830 0x7f0fe414cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.227 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.221+0000 7f0fea215700 1 -- 172.21.15.146:0/581652018 >> 172.21.15.146:0/581652018 conn(0x7f0fe4069110 msgr2=0x7f0fe40b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:16.227 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.221+0000 7f0fea215700 1 -- 172.21.15.146:0/581652018 shutdown_connections 2021-01-27T09:45:16.227 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.221+0000 7f0fea215700 1 -- 172.21.15.146:0/581652018 wait complete. 2021-01-27T09:45:16.253 INFO:tasks.mds_thrash.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-27T09:44:18.497521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-27T09:44:24.550303+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-27T09:44:27.607542+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-01-27T09:44:28.331389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2021-01-27T09:44:31.378452+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-27T09:45:16.254 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-01-27T09:45:16.413 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.409+0000 7fac1271b700 1 Processor -- start 2021-01-27T09:45:16.414 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.413+0000 7fac1271b700 1 -- start start 2021-01-27T09:45:16.416 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.413+0000 7fac1271b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fac0c0672d0 0x7fac0c0c0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:16.417 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.413+0000 7fac1271b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac0c0676b0 0x7fac0c1512e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:16.417 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.413+0000 7fac1271b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0c0c1140 con 0x7fac0c069580 2021-01-27T09:45:16.417 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.413+0000 7fac1271b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0c065110 con 0x7fac0c0672d0 2021-01-27T09:45:16.417 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.413+0000 7fac1271b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0653b0 con 0x7fac0c0676b0 2021-01-27T09:45:16.419 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.413+0000 7fac11719700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fac0c0672d0 0x7fac0c0c0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:16.419 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.413+0000 7fac11f1a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fac0c069580 0x7fac0c14ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46874/0 (socket says 172.21.15.146:46874) 2021-01-27T09:45:16.419 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.413+0000 7fac11f1a700 1 -- 172.21.15.146:0/2549881020 learned_addr learned my addr 172.21.15.146:0/2549881020 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:16.419 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.413+0000 7fac10f18700 1 --2- 172.21.15.146:0/2549881020 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac0c0676b0 0x7fac0c1512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:16.419 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.417+0000 7fabfbfff700 1 -- 172.21.15.146:0/2549881020 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416370425 0 0) 0x7fac0c0c1140 con 0x7fac0c069580 2021-01-27T09:45:16.420 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.417+0000 7fabfbfff700 1 -- 172.21.15.146:0/2549881020 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabf4003270 con 0x7fac0c069580 2021-01-27T09:45:16.420 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.417+0000 7fac11719700 1 -- 172.21.15.146:0/2549881020 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac0c0676b0 msgr2=0x7fac0c1512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:16.420 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.417+0000 7fac11719700 1 --2- 172.21.15.146:0/2549881020 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac0c0676b0 0x7fac0c1512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.420 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.417+0000 7fac11719700 1 -- 172.21.15.146:0/2549881020 >> v1:172.21.15.146:6789/0 conn(0x7fac0c069580 legacy=0x7fac0c14ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:16.421 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.417+0000 7fac11719700 1 -- 172.21.15.146:0/2549881020 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c065650 con 0x7fac0c0672d0 2021-01-27T09:45:16.421 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.417+0000 7fac11719700 1 --2- 172.21.15.146:0/2549881020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac0c0672d0 0x7fac0c0c0c50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fac0800b9c0 tx=0x7fac08006e20).ready entity=mon.1 client_cookie=33121ae006fd1c6f server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:16.421 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.417+0000 7fac10f18700 1 --2- 172.21.15.146:0/2549881020 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac0c0676b0 0x7fac0c1512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:45:16.421 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.417+0000 7fabfbfff700 1 -- 172.21.15.146:0/2549881020 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac08009870 con 0x7fac0c0672d0 2021-01-27T09:45:16.422 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.417+0000 7fabfbfff700 1 -- 172.21.15.146:0/2549881020 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac080099d0 con 0x7fac0c0672d0 2021-01-27T09:45:16.422 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.417+0000 7fabfbfff700 1 -- 172.21.15.146:0/2549881020 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac08009d50 con 0x7fac0c0672d0 2021-01-27T09:45:16.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.417+0000 7fac1271b700 1 -- 172.21.15.146:0/2549881020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac0c0672d0 msgr2=0x7fac0c0c0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:16.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.417+0000 7fac1271b700 1 --2- 172.21.15.146:0/2549881020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac0c0672d0 0x7fac0c0c0c50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fac0800b9c0 tx=0x7fac08006e20).stop 2021-01-27T09:45:16.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.417+0000 7fac1271b700 1 -- 172.21.15.146:0/2549881020 shutdown_connections 2021-01-27T09:45:16.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.417+0000 7fac1271b700 1 --2- 172.21.15.146:0/2549881020 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac0c0676b0 0x7fac0c1512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.417+0000 7fac1271b700 1 --2- 172.21.15.146:0/2549881020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac0c0672d0 0x7fac0c0c0c50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.424 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.417+0000 7fac1271b700 1 -- 172.21.15.146:0/2549881020 >> 172.21.15.146:0/2549881020 conn(0x7fac0c067da0 msgr2=0x7fac0c0681b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:16.424 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.417+0000 7fac1271b700 1 -- 172.21.15.146:0/2549881020 shutdown_connections 2021-01-27T09:45:16.424 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.417+0000 7fac1271b700 1 -- 172.21.15.146:0/2549881020 wait complete. 2021-01-27T09:45:16.425 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.421+0000 7fac1271b700 1 Processor -- start 2021-01-27T09:45:16.425 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.421+0000 7fac1271b700 1 -- start start 2021-01-27T09:45:16.426 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.421+0000 7fac1271b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac0c0672d0 0x7fac0c0b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:16.426 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.421+0000 7fac1271b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac0c0676b0 0x7fac0c0b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:16.426 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.421+0000 7fac1271b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac0c069580 0x7fac0c0b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:16.427 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.421+0000 7fac1271b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0b6cd0 con 0x7fac0c0672d0 2021-01-27T09:45:16.427 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.421+0000 7fac1271b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c15e2e0 con 0x7fac0c069580 2021-01-27T09:45:16.427 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.421+0000 7fac1271b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0b8290 con 0x7fac0c0676b0 2021-01-27T09:45:16.427 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.425+0000 7fac11f1a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac0c069580 0x7fac0c0b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:16.428 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.425+0000 7fac11f1a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac0c069580 0x7fac0c0b67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47310/0 (socket says 172.21.15.146:47310) 2021-01-27T09:45:16.428 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.425+0000 7fac11f1a700 1 -- 172.21.15.146:0/354097119 learned_addr learned my addr 172.21.15.146:0/354097119 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:16.428 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.425+0000 7fac10f18700 1 --2- 172.21.15.146:0/354097119 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac0c0676b0 0x7fac0c0b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:16.428 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.425+0000 7fac11719700 1 --2- 172.21.15.146:0/354097119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac0c0672d0 0x7fac0c0b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:16.429 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.425+0000 7fac11f1a700 1 -- 172.21.15.146:0/354097119 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac0c0676b0 msgr2=0x7fac0c0b62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:16.430 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.425+0000 7fac11f1a700 1 --2- 172.21.15.146:0/354097119 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac0c0676b0 0x7fac0c0b62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.430 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.425+0000 7fac11f1a700 1 -- 172.21.15.146:0/354097119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac0c0672d0 msgr2=0x7fac0c0b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:16.431 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.425+0000 7fac11f1a700 1 --2- 172.21.15.146:0/354097119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac0c0672d0 0x7fac0c0b4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.431 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.425+0000 7fac11f1a700 1 -- 172.21.15.146:0/354097119 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c0b8530 con 0x7fac0c069580 2021-01-27T09:45:16.431 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.425+0000 7fac11f1a700 1 --2- 172.21.15.146:0/354097119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac0c069580 0x7fac0c0b67e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fac04001460 tx=0x7fac04007e50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:16.432 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.425+0000 7fabf97fa700 1 -- 172.21.15.146:0/354097119 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0400ce10 con 0x7fac0c069580 2021-01-27T09:45:16.433 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.425+0000 7fabf97fa700 1 -- 172.21.15.146:0/354097119 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac04005bb0 con 0x7fac0c069580 2021-01-27T09:45:16.433 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.425+0000 7fabf97fa700 1 -- 172.21.15.146:0/354097119 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04007110 con 0x7fac0c069580 2021-01-27T09:45:16.434 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.425+0000 7fac1271b700 1 -- 172.21.15.146:0/354097119 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0c0b87d0 con 0x7fac0c069580 2021-01-27T09:45:16.434 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.425+0000 7fac1271b700 1 -- 172.21.15.146:0/354097119 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0c0bf390 con 0x7fac0c069580 2021-01-27T09:45:16.435 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.425+0000 7fac1271b700 1 -- 172.21.15.146:0/354097119 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac0c0b5c90 con 0x7fac0c069580 2021-01-27T09:45:16.436 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.429+0000 7fabf97fa700 1 -- 172.21.15.146:0/354097119 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fac04010030 con 0x7fac0c069580 2021-01-27T09:45:16.437 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.429+0000 7fabf97fa700 1 --2- 172.21.15.146:0/354097119 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fabec056210 0x7fabec0586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:16.437 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.429+0000 7fabf97fa700 1 -- 172.21.15.146:0/354097119 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fac0406f3e0 con 0x7fac0c069580 2021-01-27T09:45:16.437 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.429+0000 7fac11719700 1 --2- 172.21.15.146:0/354097119 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fabec056210 0x7fabec0586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:16.438 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.429+0000 7fac11719700 1 --2- 172.21.15.146:0/354097119 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fabec056210 0x7fabec0586d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fac08006e60 tx=0x7fac08016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:16.439 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.437+0000 7fabf97fa700 1 -- 172.21.15.146:0/354097119 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fac04044980 con 0x7fac0c069580 2021-01-27T09:45:16.582 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.577+0000 7fac1271b700 1 -- 172.21.15.146:0/354097119 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fac0c0b8960 con 0x7fac0c069580 2021-01-27T09:45:16.582 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.581+0000 7fabf97fa700 1 -- 172.21.15.146:0/354097119 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7fac04047fa0 con 0x7fac0c069580 2021-01-27T09:45:16.583 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2021-01-27T09:45:16.584 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.581+0000 7fac1271b700 1 -- 172.21.15.146:0/354097119 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fabec056210 msgr2=0x7fabec0586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:16.585 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.581+0000 7fac1271b700 1 --2- 172.21.15.146:0/354097119 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fabec056210 0x7fabec0586d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fac08006e60 tx=0x7fac08016000).stop 2021-01-27T09:45:16.585 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.581+0000 7fac1271b700 1 -- 172.21.15.146:0/354097119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac0c069580 msgr2=0x7fac0c0b67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:16.585 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.581+0000 7fac1271b700 1 --2- 172.21.15.146:0/354097119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac0c069580 0x7fac0c0b67e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fac04001460 tx=0x7fac04007e50).stop 2021-01-27T09:45:16.586 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.581+0000 7fac1271b700 1 -- 172.21.15.146:0/354097119 shutdown_connections 2021-01-27T09:45:16.586 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.581+0000 7fac1271b700 1 --2- 172.21.15.146:0/354097119 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fabec056210 0x7fabec0586d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.586 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.581+0000 7fac1271b700 1 --2- 172.21.15.146:0/354097119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac0c069580 0x7fac0c0b67e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.581+0000 7fac1271b700 1 --2- 172.21.15.146:0/354097119 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac0c0676b0 0x7fac0c0b62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.581+0000 7fac1271b700 1 --2- 172.21.15.146:0/354097119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac0c0672d0 0x7fac0c0b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.581+0000 7fac1271b700 1 -- 172.21.15.146:0/354097119 >> 172.21.15.146:0/354097119 conn(0x7fac0c067da0 msgr2=0x7fac0c063110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:16.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.581+0000 7fac1271b700 1 -- 172.21.15.146:0/354097119 shutdown_connections 2021-01-27T09:45:16.588 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.581+0000 7fac1271b700 1 -- 172.21.15.146:0/354097119 wait complete. 2021-01-27T09:45:16.610 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-01-27T09:45:16.775 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.773+0000 7fd83759e700 1 Processor -- start 2021-01-27T09:45:16.775 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.773+0000 7fd83759e700 1 -- start start 2021-01-27T09:45:16.779 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.773+0000 7fd83759e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd8380bcb30 0x7fd8380bd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:16.779 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.773+0000 7fd83759e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8380bcf10 0x7fd83814bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:16.779 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.773+0000 7fd83759e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd83814c290 0x7fd838148900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:16.779 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.773+0000 7fd83759e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83814b940 con 0x7fd8380bcb30 2021-01-27T09:45:16.780 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.773+0000 7fd83759e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83814c720 con 0x7fd83814c290 2021-01-27T09:45:16.780 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.773+0000 7fd83759e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8380bb500 con 0x7fd8380bcf10 2021-01-27T09:45:16.780 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.773+0000 7fd836d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd83814c290 0x7fd838148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:16.782 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.773+0000 7fd836d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd83814c290 0x7fd838148900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47314/0 (socket says 172.21.15.146:47314) 2021-01-27T09:45:16.783 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.773+0000 7fd835d9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8380bcf10 0x7fd83814bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:16.784 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.773+0000 7fd836d9d700 1 -- 172.21.15.146:0/3800243562 learned_addr learned my addr 172.21.15.146:0/3800243562 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:16.784 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.773+0000 7fd83659c700 1 --2- 172.21.15.146:0/3800243562 >> v2:172.21.15.78:3300/0 conn(0x7fd8380bcb30 0x7fd8380bd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:16.784 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.773+0000 7fd836d9d700 1 -- 172.21.15.146:0/3800243562 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8380bcf10 msgr2=0x7fd83814bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:16.785 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.773+0000 7fd836d9d700 1 --2- 172.21.15.146:0/3800243562 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8380bcf10 0x7fd83814bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.785 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.773+0000 7fd836d9d700 1 -- 172.21.15.146:0/3800243562 >> v2:172.21.15.78:3300/0 conn(0x7fd8380bcb30 msgr2=0x7fd8380bd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:16.785 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.773+0000 7fd836d9d700 1 --2- 172.21.15.146:0/3800243562 >> v2:172.21.15.78:3300/0 conn(0x7fd8380bcb30 0x7fd8380bd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.785 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.773+0000 7fd836d9d700 1 -- 172.21.15.146:0/3800243562 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83814f1e0 con 0x7fd83814c290 2021-01-27T09:45:16.786 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.777+0000 7fd83659c700 1 --2- 172.21.15.146:0/3800243562 >> v2:172.21.15.78:3300/0 conn(0x7fd8380bcb30 0x7fd8380bd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:45:16.786 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.777+0000 7fd836d9d700 1 --2- 172.21.15.146:0/3800243562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd83814c290 0x7fd838148900 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fd8380c00b0 tx=0x7fd8300092d0).ready entity=mon.1 client_cookie=3c6054aa3f2c7a04 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:16.786 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.777+0000 7fd83559a700 1 -- 172.21.15.146:0/3800243562 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83000bc80 con 0x7fd83814c290 2021-01-27T09:45:16.786 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.777+0000 7fd83559a700 1 -- 172.21.15.146:0/3800243562 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83000bde0 con 0x7fd83814c290 2021-01-27T09:45:16.786 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.777+0000 7fd83559a700 1 -- 172.21.15.146:0/3800243562 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830011610 con 0x7fd83814c290 2021-01-27T09:45:16.789 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.777+0000 7fd83759e700 1 -- 172.21.15.146:0/3800243562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd83814c290 msgr2=0x7fd838148900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:16.790 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.777+0000 7fd83759e700 1 --2- 172.21.15.146:0/3800243562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd83814c290 0x7fd838148900 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fd8380c00b0 tx=0x7fd8300092d0).stop 2021-01-27T09:45:16.790 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.777+0000 7fd83759e700 1 -- 172.21.15.146:0/3800243562 shutdown_connections 2021-01-27T09:45:16.790 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.777+0000 7fd83759e700 1 --2- 172.21.15.146:0/3800243562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd83814c290 0x7fd838148900 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.791 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.777+0000 7fd83759e700 1 --2- 172.21.15.146:0/3800243562 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8380bcf10 0x7fd83814bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.791 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.777+0000 7fd83759e700 1 --2- 172.21.15.146:0/3800243562 >> v2:172.21.15.78:3300/0 conn(0x7fd8380bcb30 0x7fd8380bd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.791 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.777+0000 7fd83759e700 1 -- 172.21.15.146:0/3800243562 >> 172.21.15.146:0/3800243562 conn(0x7fd838069ba0 msgr2=0x7fd838062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:16.791 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.777+0000 7fd83759e700 1 -- 172.21.15.146:0/3800243562 shutdown_connections 2021-01-27T09:45:16.791 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.777+0000 7fd83759e700 1 -- 172.21.15.146:0/3800243562 wait complete. 2021-01-27T09:45:16.792 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.781+0000 7fd83759e700 1 Processor -- start 2021-01-27T09:45:16.792 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.781+0000 7fd83759e700 1 -- start start 2021-01-27T09:45:16.792 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.781+0000 7fd83759e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8380bcb30 0x7fd8381480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:16.792 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.781+0000 7fd83759e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8380bcf10 0x7fd838142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:16.793 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.781+0000 7fd83759e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd83814c290 0x7fd838142620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:16.793 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.781+0000 7fd83759e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8381477a0 con 0x7fd83814c290 2021-01-27T09:45:16.793 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.781+0000 7fd83759e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8380ba900 con 0x7fd8380bcf10 2021-01-27T09:45:16.793 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.781+0000 7fd83759e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83814e870 con 0x7fd8380bcb30 2021-01-27T09:45:16.793 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.785+0000 7fd83659c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8380bcb30 0x7fd8381480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:16.794 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.785+0000 7fd83659c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8380bcb30 0x7fd8381480d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36806/0 (socket says 172.21.15.146:36806) 2021-01-27T09:45:16.795 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.785+0000 7fd83659c700 1 -- 172.21.15.146:0/133550821 learned_addr learned my addr 172.21.15.146:0/133550821 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:16.795 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.785+0000 7fd836d9d700 1 --2- 172.21.15.146:0/133550821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd83814c290 0x7fd838142620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:16.795 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.785+0000 7fd835d9b700 1 --2- 172.21.15.146:0/133550821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8380bcf10 0x7fd838142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:16.795 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.785+0000 7fd83659c700 1 -- 172.21.15.146:0/133550821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8380bcf10 msgr2=0x7fd838142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:16.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.785+0000 7fd83659c700 1 --2- 172.21.15.146:0/133550821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8380bcf10 0x7fd838142130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.785+0000 7fd83659c700 1 -- 172.21.15.146:0/133550821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd83814c290 msgr2=0x7fd838142620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:16.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.785+0000 7fd83659c700 1 --2- 172.21.15.146:0/133550821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd83814c290 0x7fd838142620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.785+0000 7fd83659c700 1 -- 172.21.15.146:0/133550821 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83814eb10 con 0x7fd8380bcb30 2021-01-27T09:45:16.797 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.785+0000 7fd835d9b700 1 --2- 172.21.15.146:0/133550821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8380bcf10 0x7fd838142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:45:16.797 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.785+0000 7fd83659c700 1 --2- 172.21.15.146:0/133550821 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8380bcb30 0x7fd8381480d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd82800db60 tx=0x7fd828008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:16.797 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.785+0000 7fd8267fc700 1 -- 172.21.15.146:0/133550821 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82800de70 con 0x7fd8380bcb30 2021-01-27T09:45:16.797 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.785+0000 7fd8267fc700 1 -- 172.21.15.146:0/133550821 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8280097c0 con 0x7fd8380bcb30 2021-01-27T09:45:16.797 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.785+0000 7fd83759e700 1 -- 172.21.15.146:0/133550821 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83814edb0 con 0x7fd8380bcb30 2021-01-27T09:45:16.798 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.785+0000 7fd8267fc700 1 -- 172.21.15.146:0/133550821 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd828009b80 con 0x7fd8380bcb30 2021-01-27T09:45:16.798 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.785+0000 7fd83759e700 1 -- 172.21.15.146:0/133550821 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd838147c30 con 0x7fd8380bcb30 2021-01-27T09:45:16.798 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.785+0000 7fd83759e700 1 -- 172.21.15.146:0/133550821 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd838044680 con 0x7fd8380bcb30 2021-01-27T09:45:16.800 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.789+0000 7fd8267fc700 1 -- 172.21.15.146:0/133550821 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fd828013480 con 0x7fd8380bcb30 2021-01-27T09:45:16.800 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.789+0000 7fd8267fc700 1 --2- 172.21.15.146:0/133550821 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd8140561e0 0x7fd8140586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:16.800 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.789+0000 7fd8267fc700 1 -- 172.21.15.146:0/133550821 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fd82806fa20 con 0x7fd8380bcb30 2021-01-27T09:45:16.801 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.789+0000 7fd835d9b700 1 --2- 172.21.15.146:0/133550821 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd8140561e0 0x7fd8140586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:16.801 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.789+0000 7fd835d9b700 1 --2- 172.21.15.146:0/133550821 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd8140561e0 0x7fd8140586a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fd838143bb0 tx=0x7fd82c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:16.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.801+0000 7fd8267fc700 1 -- 172.21.15.146:0/133550821 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fd828044ff0 con 0x7fd8380bcb30 2021-01-27T09:45:16.949 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.945+0000 7fd83759e700 1 -- 172.21.15.146:0/133550821 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd8380638d0 con 0x7fd8380bcb30 2021-01-27T09:45:16.951 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.949+0000 7fd8267fc700 1 -- 172.21.15.146:0/133550821 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd828048610 con 0x7fd8380bcb30 2021-01-27T09:45:16.951 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:45:16.953 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.949+0000 7fd83759e700 1 -- 172.21.15.146:0/133550821 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd8140561e0 msgr2=0x7fd8140586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:16.953 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.949+0000 7fd83759e700 1 --2- 172.21.15.146:0/133550821 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd8140561e0 0x7fd8140586a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fd838143bb0 tx=0x7fd82c008040).stop 2021-01-27T09:45:16.954 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.949+0000 7fd83759e700 1 -- 172.21.15.146:0/133550821 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8380bcb30 msgr2=0x7fd8381480d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:16.955 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.949+0000 7fd83759e700 1 --2- 172.21.15.146:0/133550821 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8380bcb30 0x7fd8381480d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd82800db60 tx=0x7fd828008040).stop 2021-01-27T09:45:16.955 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.949+0000 7fd83759e700 1 -- 172.21.15.146:0/133550821 shutdown_connections 2021-01-27T09:45:16.955 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.953+0000 7fd83759e700 1 --2- 172.21.15.146:0/133550821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd83814c290 0x7fd838142620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.955 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.953+0000 7fd83759e700 1 --2- 172.21.15.146:0/133550821 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd8140561e0 0x7fd8140586a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.953+0000 7fd83759e700 1 --2- 172.21.15.146:0/133550821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8380bcf10 0x7fd838142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.953+0000 7fd83759e700 1 --2- 172.21.15.146:0/133550821 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8380bcb30 0x7fd8381480d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.953+0000 7fd83759e700 1 -- 172.21.15.146:0/133550821 >> 172.21.15.146:0/133550821 conn(0x7fd838069ba0 msgr2=0x7fd838065e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.953+0000 7fd83759e700 1 -- 172.21.15.146:0/133550821 shutdown_connections 2021-01-27T09:45:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:16.953+0000 7fd83759e700 1 -- 172.21.15.146:0/133550821 wait complete. 2021-01-27T09:45:16.983 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-01-27T09:45:17.146 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.145+0000 7f0a828cd700 1 Processor -- start 2021-01-27T09:45:17.147 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.145+0000 7f0a828cd700 1 -- start start 2021-01-27T09:45:17.149 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.145+0000 7f0a828cd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0a7c0b9a90 0x7f0a7c0631e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:17.149 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.145+0000 7f0a828cd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0a7c0b9e70 0x7f0a7c1459a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:17.149 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.145+0000 7f0a828cd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0a7c0651f0 0x7f0a7c145e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:17.149 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.145+0000 7f0a828cd700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a7c061270 con 0x7f0a7c0b9e70 2021-01-27T09:45:17.150 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.145+0000 7f0a828cd700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a7c0636d0 con 0x7f0a7c0b9a90 2021-01-27T09:45:17.150 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.145+0000 7f0a828cd700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c14f6b0 con 0x7f0a7c0651f0 2021-01-27T09:45:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.145+0000 7f0a7b7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0a7c0b9e70 0x7f0a7c1459a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.145+0000 7f0a7bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0a7c0b9a90 0x7f0a7c0631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.149+0000 7f0a7b7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0a7c0b9e70 0x7f0a7c1459a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:50204/0 (socket says 172.21.15.146:50204) 2021-01-27T09:45:17.152 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.149+0000 7f0a7b7fe700 1 -- 172.21.15.146:0/3481663026 learned_addr learned my addr 172.21.15.146:0/3481663026 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:17.152 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.149+0000 7f0a80e6a700 1 --2- 172.21.15.146:0/3481663026 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0a7c0651f0 0x7f0a7c145e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:17.152 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.149+0000 7f0a7b7fe700 1 -- 172.21.15.146:0/3481663026 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0a7c0651f0 msgr2=0x7f0a7c145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:17.152 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.149+0000 7f0a7b7fe700 1 --2- 172.21.15.146:0/3481663026 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0a7c0651f0 0x7f0a7c145e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:17.152 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.149+0000 7f0a7b7fe700 1 -- 172.21.15.146:0/3481663026 >> v2:172.21.15.146:3300/0 conn(0x7f0a7c0b9a90 msgr2=0x7f0a7c0631e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:17.153 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.149+0000 7f0a7b7fe700 1 --2- 172.21.15.146:0/3481663026 >> v2:172.21.15.146:3300/0 conn(0x7f0a7c0b9a90 0x7f0a7c0631e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:17.153 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.149+0000 7f0a7b7fe700 1 -- 172.21.15.146:0/3481663026 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7c14f950 con 0x7f0a7c0b9e70 2021-01-27T09:45:17.153 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.149+0000 7f0a80e6a700 1 --2- 172.21.15.146:0/3481663026 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0a7c0651f0 0x7f0a7c145e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:45:17.153 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.149+0000 7f0a7b7fe700 1 --2- 172.21.15.146:0/3481663026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a7c0b9e70 0x7f0a7c1459a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f0a7c0bddb0 tx=0x7f0a70006ee0).ready entity=mon.0 client_cookie=6029da36b6c4a223 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:17.154 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.149+0000 7f0a7affd700 1 -- 172.21.15.146:0/3481663026 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a700098d0 con 0x7f0a7c0b9e70 2021-01-27T09:45:17.155 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.149+0000 7f0a7affd700 1 -- 172.21.15.146:0/3481663026 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a70009a30 con 0x7f0a7c0b9e70 2021-01-27T09:45:17.155 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.149+0000 7f0a7affd700 1 -- 172.21.15.146:0/3481663026 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a70009db0 con 0x7f0a7c0b9e70 2021-01-27T09:45:17.155 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.149+0000 7f0a828cd700 1 -- 172.21.15.146:0/3481663026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a7c0b9e70 msgr2=0x7f0a7c1459a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:17.155 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.149+0000 7f0a828cd700 1 --2- 172.21.15.146:0/3481663026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a7c0b9e70 0x7f0a7c1459a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f0a7c0bddb0 tx=0x7f0a70006ee0).stop 2021-01-27T09:45:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.149+0000 7f0a828cd700 1 -- 172.21.15.146:0/3481663026 shutdown_connections 2021-01-27T09:45:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.149+0000 7f0a828cd700 1 --2- 172.21.15.146:0/3481663026 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0a7c0651f0 0x7f0a7c145e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.149+0000 7f0a828cd700 1 --2- 172.21.15.146:0/3481663026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a7c0b9e70 0x7f0a7c1459a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.149+0000 7f0a828cd700 1 --2- 172.21.15.146:0/3481663026 >> v2:172.21.15.146:3300/0 conn(0x7f0a7c0b9a90 0x7f0a7c0631e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.149+0000 7f0a828cd700 1 -- 172.21.15.146:0/3481663026 >> 172.21.15.146:0/3481663026 conn(0x7f0a7c060910 msgr2=0x7f0a7c064ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:17.157 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.149+0000 7f0a828cd700 1 -- 172.21.15.146:0/3481663026 shutdown_connections 2021-01-27T09:45:17.157 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.149+0000 7f0a828cd700 1 -- 172.21.15.146:0/3481663026 wait complete. 2021-01-27T09:45:17.158 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.153+0000 7f0a828cd700 1 Processor -- start 2021-01-27T09:45:17.158 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.153+0000 7f0a828cd700 1 -- start start 2021-01-27T09:45:17.159 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.153+0000 7f0a828cd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a7c0651f0 0x7f0a7c14a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:17.159 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.153+0000 7f0a828cd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0a7c0b9a90 0x7f0a7c144140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:17.159 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.153+0000 7f0a828cd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a7c0b9e70 0x7f0a7c14e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.153+0000 7f0a828cd700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c166280 con 0x7f0a7c0b9e70 2021-01-27T09:45:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.153+0000 7f0a828cd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c165800 con 0x7f0a7c0651f0 2021-01-27T09:45:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.153+0000 7f0a828cd700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c165aa0 con 0x7f0a7c0b9a90 2021-01-27T09:45:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.153+0000 7f0a7bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a7c0651f0 0x7f0a7c14a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.153+0000 7f0a7b7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0a7c0b9a90 0x7f0a7c144140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:17.161 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.157+0000 7f0a80e6a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a7c0b9e70 0x7f0a7c14e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:17.161 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.157+0000 7f0a7b7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0a7c0b9a90 0x7f0a7c144140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36820/0 (socket says 172.21.15.146:36820) 2021-01-27T09:45:17.161 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.157+0000 7f0a7b7fe700 1 -- 172.21.15.146:0/528339172 learned_addr learned my addr 172.21.15.146:0/528339172 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:17.161 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.157+0000 7f0a7b7fe700 1 -- 172.21.15.146:0/528339172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a7c0651f0 msgr2=0x7f0a7c14a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:17.161 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.157+0000 7f0a7b7fe700 1 --2- 172.21.15.146:0/528339172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a7c0651f0 0x7f0a7c14a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:17.162 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.157+0000 7f0a7b7fe700 1 -- 172.21.15.146:0/528339172 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a7c0b9e70 msgr2=0x7f0a7c14e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:17.162 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.157+0000 7f0a7b7fe700 1 --2- 172.21.15.146:0/528339172 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a7c0b9e70 0x7f0a7c14e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:17.162 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.157+0000 7f0a7b7fe700 1 -- 172.21.15.146:0/528339172 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7c165d40 con 0x7f0a7c0b9a90 2021-01-27T09:45:17.162 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.157+0000 7f0a7b7fe700 1 --2- 172.21.15.146:0/528339172 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0a7c0b9a90 0x7f0a7c144140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f0a7c05c610 tx=0x7f0a70016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:17.163 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.157+0000 7f0a63fff700 1 -- 172.21.15.146:0/528339172 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a700068c0 con 0x7f0a7c0b9a90 2021-01-27T09:45:17.163 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.157+0000 7f0a63fff700 1 -- 172.21.15.146:0/528339172 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a70011a70 con 0x7f0a7c0b9a90 2021-01-27T09:45:17.164 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.157+0000 7f0a828cd700 1 -- 172.21.15.146:0/528339172 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a7c165fe0 con 0x7f0a7c0b9a90 2021-01-27T09:45:17.164 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.157+0000 7f0a63fff700 1 -- 172.21.15.146:0/528339172 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a70011e10 con 0x7f0a7c0b9a90 2021-01-27T09:45:17.164 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.157+0000 7f0a828cd700 1 -- 172.21.15.146:0/528339172 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7c144c80 con 0x7f0a7c0b9a90 2021-01-27T09:45:17.164 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.157+0000 7f0a828cd700 1 -- 172.21.15.146:0/528339172 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a7c14b6f0 con 0x7f0a7c0b9a90 2021-01-27T09:45:17.164 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.161+0000 7f0a63fff700 1 -- 172.21.15.146:0/528339172 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f0a7000f070 con 0x7f0a7c0b9a90 2021-01-27T09:45:17.165 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.161+0000 7f0a63fff700 1 --2- 172.21.15.146:0/528339172 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0a5c0561e0 0x7f0a5c0586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:17.165 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.161+0000 7f0a63fff700 1 -- 172.21.15.146:0/528339172 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f0a700708e0 con 0x7f0a7c0b9a90 2021-01-27T09:45:17.166 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.161+0000 7f0a7bfff700 1 --2- 172.21.15.146:0/528339172 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0a5c0561e0 0x7f0a5c0586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:17.166 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.161+0000 7f0a7bfff700 1 --2- 172.21.15.146:0/528339172 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0a5c0561e0 0x7f0a5c0586a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f0a6c00bb00 tx=0x7f0a6c006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:17.175 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.173+0000 7f0a63fff700 1 -- 172.21.15.146:0/528339172 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f0a7c14b6f0 con 0x7f0a7c0b9a90 2021-01-27T09:45:17.314 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.313+0000 7f0a828cd700 1 -- 172.21.15.146:0/528339172 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a7c14b6f0 con 0x7f0a7c0b9a90 2021-01-27T09:45:17.315 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.313+0000 7f0a63fff700 1 -- 172.21.15.146:0/528339172 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+10 (secure 0 0 0) 0x7f0a7c14b6f0 con 0x7f0a7c0b9a90 2021-01-27T09:45:17.316 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:45:17.319 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.317+0000 7f0a828cd700 1 -- 172.21.15.146:0/528339172 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0a5c0561e0 msgr2=0x7f0a5c0586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:17.319 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.317+0000 7f0a828cd700 1 --2- 172.21.15.146:0/528339172 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0a5c0561e0 0x7f0a5c0586a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f0a6c00bb00 tx=0x7f0a6c006e20).stop 2021-01-27T09:45:17.320 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.317+0000 7f0a828cd700 1 -- 172.21.15.146:0/528339172 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0a7c0b9a90 msgr2=0x7f0a7c144140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:17.320 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.317+0000 7f0a828cd700 1 --2- 172.21.15.146:0/528339172 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0a7c0b9a90 0x7f0a7c144140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f0a7c05c610 tx=0x7f0a70016000).stop 2021-01-27T09:45:17.320 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.317+0000 7f0a828cd700 1 -- 172.21.15.146:0/528339172 shutdown_connections 2021-01-27T09:45:17.320 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.317+0000 7f0a828cd700 1 --2- 172.21.15.146:0/528339172 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a7c0b9e70 0x7f0a7c14e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:17.321 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.317+0000 7f0a828cd700 1 --2- 172.21.15.146:0/528339172 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0a7c0b9a90 0x7f0a7c144140 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:17.321 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.317+0000 7f0a828cd700 1 --2- 172.21.15.146:0/528339172 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0a5c0561e0 0x7f0a5c0586a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:17.321 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.317+0000 7f0a828cd700 1 --2- 172.21.15.146:0/528339172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a7c0651f0 0x7f0a7c14a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:17.321 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.317+0000 7f0a828cd700 1 -- 172.21.15.146:0/528339172 >> 172.21.15.146:0/528339172 conn(0x7f0a7c060910 msgr2=0x7f0a7c142920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:17.322 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.317+0000 7f0a828cd700 1 -- 172.21.15.146:0/528339172 shutdown_connections 2021-01-27T09:45:17.322 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.317+0000 7f0a828cd700 1 -- 172.21.15.146:0/528339172 wait complete. 2021-01-27T09:45:17.348 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-01-27T09:45:17.509 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.505+0000 7f6d5dbf4700 1 Processor -- start 2021-01-27T09:45:17.510 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.509+0000 7f6d5dbf4700 1 -- start start 2021-01-27T09:45:17.512 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.509+0000 7f6d5dbf4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d58060a50 0x7f6d580b80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:17.512 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.509+0000 7f6d5dbf4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d580bdc30 0x7f6d580c0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:17.512 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.509+0000 7f6d5dbf4700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d580b85a0 con 0x7f6d58060e30 2021-01-27T09:45:17.512 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.509+0000 7f6d5dbf4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d580b8820 con 0x7f6d580bdc30 2021-01-27T09:45:17.513 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.509+0000 7f6d5dbf4700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5814d8f0 con 0x7f6d58060a50 2021-01-27T09:45:17.514 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.509+0000 7f6d5cbf2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d58060a50 0x7f6d580b80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:17.514 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.509+0000 7f6d57fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d580bdc30 0x7f6d580c0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:17.515 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.509+0000 7f6d5d3f3700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6d58060e30 0x7f6d58147280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:34948/0 (socket says 172.21.15.146:34948) 2021-01-27T09:45:17.515 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.509+0000 7f6d5d3f3700 1 -- 172.21.15.146:0/2134074334 learned_addr learned my addr 172.21.15.146:0/2134074334 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:17.515 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.509+0000 7f6d577fe700 1 -- 172.21.15.146:0/2134074334 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22755478 0 0) 0x7f6d580b85a0 con 0x7f6d58060e30 2021-01-27T09:45:17.515 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.509+0000 7f6d577fe700 1 -- 172.21.15.146:0/2134074334 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d3c003270 con 0x7f6d58060e30 2021-01-27T09:45:17.515 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.509+0000 7f6d5cbf2700 1 -- 172.21.15.146:0/2134074334 >> v2:172.21.15.146:3300/0 conn(0x7f6d580bdc30 msgr2=0x7f6d580c0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:17.516 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.513+0000 7f6d5cbf2700 1 --2- 172.21.15.146:0/2134074334 >> v2:172.21.15.146:3300/0 conn(0x7f6d580bdc30 0x7f6d580c0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:17.516 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.513+0000 7f6d5cbf2700 1 -- 172.21.15.146:0/2134074334 >> v1:172.21.15.78:6789/0 conn(0x7f6d58060e30 legacy=0x7f6d58147280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:17.516 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.513+0000 7f6d5cbf2700 1 -- 172.21.15.146:0/2134074334 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5814db90 con 0x7f6d58060a50 2021-01-27T09:45:17.516 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.513+0000 7f6d57fff700 1 --2- 172.21.15.146:0/2134074334 >> v2:172.21.15.146:3300/0 conn(0x7f6d580bdc30 0x7f6d580c0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:45:17.517 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.513+0000 7f6d5cbf2700 1 --2- 172.21.15.146:0/2134074334 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d58060a50 0x7f6d580b80b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f6d4c00b9c0 tx=0x7f6d4c006e20).ready entity=mon.2 client_cookie=7fbee0bb9a2ef5a0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.513+0000 7f6d577fe700 1 -- 172.21.15.146:0/2134074334 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c009690 con 0x7f6d58060a50 2021-01-27T09:45:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.513+0000 7f6d577fe700 1 -- 172.21.15.146:0/2134074334 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4c0097f0 con 0x7f6d58060a50 2021-01-27T09:45:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.513+0000 7f6d577fe700 1 -- 172.21.15.146:0/2134074334 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c009b70 con 0x7f6d58060a50 2021-01-27T09:45:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.513+0000 7f6d5dbf4700 1 -- 172.21.15.146:0/2134074334 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d58060a50 msgr2=0x7f6d580b80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:17.519 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.513+0000 7f6d5dbf4700 1 --2- 172.21.15.146:0/2134074334 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d58060a50 0x7f6d580b80b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f6d4c00b9c0 tx=0x7f6d4c006e20).stop 2021-01-27T09:45:17.519 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.513+0000 7f6d5dbf4700 1 -- 172.21.15.146:0/2134074334 shutdown_connections 2021-01-27T09:45:17.519 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.513+0000 7f6d5dbf4700 1 --2- 172.21.15.146:0/2134074334 >> v2:172.21.15.146:3300/0 conn(0x7f6d580bdc30 0x7f6d580c0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:17.519 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.513+0000 7f6d5dbf4700 1 --2- 172.21.15.146:0/2134074334 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d58060a50 0x7f6d580b80b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:17.519 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.513+0000 7f6d5dbf4700 1 -- 172.21.15.146:0/2134074334 >> 172.21.15.146:0/2134074334 conn(0x7f6d58064d20 msgr2=0x7f6d58066390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:17.520 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.513+0000 7f6d5dbf4700 1 -- 172.21.15.146:0/2134074334 shutdown_connections 2021-01-27T09:45:17.520 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.513+0000 7f6d5dbf4700 1 -- 172.21.15.146:0/2134074334 wait complete. 2021-01-27T09:45:17.521 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.517+0000 7f6d5dbf4700 1 Processor -- start 2021-01-27T09:45:17.521 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.517+0000 7f6d5dbf4700 1 -- start start 2021-01-27T09:45:17.521 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.517+0000 7f6d5dbf4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d58060e30 0x7f6d5814ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:17.521 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.517+0000 7f6d5dbf4700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d580bdc30 0x7f6d5813be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:17.522 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.517+0000 7f6d5dbf4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d5813c330 0x7f6d58148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:17.522 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.517+0000 7f6d5dbf4700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5814b2d0 con 0x7f6d580bdc30 2021-01-27T09:45:17.522 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.517+0000 7f6d5dbf4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d58147f30 con 0x7f6d58060e30 2021-01-27T09:45:17.522 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.517+0000 7f6d5dbf4700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5815f410 con 0x7f6d5813c330 2021-01-27T09:45:17.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.517+0000 7f6d5cbf2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d58060e30 0x7f6d5814ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:17.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.517+0000 7f6d5cbf2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d58060e30 0x7f6d5814ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47348/0 (socket says 172.21.15.146:47348) 2021-01-27T09:45:17.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.521+0000 7f6d57fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d580bdc30 0x7f6d5813be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:17.525 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.521+0000 7f6d5cbf2700 1 -- 172.21.15.146:0/2473356655 learned_addr learned my addr 172.21.15.146:0/2473356655 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:17.525 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.521+0000 7f6d5d3f3700 1 --2- 172.21.15.146:0/2473356655 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d5813c330 0x7f6d58148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:17.525 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.521+0000 7f6d5cbf2700 1 -- 172.21.15.146:0/2473356655 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d5813c330 msgr2=0x7f6d58148360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:17.526 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.521+0000 7f6d5cbf2700 1 --2- 172.21.15.146:0/2473356655 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d5813c330 0x7f6d58148360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:17.526 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.521+0000 7f6d5cbf2700 1 -- 172.21.15.146:0/2473356655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d580bdc30 msgr2=0x7f6d5813be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:17.526 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.521+0000 7f6d5cbf2700 1 --2- 172.21.15.146:0/2473356655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d580bdc30 0x7f6d5813be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:17.526 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.521+0000 7f6d5cbf2700 1 -- 172.21.15.146:0/2473356655 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5814a600 con 0x7f6d58060e30 2021-01-27T09:45:17.526 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.521+0000 7f6d5cbf2700 1 --2- 172.21.15.146:0/2473356655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d58060e30 0x7f6d5814ade0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f6d4c010000 tx=0x7f6d4c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:17.527 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.521+0000 7f6d54ff9700 1 -- 172.21.15.146:0/2473356655 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c012c00 con 0x7f6d58060e30 2021-01-27T09:45:17.527 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.521+0000 7f6d54ff9700 1 -- 172.21.15.146:0/2473356655 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4c012d60 con 0x7f6d58060e30 2021-01-27T09:45:17.527 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.521+0000 7f6d5dbf4700 1 -- 172.21.15.146:0/2473356655 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5814a8a0 con 0x7f6d58060e30 2021-01-27T09:45:17.527 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.521+0000 7f6d54ff9700 1 -- 172.21.15.146:0/2473356655 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c01c650 con 0x7f6d58060e30 2021-01-27T09:45:17.528 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.521+0000 7f6d5dbf4700 1 -- 172.21.15.146:0/2473356655 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5815f100 con 0x7f6d58060e30 2021-01-27T09:45:17.528 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.525+0000 7f6d5dbf4700 1 -- 172.21.15.146:0/2473356655 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d58063e50 con 0x7f6d58060e30 2021-01-27T09:45:17.529 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.525+0000 7f6d54ff9700 1 -- 172.21.15.146:0/2473356655 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f6d4c00f070 con 0x7f6d58060e30 2021-01-27T09:45:17.529 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.525+0000 7f6d54ff9700 1 --2- 172.21.15.146:0/2473356655 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6d380561e0 0x7f6d380586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:17.529 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.525+0000 7f6d54ff9700 1 -- 172.21.15.146:0/2473356655 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f6d4c0708e0 con 0x7f6d58060e30 2021-01-27T09:45:17.529 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.525+0000 7f6d57fff700 1 --2- 172.21.15.146:0/2473356655 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6d380561e0 0x7f6d380586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:17.530 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.529+0000 7f6d57fff700 1 --2- 172.21.15.146:0/2473356655 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6d380561e0 0x7f6d380586a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f6d58067370 tx=0x7f6d44006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:17.536 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.533+0000 7f6d54ff9700 1 -- 172.21.15.146:0/2473356655 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f6d4c045ec0 con 0x7f6d58060e30 2021-01-27T09:45:17.683 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.681+0000 7f6d5dbf4700 1 -- 172.21.15.146:0/2473356655 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6d58044680 con 0x7f6d58060e30 2021-01-27T09:45:17.684 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.681+0000 7f6d54ff9700 1 -- 172.21.15.146:0/2473356655 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+10 (secure 0 0 0) 0x7f6d4c0494a0 con 0x7f6d58060e30 2021-01-27T09:45:17.685 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:45:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.685+0000 7f6d5dbf4700 1 -- 172.21.15.146:0/2473356655 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6d380561e0 msgr2=0x7f6d380586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.685+0000 7f6d5dbf4700 1 --2- 172.21.15.146:0/2473356655 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6d380561e0 0x7f6d380586a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f6d58067370 tx=0x7f6d44006e20).stop 2021-01-27T09:45:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.685+0000 7f6d5dbf4700 1 -- 172.21.15.146:0/2473356655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d58060e30 msgr2=0x7f6d5814ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.685+0000 7f6d5dbf4700 1 --2- 172.21.15.146:0/2473356655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d58060e30 0x7f6d5814ade0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f6d4c010000 tx=0x7f6d4c016000).stop 2021-01-27T09:45:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.685+0000 7f6d5dbf4700 1 -- 172.21.15.146:0/2473356655 shutdown_connections 2021-01-27T09:45:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.685+0000 7f6d5dbf4700 1 --2- 172.21.15.146:0/2473356655 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d5813c330 0x7f6d58148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.685+0000 7f6d5dbf4700 1 --2- 172.21.15.146:0/2473356655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d580bdc30 0x7f6d5813be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.685+0000 7f6d5dbf4700 1 --2- 172.21.15.146:0/2473356655 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6d380561e0 0x7f6d380586a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.685+0000 7f6d5dbf4700 1 --2- 172.21.15.146:0/2473356655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d58060e30 0x7f6d5814ade0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.685+0000 7f6d5dbf4700 1 -- 172.21.15.146:0/2473356655 >> 172.21.15.146:0/2473356655 conn(0x7f6d58064d20 msgr2=0x7f6d580678e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.685+0000 7f6d5dbf4700 1 -- 172.21.15.146:0/2473356655 shutdown_connections 2021-01-27T09:45:17.690 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.685+0000 7f6d5dbf4700 1 -- 172.21.15.146:0/2473356655 wait complete. 2021-01-27T09:45:17.713 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2021-01-27T09:45:17.887 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.885+0000 7f4b9c5fe700 1 Processor -- start 2021-01-27T09:45:17.887 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.885+0000 7f4b9c5fe700 1 -- start start 2021-01-27T09:45:17.890 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.889+0000 7f4b9c5fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4b9414c990 0x7f4b940631e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:17.890 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.889+0000 7f4b9c5fe700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9414f6b0 con 0x7f4b940b9a90 2021-01-27T09:45:17.890 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.889+0000 7f4b9c5fe700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9414f950 con 0x7f4b940b9e70 2021-01-27T09:45:17.891 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.889+0000 7f4b9c5fe700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b94061270 con 0x7f4b9414c990 2021-01-27T09:45:17.891 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.889+0000 7f4b99b99700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4b940b9e70 0x7f4b9414c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46930/0 (socket says 172.21.15.146:46930) 2021-01-27T09:45:17.892 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.889+0000 7f4b99b99700 1 -- 172.21.15.146:0/854846451 learned_addr learned my addr 172.21.15.146:0/854846451 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:17.892 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.889+0000 7f4b9ab9b700 1 --2- 172.21.15.146:0/854846451 >> v2:172.21.15.146:3300/0 conn(0x7f4b9414c990 0x7f4b940631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:17.892 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.889+0000 7f4b9ab9b700 1 -- 172.21.15.146:0/854846451 >> v1:172.21.15.146:6789/0 conn(0x7f4b940b9e70 legacy=0x7f4b9414c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:17.892 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.889+0000 7f4b9ab9b700 1 -- 172.21.15.146:0/854846451 >> v1:172.21.15.78:6789/0 conn(0x7f4b940b9a90 legacy=0x7f4b941459a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:17.892 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.889+0000 7f4b9ab9b700 1 -- 172.21.15.146:0/854846451 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9414fbf0 con 0x7f4b9414c990 2021-01-27T09:45:17.893 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.889+0000 7f4b9ab9b700 1 --2- 172.21.15.146:0/854846451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b9414c990 0x7f4b940631e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f4b8c009cc0 tx=0x7f4b8c009220).ready entity=mon.1 client_cookie=2dc10848810a30b0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:17.893 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.889+0000 7f4b99398700 1 -- 172.21.15.146:0/854846451 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c00bc80 con 0x7f4b9414c990 2021-01-27T09:45:17.894 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.889+0000 7f4b99398700 1 -- 172.21.15.146:0/854846451 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8c00bde0 con 0x7f4b9414c990 2021-01-27T09:45:17.894 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.889+0000 7f4b99398700 1 -- 172.21.15.146:0/854846451 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c011610 con 0x7f4b9414c990 2021-01-27T09:45:17.894 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.889+0000 7f4b9c5fe700 1 -- 172.21.15.146:0/854846451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b9414c990 msgr2=0x7f4b940631e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:17.894 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.889+0000 7f4b9c5fe700 1 --2- 172.21.15.146:0/854846451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b9414c990 0x7f4b940631e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f4b8c009cc0 tx=0x7f4b8c009220).stop 2021-01-27T09:45:17.895 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.893+0000 7f4b9c5fe700 1 -- 172.21.15.146:0/854846451 shutdown_connections 2021-01-27T09:45:17.895 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.893+0000 7f4b9c5fe700 1 --2- 172.21.15.146:0/854846451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b9414c990 0x7f4b940631e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:17.896 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.893+0000 7f4b9c5fe700 1 -- 172.21.15.146:0/854846451 >> 172.21.15.146:0/854846451 conn(0x7f4b94060910 msgr2=0x7f4b94064ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:17.896 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.893+0000 7f4b9c5fe700 1 -- 172.21.15.146:0/854846451 shutdown_connections 2021-01-27T09:45:17.896 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.893+0000 7f4b9c5fe700 1 -- 172.21.15.146:0/854846451 wait complete. 2021-01-27T09:45:17.898 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.897+0000 7f4b9c5fe700 1 Processor -- start 2021-01-27T09:45:17.898 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.897+0000 7f4b9c5fe700 1 -- start start 2021-01-27T09:45:17.899 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.897+0000 7f4b9c5fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b940b9a90 0x7f4b940bd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:17.900 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.897+0000 7f4b9c5fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b940b9e70 0x7f4b9415f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:17.900 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.897+0000 7f4b9c5fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4b9414c990 0x7f4b9415be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:17.900 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.897+0000 7f4b9c5fe700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b940bd620 con 0x7f4b940b9a90 2021-01-27T09:45:17.900 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.897+0000 7f4b9c5fe700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9413ac30 con 0x7f4b940b9e70 2021-01-27T09:45:17.901 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.897+0000 7f4b9c5fe700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9414a920 con 0x7f4b9414c990 2021-01-27T09:45:17.901 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.897+0000 7f4b99b99700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b940b9e70 0x7f4b9415f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:17.901 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.897+0000 7f4b99b99700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b940b9e70 0x7f4b9415f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47362/0 (socket says 172.21.15.146:47362) 2021-01-27T09:45:17.902 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.897+0000 7f4b99b99700 1 -- 172.21.15.146:0/3272604117 learned_addr learned my addr 172.21.15.146:0/3272604117 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:17.902 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.897+0000 7f4b9ab9b700 1 --2- 172.21.15.146:0/3272604117 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4b9414c990 0x7f4b9415be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:17.902 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.897+0000 7f4b9a39a700 1 --2- 172.21.15.146:0/3272604117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b940b9a90 0x7f4b940bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:17.904 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.897+0000 7f4b99b99700 1 -- 172.21.15.146:0/3272604117 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4b9414c990 msgr2=0x7f4b9415be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:17.904 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.897+0000 7f4b99b99700 1 --2- 172.21.15.146:0/3272604117 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4b9414c990 0x7f4b9415be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:17.904 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.897+0000 7f4b99b99700 1 -- 172.21.15.146:0/3272604117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b940b9a90 msgr2=0x7f4b940bd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:17.905 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.897+0000 7f4b99b99700 1 --2- 172.21.15.146:0/3272604117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b940b9a90 0x7f4b940bd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:17.905 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.897+0000 7f4b99b99700 1 -- 172.21.15.146:0/3272604117 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9414abc0 con 0x7f4b940b9e70 2021-01-27T09:45:17.905 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.897+0000 7f4b99b99700 1 --2- 172.21.15.146:0/3272604117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b940b9e70 0x7f4b9415f440 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f4b8400c710 tx=0x7f4b84007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:17.906 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.897+0000 7f4b827fc700 1 -- 172.21.15.146:0/3272604117 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b840072e0 con 0x7f4b940b9e70 2021-01-27T09:45:17.906 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.897+0000 7f4b827fc700 1 -- 172.21.15.146:0/3272604117 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b84007440 con 0x7f4b940b9e70 2021-01-27T09:45:17.907 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.897+0000 7f4b827fc700 1 -- 172.21.15.146:0/3272604117 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b84005830 con 0x7f4b940b9e70 2021-01-27T09:45:17.907 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.897+0000 7f4b9c5fe700 1 -- 172.21.15.146:0/3272604117 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9414ae60 con 0x7f4b940b9e70 2021-01-27T09:45:17.907 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.901+0000 7f4b9c5fe700 1 -- 172.21.15.146:0/3272604117 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9415efa0 con 0x7f4b940b9e70 2021-01-27T09:45:17.907 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.901+0000 7f4b9c5fe700 1 -- 172.21.15.146:0/3272604117 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b94044ee0 con 0x7f4b940b9e70 2021-01-27T09:45:17.908 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.901+0000 7f4b827fc700 1 -- 172.21.15.146:0/3272604117 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f4b84010070 con 0x7f4b940b9e70 2021-01-27T09:45:17.908 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.901+0000 7f4b827fc700 1 --2- 172.21.15.146:0/3272604117 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4b740561e0 0x7f4b740586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:17.909 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.901+0000 7f4b827fc700 1 -- 172.21.15.146:0/3272604117 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f4b8406ebb0 con 0x7f4b940b9e70 2021-01-27T09:45:17.909 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.905+0000 7f4b9a39a700 1 --2- 172.21.15.146:0/3272604117 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4b740561e0 0x7f4b740586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:17.909 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.905+0000 7f4b9a39a700 1 --2- 172.21.15.146:0/3272604117 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4b740561e0 0x7f4b740586a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f4b90003780 tx=0x7f4b90007bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:17.910 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:17.909+0000 7f4b827fc700 1 -- 172.21.15.146:0/3272604117 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f4b84075080 con 0x7f4b940b9e70 2021-01-27T09:45:18.062 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.061+0000 7f4b9c5fe700 1 -- 172.21.15.146:0/3272604117 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4b941435a0 con 0x7f4b940b9e70 2021-01-27T09:45:18.063 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.061+0000 7f4b827fc700 1 -- 172.21.15.146:0/3272604117 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+10 (secure 0 0 0) 0x7f4b84044260 con 0x7f4b940b9e70 2021-01-27T09:45:18.063 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:45:18.065 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.061+0000 7f4b9c5fe700 1 -- 172.21.15.146:0/3272604117 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4b740561e0 msgr2=0x7f4b740586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:18.065 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.061+0000 7f4b9c5fe700 1 --2- 172.21.15.146:0/3272604117 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4b740561e0 0x7f4b740586a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f4b90003780 tx=0x7f4b90007bc0).stop 2021-01-27T09:45:18.065 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.061+0000 7f4b9c5fe700 1 -- 172.21.15.146:0/3272604117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b940b9e70 msgr2=0x7f4b9415f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:18.066 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.061+0000 7f4b9c5fe700 1 --2- 172.21.15.146:0/3272604117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b940b9e70 0x7f4b9415f440 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f4b8400c710 tx=0x7f4b84007c40).stop 2021-01-27T09:45:18.066 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.061+0000 7f4b9c5fe700 1 -- 172.21.15.146:0/3272604117 shutdown_connections 2021-01-27T09:45:18.066 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.061+0000 7f4b9c5fe700 1 --2- 172.21.15.146:0/3272604117 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4b9414c990 0x7f4b9415be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:18.066 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.061+0000 7f4b9c5fe700 1 --2- 172.21.15.146:0/3272604117 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4b740561e0 0x7f4b740586a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:18.067 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.061+0000 7f4b9c5fe700 1 --2- 172.21.15.146:0/3272604117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b940b9e70 0x7f4b9415f440 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:18.067 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.061+0000 7f4b9c5fe700 1 --2- 172.21.15.146:0/3272604117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b940b9a90 0x7f4b940bd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:18.067 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.061+0000 7f4b9c5fe700 1 -- 172.21.15.146:0/3272604117 >> 172.21.15.146:0/3272604117 conn(0x7f4b94060910 msgr2=0x7f4b94142be0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:18.068 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.061+0000 7f4b9c5fe700 1 -- 172.21.15.146:0/3272604117 shutdown_connections 2021-01-27T09:45:18.068 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.065+0000 7f4b9c5fe700 1 -- 172.21.15.146:0/3272604117 wait complete. 2021-01-27T09:45:18.090 INFO:tasks.mds_thrash:Wait for all MDSs to reach steady state... 2021-01-27T09:45:18.090 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:45:18.249 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.245+0000 7fc451610700 1 Processor -- start 2021-01-27T09:45:18.250 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.245+0000 7fc451610700 1 -- start start 2021-01-27T09:45:18.251 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.249+0000 7fc451610700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc44c147380 0x7fc44c0bd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:18.251 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.249+0000 7fc451610700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc44c147760 0x7fc44c066080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:18.252 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.249+0000 7fc451610700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc44c0bdb40 con 0x7fc44c067550 2021-01-27T09:45:18.252 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.249+0000 7fc451610700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc44c0aede0 con 0x7fc44c147760 2021-01-27T09:45:18.252 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.249+0000 7fc451610700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c0af080 con 0x7fc44c147380 2021-01-27T09:45:18.253 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.249+0000 7fc450e0f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc44c067550 0x7fc44c069110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46942/0 (socket says 172.21.15.146:46942) 2021-01-27T09:45:18.253 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.249+0000 7fc450e0f700 1 -- 172.21.15.146:0/1785310466 learned_addr learned my addr 172.21.15.146:0/1785310466 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:18.254 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.249+0000 7fc44b7fe700 1 --2- 172.21.15.146:0/1785310466 >> v2:172.21.15.146:3300/0 conn(0x7fc44c147760 0x7fc44c066080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:18.254 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.249+0000 7fc44bfff700 1 --2- 172.21.15.146:0/1785310466 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc44c147380 0x7fc44c0bd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:18.254 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.249+0000 7fc44affd700 1 -- 172.21.15.146:0/1785310466 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913663240 0 0) 0x7fc44c0bdb40 con 0x7fc44c067550 2021-01-27T09:45:18.254 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.249+0000 7fc44affd700 1 -- 172.21.15.146:0/1785310466 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc438003270 con 0x7fc44c067550 2021-01-27T09:45:18.254 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.249+0000 7fc44bfff700 1 -- 172.21.15.146:0/1785310466 >> v2:172.21.15.146:3300/0 conn(0x7fc44c147760 msgr2=0x7fc44c066080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:18.255 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.249+0000 7fc44bfff700 1 --2- 172.21.15.146:0/1785310466 >> v2:172.21.15.146:3300/0 conn(0x7fc44c147760 0x7fc44c066080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:18.255 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.249+0000 7fc44affd700 1 -- 172.21.15.146:0/1785310466 <== mon.1 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 159992967 0 0) 0x7fc438003270 con 0x7fc44c067550 2021-01-27T09:45:18.255 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.249+0000 7fc44bfff700 1 -- 172.21.15.146:0/1785310466 >> v1:172.21.15.146:6789/0 conn(0x7fc44c067550 legacy=0x7fc44c069110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:18.255 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.249+0000 7fc44bfff700 1 -- 172.21.15.146:0/1785310466 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c0af320 con 0x7fc44c147380 2021-01-27T09:45:18.256 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.249+0000 7fc44b7fe700 1 --2- 172.21.15.146:0/1785310466 >> v2:172.21.15.146:3300/0 conn(0x7fc44c147760 0x7fc44c066080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:45:18.256 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.253+0000 7fc44bfff700 1 --2- 172.21.15.146:0/1785310466 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc44c147380 0x7fc44c0bd520 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fc43c00b9c0 tx=0x7fc43c006e20).ready entity=mon.2 client_cookie=c77d66a9d5cbc69c server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:18.257 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.253+0000 7fc44affd700 1 -- 172.21.15.146:0/1785310466 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4440018a0 con 0x7fc44c147380 2021-01-27T09:45:18.257 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.253+0000 7fc44affd700 1 -- 172.21.15.146:0/1785310466 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43c011400 con 0x7fc44c147380 2021-01-27T09:45:18.257 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.253+0000 7fc44affd700 1 -- 172.21.15.146:0/1785310466 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c011780 con 0x7fc44c147380 2021-01-27T09:45:18.257 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.253+0000 7fc451610700 1 -- 172.21.15.146:0/1785310466 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc44c147380 msgr2=0x7fc44c0bd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:18.258 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.253+0000 7fc451610700 1 --2- 172.21.15.146:0/1785310466 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc44c147380 0x7fc44c0bd520 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fc43c00b9c0 tx=0x7fc43c006e20).stop 2021-01-27T09:45:18.258 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.253+0000 7fc451610700 1 -- 172.21.15.146:0/1785310466 shutdown_connections 2021-01-27T09:45:18.258 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.253+0000 7fc451610700 1 --2- 172.21.15.146:0/1785310466 >> v2:172.21.15.146:3300/0 conn(0x7fc44c147760 0x7fc44c066080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:18.259 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.253+0000 7fc451610700 1 --2- 172.21.15.146:0/1785310466 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc44c147380 0x7fc44c0bd520 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:18.259 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.253+0000 7fc451610700 1 -- 172.21.15.146:0/1785310466 >> 172.21.15.146:0/1785310466 conn(0x7fc44c064240 msgr2=0x7fc44c0601f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:18.259 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.253+0000 7fc451610700 1 -- 172.21.15.146:0/1785310466 shutdown_connections 2021-01-27T09:45:18.259 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.253+0000 7fc451610700 1 -- 172.21.15.146:0/1785310466 wait complete. 2021-01-27T09:45:18.260 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.257+0000 7fc451610700 1 Processor -- start 2021-01-27T09:45:18.260 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.257+0000 7fc451610700 1 -- start start 2021-01-27T09:45:18.261 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.257+0000 7fc451610700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc44c067550 0x7fc44c14e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:18.261 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.257+0000 7fc451610700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc44c147380 0x7fc44c14f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:18.261 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.257+0000 7fc451610700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc44c147760 0x7fc44c0692b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:18.261 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.257+0000 7fc451610700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c145dd0 con 0x7fc44c067550 2021-01-27T09:45:18.262 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.257+0000 7fc451610700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c14ed50 con 0x7fc44c147760 2021-01-27T09:45:18.262 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.257+0000 7fc451610700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c145890 con 0x7fc44c147380 2021-01-27T09:45:18.263 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.257+0000 7fc450e0f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc44c147760 0x7fc44c0692b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:18.263 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.257+0000 7fc44bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc44c067550 0x7fc44c14e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:18.263 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.257+0000 7fc44b7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc44c147380 0x7fc44c14f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:18.264 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.257+0000 7fc44bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc44c067550 0x7fc44c14e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:50250/0 (socket says 172.21.15.146:50250) 2021-01-27T09:45:18.264 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.257+0000 7fc44bfff700 1 -- 172.21.15.146:0/3320042108 learned_addr learned my addr 172.21.15.146:0/3320042108 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:18.264 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.261+0000 7fc450e0f700 1 -- 172.21.15.146:0/3320042108 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc44c147380 msgr2=0x7fc44c14f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:18.264 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.261+0000 7fc450e0f700 1 --2- 172.21.15.146:0/3320042108 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc44c147380 0x7fc44c14f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:18.264 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.261+0000 7fc450e0f700 1 -- 172.21.15.146:0/3320042108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc44c067550 msgr2=0x7fc44c14e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:18.265 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.261+0000 7fc450e0f700 1 --2- 172.21.15.146:0/3320042108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc44c067550 0x7fc44c14e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:18.265 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.261+0000 7fc450e0f700 1 -- 172.21.15.146:0/3320042108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c145b30 con 0x7fc44c147760 2021-01-27T09:45:18.265 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.261+0000 7fc450e0f700 1 --2- 172.21.15.146:0/3320042108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc44c147760 0x7fc44c0692b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fc444001560 tx=0x7fc4440015b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:18.265 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.261+0000 7fc433fff700 1 -- 172.21.15.146:0/3320042108 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44400ce30 con 0x7fc44c147760 2021-01-27T09:45:18.266 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.261+0000 7fc433fff700 1 -- 172.21.15.146:0/3320042108 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc444004ac0 con 0x7fc44c147760 2021-01-27T09:45:18.266 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.261+0000 7fc451610700 1 -- 172.21.15.146:0/3320042108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc44c146050 con 0x7fc44c147760 2021-01-27T09:45:18.266 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.261+0000 7fc433fff700 1 -- 172.21.15.146:0/3320042108 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc444004e60 con 0x7fc44c147760 2021-01-27T09:45:18.266 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.261+0000 7fc451610700 1 -- 172.21.15.146:0/3320042108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc44c146590 con 0x7fc44c147760 2021-01-27T09:45:18.267 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.261+0000 7fc451610700 1 -- 172.21.15.146:0/3320042108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc44c0be160 con 0x7fc44c147760 2021-01-27T09:45:18.267 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.261+0000 7fc433fff700 1 -- 172.21.15.146:0/3320042108 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fc444010070 con 0x7fc44c147760 2021-01-27T09:45:18.268 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.265+0000 7fc433fff700 1 --2- 172.21.15.146:0/3320042108 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc42c0561e0 0x7fc42c0586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:18.268 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.265+0000 7fc433fff700 1 -- 172.21.15.146:0/3320042108 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fc44406f470 con 0x7fc44c147760 2021-01-27T09:45:18.268 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.265+0000 7fc44bfff700 1 --2- 172.21.15.146:0/3320042108 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc42c0561e0 0x7fc42c0586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:18.268 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.265+0000 7fc44bfff700 1 --2- 172.21.15.146:0/3320042108 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc42c0561e0 0x7fc42c0586a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fc43c00b3b0 tx=0x7fc43c016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:18.272 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.269+0000 7fc433fff700 1 -- 172.21.15.146:0/3320042108 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fc44c0be160 con 0x7fc44c147760 2021-01-27T09:45:18.441 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.437+0000 7fc451610700 1 -- 172.21.15.146:0/3320042108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc44c14cb40 con 0x7fc44c147760 2021-01-27T09:45:18.442 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.441+0000 7fc433fff700 1 -- 172.21.15.146:0/3320042108 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3574 (secure 0 0 0) 0x7fc44c14cb40 con 0x7fc44c147760 2021-01-27T09:45:18.443 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:45:18.443 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:44:52.595879+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6837/745099427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":745099427},{"type":"v1","addr":"172.21.15.146:6837","nonce":745099427}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:45:18.445 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.441+0000 7fc451610700 1 -- 172.21.15.146:0/3320042108 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc42c0561e0 msgr2=0x7fc42c0586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:18.445 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.441+0000 7fc451610700 1 --2- 172.21.15.146:0/3320042108 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc42c0561e0 0x7fc42c0586a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fc43c00b3b0 tx=0x7fc43c016000).stop 2021-01-27T09:45:18.445 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.441+0000 7fc451610700 1 -- 172.21.15.146:0/3320042108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc44c147760 msgr2=0x7fc44c0692b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:18.445 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.441+0000 7fc451610700 1 --2- 172.21.15.146:0/3320042108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc44c147760 0x7fc44c0692b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fc444001560 tx=0x7fc4440015b0).stop 2021-01-27T09:45:18.446 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.441+0000 7fc451610700 1 -- 172.21.15.146:0/3320042108 shutdown_connections 2021-01-27T09:45:18.446 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.441+0000 7fc451610700 1 --2- 172.21.15.146:0/3320042108 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc42c0561e0 0x7fc42c0586a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:18.446 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.441+0000 7fc451610700 1 --2- 172.21.15.146:0/3320042108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc44c147760 0x7fc44c0692b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:18.446 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.441+0000 7fc451610700 1 --2- 172.21.15.146:0/3320042108 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc44c147380 0x7fc44c14f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:18.446 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.441+0000 7fc451610700 1 --2- 172.21.15.146:0/3320042108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc44c067550 0x7fc44c14e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:18.447 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.441+0000 7fc451610700 1 -- 172.21.15.146:0/3320042108 >> 172.21.15.146:0/3320042108 conn(0x7fc44c064240 msgr2=0x7fc44c1412c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:18.447 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.441+0000 7fc451610700 1 -- 172.21.15.146:0/3320042108 shutdown_connections 2021-01-27T09:45:18.447 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.441+0000 7fc451610700 1 -- 172.21.15.146:0/3320042108 wait complete. 2021-01-27T09:45:18.448 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 13 2021-01-27T09:45:18.474 INFO:tasks.mds_thrash:Ready to start thrashing 2021-01-27T09:45:18.474 INFO:tasks.mds_thrash.ceph_manager:waiting for clean 2021-01-27T09:45:18.475 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-01-27T09:45:18.635 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.633+0000 7f37d9781700 1 Processor -- start 2021-01-27T09:45:18.636 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.633+0000 7f37d9781700 1 -- start start 2021-01-27T09:45:18.638 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.633+0000 7f37d9781700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37d4151c60 0x7f37d4064cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:18.638 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.633+0000 7f37d9781700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37d40b1550 con 0x7f37d414b220 2021-01-27T09:45:18.638 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.633+0000 7f37d9781700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37d4064710 con 0x7f37d414b600 2021-01-27T09:45:18.639 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.633+0000 7f37d9781700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d40651a0 con 0x7f37d4151c60 2021-01-27T09:45:18.639 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.633+0000 7f37cbfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f37d414b600 0x7f37d4151540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46958/0 (socket says 172.21.15.146:46958) 2021-01-27T09:45:18.640 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.637+0000 7f37cbfff700 1 -- 172.21.15.146:0/851367672 learned_addr learned my addr 172.21.15.146:0/851367672 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:18.640 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.637+0000 7f37d37fe700 1 --2- 172.21.15.146:0/851367672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37d4151c60 0x7f37d4064cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:18.643 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.637+0000 7f37d27fc700 1 -- 172.21.15.146:0/851367672 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 636766849 0 0) 0x7f37d4064710 con 0x7f37d414b600 2021-01-27T09:45:18.643 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.637+0000 7f37d27fc700 1 -- 172.21.15.146:0/851367672 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37b4003270 con 0x7f37d414b600 2021-01-27T09:45:18.643 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.637+0000 7f37d37fe700 1 -- 172.21.15.146:0/851367672 >> v1:172.21.15.146:6789/0 conn(0x7f37d414b600 legacy=0x7f37d4151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:18.644 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.637+0000 7f37d37fe700 1 -- 172.21.15.146:0/851367672 >> v1:172.21.15.78:6789/0 conn(0x7f37d414b220 legacy=0x7f37d40be0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:18.644 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.637+0000 7f37d37fe700 1 -- 172.21.15.146:0/851367672 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d4065fa0 con 0x7f37d4151c60 2021-01-27T09:45:18.645 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.637+0000 7f37d37fe700 1 --2- 172.21.15.146:0/851367672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37d4151c60 0x7f37d4064cb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f37cc009cf0 tx=0x7f37cc009220).ready entity=mon.2 client_cookie=32aa4dddcb13d371 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:18.645 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.637+0000 7f37d27fc700 1 -- 172.21.15.146:0/851367672 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc00bad0 con 0x7f37d4151c60 2021-01-27T09:45:18.645 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.637+0000 7f37d27fc700 1 -- 172.21.15.146:0/851367672 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37cc00bc30 con 0x7f37d4151c60 2021-01-27T09:45:18.645 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.637+0000 7f37d27fc700 1 -- 172.21.15.146:0/851367672 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc011400 con 0x7f37d4151c60 2021-01-27T09:45:18.646 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.637+0000 7f37d9781700 1 -- 172.21.15.146:0/851367672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37d4151c60 msgr2=0x7f37d4064cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:18.646 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.637+0000 7f37d9781700 1 --2- 172.21.15.146:0/851367672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37d4151c60 0x7f37d4064cb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f37cc009cf0 tx=0x7f37cc009220).stop 2021-01-27T09:45:18.646 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.637+0000 7f37d9781700 1 -- 172.21.15.146:0/851367672 shutdown_connections 2021-01-27T09:45:18.647 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.637+0000 7f37d9781700 1 --2- 172.21.15.146:0/851367672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37d4151c60 0x7f37d4064cb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:18.647 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.637+0000 7f37d9781700 1 -- 172.21.15.146:0/851367672 >> 172.21.15.146:0/851367672 conn(0x7f37d4069110 msgr2=0x7f37d4067e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:18.647 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.637+0000 7f37d9781700 1 -- 172.21.15.146:0/851367672 shutdown_connections 2021-01-27T09:45:18.648 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.637+0000 7f37d9781700 1 -- 172.21.15.146:0/851367672 wait complete. 2021-01-27T09:45:18.648 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.641+0000 7f37d9781700 1 Processor -- start 2021-01-27T09:45:18.648 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.641+0000 7f37d9781700 1 -- start start 2021-01-27T09:45:18.651 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.641+0000 7f37d9781700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37d414b220 0x7f37d4161220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:18.651 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.641+0000 7f37d9781700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37d414b600 0x7f37d415dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:18.651 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.641+0000 7f37d9781700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37d4151c60 0x7f37d4149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:18.651 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.641+0000 7f37d9781700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d4161710 con 0x7f37d414b600 2021-01-27T09:45:18.652 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.641+0000 7f37d9781700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d40b8590 con 0x7f37d414b220 2021-01-27T09:45:18.652 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.641+0000 7f37d9781700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d40b8830 con 0x7f37d4151c60 2021-01-27T09:45:18.652 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.641+0000 7f37d2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37d414b220 0x7f37d4161220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:18.652 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.641+0000 7f37d2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37d414b220 0x7f37d4161220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47390/0 (socket says 172.21.15.146:47390) 2021-01-27T09:45:18.652 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.641+0000 7f37d2ffd700 1 -- 172.21.15.146:0/756751876 learned_addr learned my addr 172.21.15.146:0/756751876 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:18.653 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.641+0000 7f37cbfff700 1 --2- 172.21.15.146:0/756751876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37d414b600 0x7f37d415dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:18.653 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.641+0000 7f37d37fe700 1 --2- 172.21.15.146:0/756751876 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37d4151c60 0x7f37d4149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:18.653 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.645+0000 7f37d2ffd700 1 -- 172.21.15.146:0/756751876 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37d4151c60 msgr2=0x7f37d4149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:18.653 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.645+0000 7f37d2ffd700 1 --2- 172.21.15.146:0/756751876 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37d4151c60 0x7f37d4149e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:18.653 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.645+0000 7f37d2ffd700 1 -- 172.21.15.146:0/756751876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37d414b600 msgr2=0x7f37d415dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:18.654 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.645+0000 7f37d2ffd700 1 --2- 172.21.15.146:0/756751876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37d414b600 0x7f37d415dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:18.654 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.645+0000 7f37d2ffd700 1 -- 172.21.15.146:0/756751876 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d40b8ad0 con 0x7f37d414b220 2021-01-27T09:45:18.654 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.645+0000 7f37d37fe700 1 --2- 172.21.15.146:0/756751876 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37d4151c60 0x7f37d4149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:45:18.654 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.645+0000 7f37d2ffd700 1 --2- 172.21.15.146:0/756751876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37d414b220 0x7f37d4161220 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f37c400c710 tx=0x7f37c4007c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:18.654 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.645+0000 7f37caffd700 1 -- 172.21.15.146:0/756751876 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c4007020 con 0x7f37d414b220 2021-01-27T09:45:18.655 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.645+0000 7f37caffd700 1 -- 172.21.15.146:0/756751876 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c4007180 con 0x7f37d414b220 2021-01-27T09:45:18.655 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.645+0000 7f37d9781700 1 -- 172.21.15.146:0/756751876 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d415d270 con 0x7f37d414b220 2021-01-27T09:45:18.655 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.645+0000 7f37caffd700 1 -- 172.21.15.146:0/756751876 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c4006520 con 0x7f37d414b220 2021-01-27T09:45:18.655 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.645+0000 7f37d9781700 1 -- 172.21.15.146:0/756751876 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d415d7b0 con 0x7f37d414b220 2021-01-27T09:45:18.656 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.645+0000 7f37d9781700 1 -- 172.21.15.146:0/756751876 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d4044ee0 con 0x7f37d414b220 2021-01-27T09:45:18.656 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.645+0000 7f37caffd700 1 -- 172.21.15.146:0/756751876 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f37c4018020 con 0x7f37d414b220 2021-01-27T09:45:18.656 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.649+0000 7f37caffd700 1 --2- 172.21.15.146:0/756751876 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f37b80561e0 0x7f37b80586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:18.656 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.649+0000 7f37caffd700 1 -- 172.21.15.146:0/756751876 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f37c406ede0 con 0x7f37d414b220 2021-01-27T09:45:18.656 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.649+0000 7f37cbfff700 1 --2- 172.21.15.146:0/756751876 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f37b80561e0 0x7f37b80586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:18.657 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.649+0000 7f37cbfff700 1 --2- 172.21.15.146:0/756751876 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f37b80561e0 0x7f37b80586a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f37d4065a10 tx=0x7f37bc009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:18.657 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.653+0000 7f37caffd700 1 -- 172.21.15.146:0/756751876 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f37c4044490 con 0x7f37d414b220 2021-01-27T09:45:18.792 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.789+0000 7f37d9781700 1 -- 172.21.15.146:0/756751876 --> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f37d415e140 con 0x7f37b80561e0 2021-01-27T09:45:18.802 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.801+0000 7f37caffd700 1 -- 172.21.15.146:0/756751876 <== mgr.4104 v2:172.21.15.78:6832/15486 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+101232 (secure 0 0 0) 0x7f37d415e140 con 0x7f37b80561e0 2021-01-27T09:45:18.804 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:45:18.805 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.801+0000 7f37d9781700 1 -- 172.21.15.146:0/756751876 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f37b80561e0 msgr2=0x7f37b80586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:18.805 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.801+0000 7f37d9781700 1 --2- 172.21.15.146:0/756751876 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f37b80561e0 0x7f37b80586a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f37d4065a10 tx=0x7f37bc009040).stop 2021-01-27T09:45:18.806 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.801+0000 7f37d9781700 1 -- 172.21.15.146:0/756751876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37d414b220 msgr2=0x7f37d4161220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:18.806 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.801+0000 7f37d9781700 1 --2- 172.21.15.146:0/756751876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37d414b220 0x7f37d4161220 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f37c400c710 tx=0x7f37c4007c80).stop 2021-01-27T09:45:18.806 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.801+0000 7f37d9781700 1 -- 172.21.15.146:0/756751876 shutdown_connections 2021-01-27T09:45:18.806 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.801+0000 7f37d9781700 1 --2- 172.21.15.146:0/756751876 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37d4151c60 0x7f37d4149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.801+0000 7f37d9781700 1 --2- 172.21.15.146:0/756751876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37d414b600 0x7f37d415dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.801+0000 7f37d9781700 1 --2- 172.21.15.146:0/756751876 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f37b80561e0 0x7f37b80586a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.801+0000 7f37d9781700 1 --2- 172.21.15.146:0/756751876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37d414b220 0x7f37d4161220 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.801+0000 7f37d9781700 1 -- 172.21.15.146:0/756751876 >> 172.21.15.146:0/756751876 conn(0x7f37d4069110 msgr2=0x7f37d414e530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:18.808 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.805+0000 7f37d9781700 1 -- 172.21.15.146:0/756751876 shutdown_connections 2021-01-27T09:45:18.809 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.805+0000 7f37d9781700 1 -- 172.21.15.146:0/756751876 wait complete. 2021-01-27T09:45:18.809 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2021-01-27T09:45:18.833 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2021-01-27T09:45:18.455767+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7669,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41620,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":754933100,"statfs":{"total":773094113280,"available":773051494400,"internally_reserved":0,"allocated":2314240,"data_stored":915036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1315,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004129"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.369789+0000","last_change":"2021-01-27T09:44:26.437753+0000","last_active":"2021-01-27T09:44:33.369789+0000","last_peered":"2021-01-27T09:44:33.369789+0000","last_clean":"2021-01-27T09:44:33.369789+0000","last_became_active":"2021-01-27T09:44:26.437402+0000","last_became_peered":"2021-01-27T09:44:26.437402+0000","last_unstale":"2021-01-27T09:44:33.369789+0000","last_undegraded":"2021-01-27T09:44:33.369789+0000","last_fullsized":"2021-01-27T09:44:33.369789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'9","reported_seq":"23","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.616159+0000","last_change":"2021-01-27T09:44:28.931645+0000","last_active":"2021-01-27T09:44:51.616159+0000","last_peered":"2021-01-27T09:44:51.616159+0000","last_clean":"2021-01-27T09:44:51.616159+0000","last_became_active":"2021-01-27T09:44:28.931347+0000","last_became_peered":"2021-01-27T09:44:28.931347+0000","last_unstale":"2021-01-27T09:44:51.616159+0000","last_undegraded":"2021-01-27T09:44:51.616159+0000","last_fullsized":"2021-01-27T09:44:51.616159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.364949+0000","last_change":"2021-01-27T09:44:29.336652+0000","last_active":"2021-01-27T09:44:33.364949+0000","last_peered":"2021-01-27T09:44:33.364949+0000","last_clean":"2021-01-27T09:44:33.364949+0000","last_became_active":"2021-01-27T09:44:29.336207+0000","last_became_peered":"2021-01-27T09:44:29.336207+0000","last_unstale":"2021-01-27T09:44:33.364949+0000","last_undegraded":"2021-01-27T09:44:33.364949+0000","last_fullsized":"2021-01-27T09:44:33.364949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.382353+0000","last_change":"2021-01-27T09:44:33.381360+0000","last_active":"2021-01-27T09:44:33.382353+0000","last_peered":"2021-01-27T09:44:33.382353+0000","last_clean":"2021-01-27T09:44:33.382353+0000","last_became_active":"2021-01-27T09:44:33.380037+0000","last_became_peered":"2021-01-27T09:44:33.380037+0000","last_unstale":"2021-01-27T09:44:33.382353+0000","last_undegraded":"2021-01-27T09:44:33.382353+0000","last_fullsized":"2021-01-27T09:44:33.382353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"17","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.372796+0000","last_change":"2021-01-27T09:44:26.436242+0000","last_active":"2021-01-27T09:44:33.372796+0000","last_peered":"2021-01-27T09:44:33.372796+0000","last_clean":"2021-01-27T09:44:33.372796+0000","last_became_active":"2021-01-27T09:44:26.435467+0000","last_became_peered":"2021-01-27T09:44:26.435467+0000","last_unstale":"2021-01-27T09:44:33.372796+0000","last_undegraded":"2021-01-27T09:44:33.372796+0000","last_fullsized":"2021-01-27T09:44:33.372796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'17","reported_seq":"31","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.618737+0000","last_change":"2021-01-27T09:44:28.934250+0000","last_active":"2021-01-27T09:44:51.618737+0000","last_peered":"2021-01-27T09:44:51.618737+0000","last_clean":"2021-01-27T09:44:51.618737+0000","last_became_active":"2021-01-27T09:44:28.933897+0000","last_became_peered":"2021-01-27T09:44:28.933897+0000","last_unstale":"2021-01-27T09:44:51.618737+0000","last_undegraded":"2021-01-27T09:44:51.618737+0000","last_fullsized":"2021-01-27T09:44:51.618737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":666,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.374140+0000","last_change":"2021-01-27T09:44:29.341412+0000","last_active":"2021-01-27T09:44:33.374140+0000","last_peered":"2021-01-27T09:44:33.374140+0000","last_clean":"2021-01-27T09:44:33.374140+0000","last_became_active":"2021-01-27T09:44:29.341016+0000","last_became_peered":"2021-01-27T09:44:29.341016+0000","last_unstale":"2021-01-27T09:44:33.374140+0000","last_undegraded":"2021-01-27T09:44:33.374140+0000","last_fullsized":"2021-01-27T09:44:33.374140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.380375+0000","last_change":"2021-01-27T09:44:33.378505+0000","last_active":"2021-01-27T09:44:33.380375+0000","last_peered":"2021-01-27T09:44:33.380375+0000","last_clean":"2021-01-27T09:44:33.380375+0000","last_became_active":"2021-01-27T09:44:33.377285+0000","last_became_peered":"2021-01-27T09:44:33.377285+0000","last_unstale":"2021-01-27T09:44:33.380375+0000","last_undegraded":"2021-01-27T09:44:33.380375+0000","last_fullsized":"2021-01-27T09:44:33.380375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368923+0000","last_change":"2021-01-27T09:44:25.841172+0000","last_active":"2021-01-27T09:44:33.368923+0000","last_peered":"2021-01-27T09:44:33.368923+0000","last_clean":"2021-01-27T09:44:33.368923+0000","last_became_active":"2021-01-27T09:44:25.840711+0000","last_became_peered":"2021-01-27T09:44:25.840711+0000","last_unstale":"2021-01-27T09:44:33.368923+0000","last_undegraded":"2021-01-27T09:44:33.368923+0000","last_fullsized":"2021-01-27T09:44:33.368923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'19","reported_seq":"33","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:45:13.556437+0000","last_change":"2021-01-27T09:44:28.932871+0000","last_active":"2021-01-27T09:45:13.556437+0000","last_peered":"2021-01-27T09:45:13.556437+0000","last_clean":"2021-01-27T09:45:13.556437+0000","last_became_active":"2021-01-27T09:44:28.932513+0000","last_became_peered":"2021-01-27T09:44:28.932513+0000","last_unstale":"2021-01-27T09:45:13.556437+0000","last_undegraded":"2021-01-27T09:45:13.556437+0000","last_fullsized":"2021-01-27T09:45:13.556437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4529,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.366893+0000","last_change":"2021-01-27T09:44:29.350508+0000","last_active":"2021-01-27T09:44:33.366893+0000","last_peered":"2021-01-27T09:44:33.366893+0000","last_clean":"2021-01-27T09:44:33.366893+0000","last_became_active":"2021-01-27T09:44:29.350179+0000","last_became_peered":"2021-01-27T09:44:29.350179+0000","last_unstale":"2021-01-27T09:44:33.366893+0000","last_undegraded":"2021-01-27T09:44:33.366893+0000","last_fullsized":"2021-01-27T09:44:33.366893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.442441+0000","last_change":"2021-01-27T09:44:33.441051+0000","last_active":"2021-01-27T09:44:33.442441+0000","last_peered":"2021-01-27T09:44:33.442441+0000","last_clean":"2021-01-27T09:44:33.442441+0000","last_became_active":"2021-01-27T09:44:33.439809+0000","last_became_peered":"2021-01-27T09:44:33.439809+0000","last_unstale":"2021-01-27T09:44:33.442441+0000","last_undegraded":"2021-01-27T09:44:33.442441+0000","last_fullsized":"2021-01-27T09:44:33.442441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"17","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.437810+0000","last_change":"2021-01-27T09:44:26.405089+0000","last_active":"2021-01-27T09:44:33.437810+0000","last_peered":"2021-01-27T09:44:33.437810+0000","last_clean":"2021-01-27T09:44:33.437810+0000","last_became_active":"2021-01-27T09:44:26.403537+0000","last_became_peered":"2021-01-27T09:44:26.403537+0000","last_unstale":"2021-01-27T09:44:33.437810+0000","last_undegraded":"2021-01-27T09:44:33.437810+0000","last_fullsized":"2021-01-27T09:44:33.437810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'10","reported_seq":"23","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.617676+0000","last_change":"2021-01-27T09:44:28.932480+0000","last_active":"2021-01-27T09:44:51.617676+0000","last_peered":"2021-01-27T09:44:51.617676+0000","last_clean":"2021-01-27T09:44:51.617676+0000","last_became_active":"2021-01-27T09:44:28.932127+0000","last_became_peered":"2021-01-27T09:44:28.932127+0000","last_unstale":"2021-01-27T09:44:51.617676+0000","last_undegraded":"2021-01-27T09:44:51.617676+0000","last_fullsized":"2021-01-27T09:44:51.617676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":736,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.366915+0000","last_change":"2021-01-27T09:44:29.338414+0000","last_active":"2021-01-27T09:44:33.366915+0000","last_peered":"2021-01-27T09:44:33.366915+0000","last_clean":"2021-01-27T09:44:33.366915+0000","last_became_active":"2021-01-27T09:44:29.337813+0000","last_became_peered":"2021-01-27T09:44:29.337813+0000","last_unstale":"2021-01-27T09:44:33.366915+0000","last_undegraded":"2021-01-27T09:44:33.366915+0000","last_fullsized":"2021-01-27T09:44:33.366915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.448516+0000","last_change":"2021-01-27T09:44:33.442248+0000","last_active":"2021-01-27T09:44:33.448516+0000","last_peered":"2021-01-27T09:44:33.448516+0000","last_clean":"2021-01-27T09:44:33.448516+0000","last_became_active":"2021-01-27T09:44:33.440410+0000","last_became_peered":"2021-01-27T09:44:33.440410+0000","last_unstale":"2021-01-27T09:44:33.448516+0000","last_undegraded":"2021-01-27T09:44:33.448516+0000","last_fullsized":"2021-01-27T09:44:33.448516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.442528+0000","last_change":"2021-01-27T09:44:33.441395+0000","last_active":"2021-01-27T09:44:33.442528+0000","last_peered":"2021-01-27T09:44:33.442528+0000","last_clean":"2021-01-27T09:44:33.442528+0000","last_became_active":"2021-01-27T09:44:33.440377+0000","last_became_peered":"2021-01-27T09:44:33.440377+0000","last_unstale":"2021-01-27T09:44:33.442528+0000","last_undegraded":"2021-01-27T09:44:33.442528+0000","last_fullsized":"2021-01-27T09:44:33.442528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"26'18","reported_seq":"31","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.608717+0000","last_change":"2021-01-27T09:44:28.929059+0000","last_active":"2021-01-27T09:44:51.608717+0000","last_peered":"2021-01-27T09:44:51.608717+0000","last_clean":"2021-01-27T09:44:51.608717+0000","last_became_active":"2021-01-27T09:44:28.928444+0000","last_became_peered":"2021-01-27T09:44:28.928444+0000","last_unstale":"2021-01-27T09:44:51.608717+0000","last_undegraded":"2021-01-27T09:44:51.608717+0000","last_fullsized":"2021-01-27T09:44:51.608717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":642,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368690+0000","last_change":"2021-01-27T09:44:26.403671+0000","last_active":"2021-01-27T09:44:33.368690+0000","last_peered":"2021-01-27T09:44:33.368690+0000","last_clean":"2021-01-27T09:44:33.368690+0000","last_became_active":"2021-01-27T09:44:26.403137+0000","last_became_peered":"2021-01-27T09:44:26.403137+0000","last_unstale":"2021-01-27T09:44:33.368690+0000","last_undegraded":"2021-01-27T09:44:33.368690+0000","last_fullsized":"2021-01-27T09:44:33.368690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.367795+0000","last_change":"2021-01-27T09:44:29.347824+0000","last_active":"2021-01-27T09:44:33.367795+0000","last_peered":"2021-01-27T09:44:33.367795+0000","last_clean":"2021-01-27T09:44:33.367795+0000","last_became_active":"2021-01-27T09:44:29.347463+0000","last_became_peered":"2021-01-27T09:44:29.347463+0000","last_unstale":"2021-01-27T09:44:33.367795+0000","last_undegraded":"2021-01-27T09:44:33.367795+0000","last_fullsized":"2021-01-27T09:44:33.367795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.443462+0000","last_change":"2021-01-27T09:44:33.441988+0000","last_active":"2021-01-27T09:44:33.443462+0000","last_peered":"2021-01-27T09:44:33.443462+0000","last_clean":"2021-01-27T09:44:33.443462+0000","last_became_active":"2021-01-27T09:44:33.440172+0000","last_became_peered":"2021-01-27T09:44:33.440172+0000","last_unstale":"2021-01-27T09:44:33.443462+0000","last_undegraded":"2021-01-27T09:44:33.443462+0000","last_fullsized":"2021-01-27T09:44:33.443462+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"26'21","reported_seq":"35","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.618079+0000","last_change":"2021-01-27T09:44:28.930780+0000","last_active":"2021-01-27T09:44:51.618079+0000","last_peered":"2021-01-27T09:44:51.618079+0000","last_clean":"2021-01-27T09:44:51.618079+0000","last_became_active":"2021-01-27T09:44:28.930374+0000","last_became_peered":"2021-01-27T09:44:28.930374+0000","last_unstale":"2021-01-27T09:44:51.618079+0000","last_undegraded":"2021-01-27T09:44:51.618079+0000","last_fullsized":"2021-01-27T09:44:51.618079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":112,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"17","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.372343+0000","last_change":"2021-01-27T09:44:25.838965+0000","last_active":"2021-01-27T09:44:33.372343+0000","last_peered":"2021-01-27T09:44:33.372343+0000","last_clean":"2021-01-27T09:44:33.372343+0000","last_became_active":"2021-01-27T09:44:25.838635+0000","last_became_peered":"2021-01-27T09:44:25.838635+0000","last_unstale":"2021-01-27T09:44:33.372343+0000","last_undegraded":"2021-01-27T09:44:33.372343+0000","last_fullsized":"2021-01-27T09:44:33.372343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.367109+0000","last_change":"2021-01-27T09:44:29.348218+0000","last_active":"2021-01-27T09:44:33.367109+0000","last_peered":"2021-01-27T09:44:33.367109+0000","last_clean":"2021-01-27T09:44:33.367109+0000","last_became_active":"2021-01-27T09:44:29.347905+0000","last_became_peered":"2021-01-27T09:44:29.347905+0000","last_unstale":"2021-01-27T09:44:33.367109+0000","last_undegraded":"2021-01-27T09:44:33.367109+0000","last_fullsized":"2021-01-27T09:44:33.367109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.380414+0000","last_change":"2021-01-27T09:44:33.378828+0000","last_active":"2021-01-27T09:44:33.380414+0000","last_peered":"2021-01-27T09:44:33.380414+0000","last_clean":"2021-01-27T09:44:33.380414+0000","last_became_active":"2021-01-27T09:44:33.376984+0000","last_became_peered":"2021-01-27T09:44:33.376984+0000","last_unstale":"2021-01-27T09:44:33.380414+0000","last_undegraded":"2021-01-27T09:44:33.380414+0000","last_fullsized":"2021-01-27T09:44:33.380414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"26'14","reported_seq":"28","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:45:13.254443+0000","last_change":"2021-01-27T09:44:28.933091+0000","last_active":"2021-01-27T09:45:13.254443+0000","last_peered":"2021-01-27T09:45:13.254443+0000","last_clean":"2021-01-27T09:45:13.254443+0000","last_became_active":"2021-01-27T09:44:28.932701+0000","last_became_peered":"2021-01-27T09:44:28.932701+0000","last_unstale":"2021-01-27T09:45:13.254443+0000","last_undegraded":"2021-01-27T09:45:13.254443+0000","last_fullsized":"2021-01-27T09:45:13.254443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":984,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368552+0000","last_change":"2021-01-27T09:44:25.737081+0000","last_active":"2021-01-27T09:44:33.368552+0000","last_peered":"2021-01-27T09:44:33.368552+0000","last_clean":"2021-01-27T09:44:33.368552+0000","last_became_active":"2021-01-27T09:44:25.736516+0000","last_became_peered":"2021-01-27T09:44:25.736516+0000","last_unstale":"2021-01-27T09:44:33.368552+0000","last_undegraded":"2021-01-27T09:44:33.368552+0000","last_fullsized":"2021-01-27T09:44:33.368552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.437701+0000","last_change":"2021-01-27T09:44:29.347815+0000","last_active":"2021-01-27T09:44:33.437701+0000","last_peered":"2021-01-27T09:44:33.437701+0000","last_clean":"2021-01-27T09:44:33.437701+0000","last_became_active":"2021-01-27T09:44:29.347415+0000","last_became_peered":"2021-01-27T09:44:29.347415+0000","last_unstale":"2021-01-27T09:44:33.437701+0000","last_undegraded":"2021-01-27T09:44:33.437701+0000","last_fullsized":"2021-01-27T09:44:33.437701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.437850+0000","last_change":"2021-01-27T09:44:33.436705+0000","last_active":"2021-01-27T09:44:33.437850+0000","last_peered":"2021-01-27T09:44:33.437850+0000","last_clean":"2021-01-27T09:44:33.437850+0000","last_became_active":"2021-01-27T09:44:33.435975+0000","last_became_peered":"2021-01-27T09:44:33.435975+0000","last_unstale":"2021-01-27T09:44:33.437850+0000","last_undegraded":"2021-01-27T09:44:33.437850+0000","last_fullsized":"2021-01-27T09:44:33.437850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'8","reported_seq":"22","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.612586+0000","last_change":"2021-01-27T09:44:28.930455+0000","last_active":"2021-01-27T09:44:51.612586+0000","last_peered":"2021-01-27T09:44:51.612586+0000","last_clean":"2021-01-27T09:44:51.612586+0000","last_became_active":"2021-01-27T09:44:28.930088+0000","last_became_peered":"2021-01-27T09:44:28.930088+0000","last_unstale":"2021-01-27T09:44:51.612586+0000","last_undegraded":"2021-01-27T09:44:51.612586+0000","last_fullsized":"2021-01-27T09:44:51.612586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368647+0000","last_change":"2021-01-27T09:44:25.736301+0000","last_active":"2021-01-27T09:44:33.368647+0000","last_peered":"2021-01-27T09:44:33.368647+0000","last_clean":"2021-01-27T09:44:33.368647+0000","last_became_active":"2021-01-27T09:44:25.735741+0000","last_became_peered":"2021-01-27T09:44:25.735741+0000","last_unstale":"2021-01-27T09:44:33.368647+0000","last_undegraded":"2021-01-27T09:44:33.368647+0000","last_fullsized":"2021-01-27T09:44:33.368647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"20","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.432653+0000","last_change":"2021-01-27T09:44:24.570544+0000","last_active":"2021-01-27T09:44:33.432653+0000","last_peered":"2021-01-27T09:44:33.432653+0000","last_clean":"2021-01-27T09:44:33.432653+0000","last_became_active":"2021-01-27T09:44:24.569755+0000","last_became_peered":"2021-01-27T09:44:24.569755+0000","last_unstale":"2021-01-27T09:44:33.432653+0000","last_undegraded":"2021-01-27T09:44:33.432653+0000","last_fullsized":"2021-01-27T09:44:33.432653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:19.429176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:19.429176+0000","last_clean_scrub_stamp":"2021-01-27T09:44:19.429176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368821+0000","last_change":"2021-01-27T09:44:29.337716+0000","last_active":"2021-01-27T09:44:33.368821+0000","last_peered":"2021-01-27T09:44:33.368821+0000","last_clean":"2021-01-27T09:44:33.368821+0000","last_became_active":"2021-01-27T09:44:29.337355+0000","last_became_peered":"2021-01-27T09:44:29.337355+0000","last_unstale":"2021-01-27T09:44:33.368821+0000","last_undegraded":"2021-01-27T09:44:33.368821+0000","last_fullsized":"2021-01-27T09:44:33.368821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":7669,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5136,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366704,"statfs":{"total":96636764160,"available":96631504896,"internally_reserved":0,"allocated":270336,"data_stored":112757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7650000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0579999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8639999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.714}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1360000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5240,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366600,"statfs":{"total":96636764160,"available":96631398400,"internally_reserved":0,"allocated":311296,"data_stored":114333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6839999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.764}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2879999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4420000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6619999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.343}]}]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5136,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366704,"statfs":{"total":96636764160,"available":96631504896,"internally_reserved":0,"allocated":270336,"data_stored":112757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1190000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.98}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8170000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2889999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.762}]}]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5148,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366692,"statfs":{"total":96636764160,"available":96631492608,"internally_reserved":0,"allocated":282624,"data_stored":112613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7969999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0379999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.552}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.855}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.093}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0899999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5204,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366636,"statfs":{"total":96636764160,"available":96631435264,"internally_reserved":0,"allocated":274432,"data_stored":112083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.369}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8520000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5619999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.919}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0449999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":119672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.532}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7749999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0150000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.869}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4239999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3170000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5224,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366616,"statfs":{"total":96636764160,"available":96631414784,"internally_reserved":0,"allocated":294912,"data_stored":117398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.75}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2320000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1440000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9470000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8969999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7639999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5212,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366628,"statfs":{"total":96636764160,"available":96631427072,"internally_reserved":0,"allocated":282624,"data_stored":113423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2890000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7010000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.944}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5019999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4220000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.792}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.25}]}]}]}} 2021-01-27T09:45:18.836 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-01-27T09:45:19.001 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.997+0000 7f5048146700 1 Processor -- start 2021-01-27T09:45:19.002 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:18.997+0000 7f5048146700 1 -- start start 2021-01-27T09:45:19.007 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.001+0000 7f5048146700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50400b7880 0x7f504014a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:19.007 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.001+0000 7f5048146700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f50400b8150 0x7f504014ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:19.007 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.001+0000 7f5048146700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50400b97b0 con 0x7f50400bea30 2021-01-27T09:45:19.008 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.001+0000 7f5048146700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50400b99e0 con 0x7f50400b8150 2021-01-27T09:45:19.008 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.001+0000 7f5048146700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50400b9c80 con 0x7f50400b7880 2021-01-27T09:45:19.009 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.001+0000 7f5045ee2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50400b7880 0x7f504014a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:19.009 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.001+0000 7f5045ee2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50400b7880 0x7f504014a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36884/0 (socket says 172.21.15.146:36884) 2021-01-27T09:45:19.010 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.001+0000 7f5045ee2700 1 -- 172.21.15.146:0/3625796004 learned_addr learned my addr 172.21.15.146:0/3625796004 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:19.010 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.001+0000 7f50466e3700 1 --1- 172.21.15.146:0/3625796004 >> v1:172.21.15.146:6789/0 conn(0x7f50400bea30 0x7f50401474a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46974/0 (socket says 172.21.15.146:46974) 2021-01-27T09:45:19.011 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.001+0000 7f50456e1700 1 --2- 172.21.15.146:0/3625796004 >> v2:172.21.15.78:3300/0 conn(0x7f50400b8150 0x7f504014ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:19.011 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.005+0000 7f5045ee2700 1 -- 172.21.15.146:0/3625796004 >> v2:172.21.15.78:3300/0 conn(0x7f50400b8150 msgr2=0x7f504014ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:19.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.005+0000 7f5045ee2700 1 --2- 172.21.15.146:0/3625796004 >> v2:172.21.15.78:3300/0 conn(0x7f50400b8150 0x7f504014ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.005+0000 7f5045ee2700 1 -- 172.21.15.146:0/3625796004 >> v1:172.21.15.146:6789/0 conn(0x7f50400bea30 legacy=0x7f50401474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:19.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.005+0000 7f5044ee0700 1 -- 172.21.15.146:0/3625796004 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968034958 0 0) 0x7f50400b97b0 con 0x7f50400bea30 2021-01-27T09:45:19.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.005+0000 7f5045ee2700 1 -- 172.21.15.146:0/3625796004 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50400b9f20 con 0x7f50400b7880 2021-01-27T09:45:19.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.005+0000 7f5045ee2700 1 --2- 172.21.15.146:0/3625796004 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50400b7880 0x7f504014a990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f503c00ba20 tx=0x7f503c006ee0).ready entity=mon.2 client_cookie=67043344ed74d2dc server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:19.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.005+0000 7f5044ee0700 1 -- 172.21.15.146:0/3625796004 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c0098d0 con 0x7f50400b7880 2021-01-27T09:45:19.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.005+0000 7f5044ee0700 1 -- 172.21.15.146:0/3625796004 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c009a30 con 0x7f50400b7880 2021-01-27T09:45:19.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.005+0000 7f5044ee0700 1 -- 172.21.15.146:0/3625796004 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c009db0 con 0x7f50400b7880 2021-01-27T09:45:19.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.005+0000 7f5048146700 1 -- 172.21.15.146:0/3625796004 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50400b7880 msgr2=0x7f504014a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:19.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.005+0000 7f5048146700 1 --2- 172.21.15.146:0/3625796004 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50400b7880 0x7f504014a990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f503c00ba20 tx=0x7f503c006ee0).stop 2021-01-27T09:45:19.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.005+0000 7f5048146700 1 -- 172.21.15.146:0/3625796004 shutdown_connections 2021-01-27T09:45:19.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.005+0000 7f5048146700 1 --2- 172.21.15.146:0/3625796004 >> v2:172.21.15.78:3300/0 conn(0x7f50400b8150 0x7f504014ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.005+0000 7f5048146700 1 --2- 172.21.15.146:0/3625796004 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50400b7880 0x7f504014a990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.005+0000 7f5048146700 1 -- 172.21.15.146:0/3625796004 >> 172.21.15.146:0/3625796004 conn(0x7f5040069110 msgr2=0x7f5040067e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:19.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.005+0000 7f5048146700 1 -- 172.21.15.146:0/3625796004 shutdown_connections 2021-01-27T09:45:19.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.005+0000 7f5048146700 1 -- 172.21.15.146:0/3625796004 wait complete. 2021-01-27T09:45:19.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.009+0000 7f5048146700 1 Processor -- start 2021-01-27T09:45:19.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.009+0000 7f5048146700 1 -- start start 2021-01-27T09:45:19.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.009+0000 7f5048146700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50400b7880 0x7f50400bc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:19.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.009+0000 7f5048146700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50400b8150 0x7f50400b6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:19.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.009+0000 7f5048146700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50400bea30 0x7f504015dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:19.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.009+0000 7f5048146700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504015d5c0 con 0x7f50400b7880 2021-01-27T09:45:19.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.009+0000 7f5048146700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504014ccc0 con 0x7f50400b8150 2021-01-27T09:45:19.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.009+0000 7f5048146700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504014cf60 con 0x7f50400bea30 2021-01-27T09:45:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.009+0000 7f50456e1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50400b8150 0x7f50400b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.009+0000 7f50456e1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50400b8150 0x7f50400b6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47406/0 (socket says 172.21.15.146:47406) 2021-01-27T09:45:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.009+0000 7f50456e1700 1 -- 172.21.15.146:0/1179114598 learned_addr learned my addr 172.21.15.146:0/1179114598 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.009+0000 7f5045ee2700 1 --2- 172.21.15.146:0/1179114598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50400b7880 0x7f50400bc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.009+0000 7f50466e3700 1 --2- 172.21.15.146:0/1179114598 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50400bea30 0x7f504015dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:19.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.013+0000 7f50456e1700 1 -- 172.21.15.146:0/1179114598 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50400bea30 msgr2=0x7f504015dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:19.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.013+0000 7f50456e1700 1 --2- 172.21.15.146:0/1179114598 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50400bea30 0x7f504015dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.013+0000 7f50456e1700 1 -- 172.21.15.146:0/1179114598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50400b7880 msgr2=0x7f50400bc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:19.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.013+0000 7f50456e1700 1 --2- 172.21.15.146:0/1179114598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50400b7880 0x7f50400bc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.013+0000 7f50456e1700 1 -- 172.21.15.146:0/1179114598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504014d200 con 0x7f50400b8150 2021-01-27T09:45:19.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.013+0000 7f50466e3700 1 --2- 172.21.15.146:0/1179114598 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50400bea30 0x7f504015dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:45:19.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.013+0000 7f50456e1700 1 --2- 172.21.15.146:0/1179114598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50400b8150 0x7f50400b6840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f503000db30 tx=0x7f5030008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:19.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.013+0000 7f502dffb700 1 -- 172.21.15.146:0/1179114598 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50300097f0 con 0x7f50400b8150 2021-01-27T09:45:19.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.013+0000 7f502dffb700 1 -- 172.21.15.146:0/1179114598 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5030009950 con 0x7f50400b8150 2021-01-27T09:45:19.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.013+0000 7f502dffb700 1 -- 172.21.15.146:0/1179114598 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030009cf0 con 0x7f50400b8150 2021-01-27T09:45:19.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.013+0000 7f5048146700 1 -- 172.21.15.146:0/1179114598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504014d4a0 con 0x7f50400b8150 2021-01-27T09:45:19.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.013+0000 7f5048146700 1 -- 172.21.15.146:0/1179114598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504015d7b0 con 0x7f50400b8150 2021-01-27T09:45:19.023 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.013+0000 7f5048146700 1 -- 172.21.15.146:0/1179114598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f504014d940 con 0x7f50400b8150 2021-01-27T09:45:19.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.013+0000 7f502dffb700 1 -- 172.21.15.146:0/1179114598 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f5030013690 con 0x7f50400b8150 2021-01-27T09:45:19.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.017+0000 7f502dffb700 1 --2- 172.21.15.146:0/1179114598 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f50200561e0 0x7f50200586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:19.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.017+0000 7f502dffb700 1 -- 172.21.15.146:0/1179114598 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f503006f7f0 con 0x7f50400b8150 2021-01-27T09:45:19.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.017+0000 7f5045ee2700 1 --2- 172.21.15.146:0/1179114598 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f50200561e0 0x7f50200586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:19.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.017+0000 7f5045ee2700 1 --2- 172.21.15.146:0/1179114598 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f50200561e0 0x7f50200586a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f503c006f20 tx=0x7f503c016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:19.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.021+0000 7f502dffb700 1 -- 172.21.15.146:0/1179114598 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f5030044ea0 con 0x7f50400b8150 2021-01-27T09:45:19.163 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.161+0000 7f5048146700 1 -- 172.21.15.146:0/1179114598 --> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f50400bdc80 con 0x7f50200561e0 2021-01-27T09:45:19.172 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.169+0000 7f502dffb700 1 -- 172.21.15.146:0/1179114598 <== mgr.4104 v2:172.21.15.78:6832/15486 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+101232 (secure 0 0 0) 0x7f50400bdc80 con 0x7f50200561e0 2021-01-27T09:45:19.174 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:45:19.176 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.173+0000 7f5048146700 1 -- 172.21.15.146:0/1179114598 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f50200561e0 msgr2=0x7f50200586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:19.177 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.173+0000 7f5048146700 1 --2- 172.21.15.146:0/1179114598 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f50200561e0 0x7f50200586a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f503c006f20 tx=0x7f503c016000).stop 2021-01-27T09:45:19.177 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.173+0000 7f5048146700 1 -- 172.21.15.146:0/1179114598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50400b8150 msgr2=0x7f50400b6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:19.177 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.173+0000 7f5048146700 1 --2- 172.21.15.146:0/1179114598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50400b8150 0x7f50400b6840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f503000db30 tx=0x7f5030008040).stop 2021-01-27T09:45:19.177 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.173+0000 7f5048146700 1 -- 172.21.15.146:0/1179114598 shutdown_connections 2021-01-27T09:45:19.178 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.173+0000 7f5048146700 1 --2- 172.21.15.146:0/1179114598 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f50400bea30 0x7f504015dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.178 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.173+0000 7f5048146700 1 --2- 172.21.15.146:0/1179114598 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f50200561e0 0x7f50200586a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.178 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.173+0000 7f5048146700 1 --2- 172.21.15.146:0/1179114598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50400b8150 0x7f50400b6840 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.178 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.173+0000 7f5048146700 1 --2- 172.21.15.146:0/1179114598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50400b7880 0x7f50400bc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.179 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.173+0000 7f5048146700 1 -- 172.21.15.146:0/1179114598 >> 172.21.15.146:0/1179114598 conn(0x7f5040069110 msgr2=0x7f504014a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:19.179 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.173+0000 7f5048146700 1 -- 172.21.15.146:0/1179114598 shutdown_connections 2021-01-27T09:45:19.179 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.173+0000 7f5048146700 1 -- 172.21.15.146:0/1179114598 wait complete. 2021-01-27T09:45:19.180 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2021-01-27T09:45:19.202 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2021-01-27T09:45:18.455767+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7669,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41620,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":754933100,"statfs":{"total":773094113280,"available":773051494400,"internally_reserved":0,"allocated":2314240,"data_stored":915036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1315,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004129"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.369789+0000","last_change":"2021-01-27T09:44:26.437753+0000","last_active":"2021-01-27T09:44:33.369789+0000","last_peered":"2021-01-27T09:44:33.369789+0000","last_clean":"2021-01-27T09:44:33.369789+0000","last_became_active":"2021-01-27T09:44:26.437402+0000","last_became_peered":"2021-01-27T09:44:26.437402+0000","last_unstale":"2021-01-27T09:44:33.369789+0000","last_undegraded":"2021-01-27T09:44:33.369789+0000","last_fullsized":"2021-01-27T09:44:33.369789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'9","reported_seq":"23","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.616159+0000","last_change":"2021-01-27T09:44:28.931645+0000","last_active":"2021-01-27T09:44:51.616159+0000","last_peered":"2021-01-27T09:44:51.616159+0000","last_clean":"2021-01-27T09:44:51.616159+0000","last_became_active":"2021-01-27T09:44:28.931347+0000","last_became_peered":"2021-01-27T09:44:28.931347+0000","last_unstale":"2021-01-27T09:44:51.616159+0000","last_undegraded":"2021-01-27T09:44:51.616159+0000","last_fullsized":"2021-01-27T09:44:51.616159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.364949+0000","last_change":"2021-01-27T09:44:29.336652+0000","last_active":"2021-01-27T09:44:33.364949+0000","last_peered":"2021-01-27T09:44:33.364949+0000","last_clean":"2021-01-27T09:44:33.364949+0000","last_became_active":"2021-01-27T09:44:29.336207+0000","last_became_peered":"2021-01-27T09:44:29.336207+0000","last_unstale":"2021-01-27T09:44:33.364949+0000","last_undegraded":"2021-01-27T09:44:33.364949+0000","last_fullsized":"2021-01-27T09:44:33.364949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.382353+0000","last_change":"2021-01-27T09:44:33.381360+0000","last_active":"2021-01-27T09:44:33.382353+0000","last_peered":"2021-01-27T09:44:33.382353+0000","last_clean":"2021-01-27T09:44:33.382353+0000","last_became_active":"2021-01-27T09:44:33.380037+0000","last_became_peered":"2021-01-27T09:44:33.380037+0000","last_unstale":"2021-01-27T09:44:33.382353+0000","last_undegraded":"2021-01-27T09:44:33.382353+0000","last_fullsized":"2021-01-27T09:44:33.382353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"17","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.372796+0000","last_change":"2021-01-27T09:44:26.436242+0000","last_active":"2021-01-27T09:44:33.372796+0000","last_peered":"2021-01-27T09:44:33.372796+0000","last_clean":"2021-01-27T09:44:33.372796+0000","last_became_active":"2021-01-27T09:44:26.435467+0000","last_became_peered":"2021-01-27T09:44:26.435467+0000","last_unstale":"2021-01-27T09:44:33.372796+0000","last_undegraded":"2021-01-27T09:44:33.372796+0000","last_fullsized":"2021-01-27T09:44:33.372796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'17","reported_seq":"31","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.618737+0000","last_change":"2021-01-27T09:44:28.934250+0000","last_active":"2021-01-27T09:44:51.618737+0000","last_peered":"2021-01-27T09:44:51.618737+0000","last_clean":"2021-01-27T09:44:51.618737+0000","last_became_active":"2021-01-27T09:44:28.933897+0000","last_became_peered":"2021-01-27T09:44:28.933897+0000","last_unstale":"2021-01-27T09:44:51.618737+0000","last_undegraded":"2021-01-27T09:44:51.618737+0000","last_fullsized":"2021-01-27T09:44:51.618737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":666,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.374140+0000","last_change":"2021-01-27T09:44:29.341412+0000","last_active":"2021-01-27T09:44:33.374140+0000","last_peered":"2021-01-27T09:44:33.374140+0000","last_clean":"2021-01-27T09:44:33.374140+0000","last_became_active":"2021-01-27T09:44:29.341016+0000","last_became_peered":"2021-01-27T09:44:29.341016+0000","last_unstale":"2021-01-27T09:44:33.374140+0000","last_undegraded":"2021-01-27T09:44:33.374140+0000","last_fullsized":"2021-01-27T09:44:33.374140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.380375+0000","last_change":"2021-01-27T09:44:33.378505+0000","last_active":"2021-01-27T09:44:33.380375+0000","last_peered":"2021-01-27T09:44:33.380375+0000","last_clean":"2021-01-27T09:44:33.380375+0000","last_became_active":"2021-01-27T09:44:33.377285+0000","last_became_peered":"2021-01-27T09:44:33.377285+0000","last_unstale":"2021-01-27T09:44:33.380375+0000","last_undegraded":"2021-01-27T09:44:33.380375+0000","last_fullsized":"2021-01-27T09:44:33.380375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368923+0000","last_change":"2021-01-27T09:44:25.841172+0000","last_active":"2021-01-27T09:44:33.368923+0000","last_peered":"2021-01-27T09:44:33.368923+0000","last_clean":"2021-01-27T09:44:33.368923+0000","last_became_active":"2021-01-27T09:44:25.840711+0000","last_became_peered":"2021-01-27T09:44:25.840711+0000","last_unstale":"2021-01-27T09:44:33.368923+0000","last_undegraded":"2021-01-27T09:44:33.368923+0000","last_fullsized":"2021-01-27T09:44:33.368923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'19","reported_seq":"33","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:45:13.556437+0000","last_change":"2021-01-27T09:44:28.932871+0000","last_active":"2021-01-27T09:45:13.556437+0000","last_peered":"2021-01-27T09:45:13.556437+0000","last_clean":"2021-01-27T09:45:13.556437+0000","last_became_active":"2021-01-27T09:44:28.932513+0000","last_became_peered":"2021-01-27T09:44:28.932513+0000","last_unstale":"2021-01-27T09:45:13.556437+0000","last_undegraded":"2021-01-27T09:45:13.556437+0000","last_fullsized":"2021-01-27T09:45:13.556437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4529,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.366893+0000","last_change":"2021-01-27T09:44:29.350508+0000","last_active":"2021-01-27T09:44:33.366893+0000","last_peered":"2021-01-27T09:44:33.366893+0000","last_clean":"2021-01-27T09:44:33.366893+0000","last_became_active":"2021-01-27T09:44:29.350179+0000","last_became_peered":"2021-01-27T09:44:29.350179+0000","last_unstale":"2021-01-27T09:44:33.366893+0000","last_undegraded":"2021-01-27T09:44:33.366893+0000","last_fullsized":"2021-01-27T09:44:33.366893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.442441+0000","last_change":"2021-01-27T09:44:33.441051+0000","last_active":"2021-01-27T09:44:33.442441+0000","last_peered":"2021-01-27T09:44:33.442441+0000","last_clean":"2021-01-27T09:44:33.442441+0000","last_became_active":"2021-01-27T09:44:33.439809+0000","last_became_peered":"2021-01-27T09:44:33.439809+0000","last_unstale":"2021-01-27T09:44:33.442441+0000","last_undegraded":"2021-01-27T09:44:33.442441+0000","last_fullsized":"2021-01-27T09:44:33.442441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"17","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.437810+0000","last_change":"2021-01-27T09:44:26.405089+0000","last_active":"2021-01-27T09:44:33.437810+0000","last_peered":"2021-01-27T09:44:33.437810+0000","last_clean":"2021-01-27T09:44:33.437810+0000","last_became_active":"2021-01-27T09:44:26.403537+0000","last_became_peered":"2021-01-27T09:44:26.403537+0000","last_unstale":"2021-01-27T09:44:33.437810+0000","last_undegraded":"2021-01-27T09:44:33.437810+0000","last_fullsized":"2021-01-27T09:44:33.437810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'10","reported_seq":"23","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.617676+0000","last_change":"2021-01-27T09:44:28.932480+0000","last_active":"2021-01-27T09:44:51.617676+0000","last_peered":"2021-01-27T09:44:51.617676+0000","last_clean":"2021-01-27T09:44:51.617676+0000","last_became_active":"2021-01-27T09:44:28.932127+0000","last_became_peered":"2021-01-27T09:44:28.932127+0000","last_unstale":"2021-01-27T09:44:51.617676+0000","last_undegraded":"2021-01-27T09:44:51.617676+0000","last_fullsized":"2021-01-27T09:44:51.617676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":736,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.366915+0000","last_change":"2021-01-27T09:44:29.338414+0000","last_active":"2021-01-27T09:44:33.366915+0000","last_peered":"2021-01-27T09:44:33.366915+0000","last_clean":"2021-01-27T09:44:33.366915+0000","last_became_active":"2021-01-27T09:44:29.337813+0000","last_became_peered":"2021-01-27T09:44:29.337813+0000","last_unstale":"2021-01-27T09:44:33.366915+0000","last_undegraded":"2021-01-27T09:44:33.366915+0000","last_fullsized":"2021-01-27T09:44:33.366915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.448516+0000","last_change":"2021-01-27T09:44:33.442248+0000","last_active":"2021-01-27T09:44:33.448516+0000","last_peered":"2021-01-27T09:44:33.448516+0000","last_clean":"2021-01-27T09:44:33.448516+0000","last_became_active":"2021-01-27T09:44:33.440410+0000","last_became_peered":"2021-01-27T09:44:33.440410+0000","last_unstale":"2021-01-27T09:44:33.448516+0000","last_undegraded":"2021-01-27T09:44:33.448516+0000","last_fullsized":"2021-01-27T09:44:33.448516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.442528+0000","last_change":"2021-01-27T09:44:33.441395+0000","last_active":"2021-01-27T09:44:33.442528+0000","last_peered":"2021-01-27T09:44:33.442528+0000","last_clean":"2021-01-27T09:44:33.442528+0000","last_became_active":"2021-01-27T09:44:33.440377+0000","last_became_peered":"2021-01-27T09:44:33.440377+0000","last_unstale":"2021-01-27T09:44:33.442528+0000","last_undegraded":"2021-01-27T09:44:33.442528+0000","last_fullsized":"2021-01-27T09:44:33.442528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"26'18","reported_seq":"31","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.608717+0000","last_change":"2021-01-27T09:44:28.929059+0000","last_active":"2021-01-27T09:44:51.608717+0000","last_peered":"2021-01-27T09:44:51.608717+0000","last_clean":"2021-01-27T09:44:51.608717+0000","last_became_active":"2021-01-27T09:44:28.928444+0000","last_became_peered":"2021-01-27T09:44:28.928444+0000","last_unstale":"2021-01-27T09:44:51.608717+0000","last_undegraded":"2021-01-27T09:44:51.608717+0000","last_fullsized":"2021-01-27T09:44:51.608717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":642,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368690+0000","last_change":"2021-01-27T09:44:26.403671+0000","last_active":"2021-01-27T09:44:33.368690+0000","last_peered":"2021-01-27T09:44:33.368690+0000","last_clean":"2021-01-27T09:44:33.368690+0000","last_became_active":"2021-01-27T09:44:26.403137+0000","last_became_peered":"2021-01-27T09:44:26.403137+0000","last_unstale":"2021-01-27T09:44:33.368690+0000","last_undegraded":"2021-01-27T09:44:33.368690+0000","last_fullsized":"2021-01-27T09:44:33.368690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.367795+0000","last_change":"2021-01-27T09:44:29.347824+0000","last_active":"2021-01-27T09:44:33.367795+0000","last_peered":"2021-01-27T09:44:33.367795+0000","last_clean":"2021-01-27T09:44:33.367795+0000","last_became_active":"2021-01-27T09:44:29.347463+0000","last_became_peered":"2021-01-27T09:44:29.347463+0000","last_unstale":"2021-01-27T09:44:33.367795+0000","last_undegraded":"2021-01-27T09:44:33.367795+0000","last_fullsized":"2021-01-27T09:44:33.367795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.443462+0000","last_change":"2021-01-27T09:44:33.441988+0000","last_active":"2021-01-27T09:44:33.443462+0000","last_peered":"2021-01-27T09:44:33.443462+0000","last_clean":"2021-01-27T09:44:33.443462+0000","last_became_active":"2021-01-27T09:44:33.440172+0000","last_became_peered":"2021-01-27T09:44:33.440172+0000","last_unstale":"2021-01-27T09:44:33.443462+0000","last_undegraded":"2021-01-27T09:44:33.443462+0000","last_fullsized":"2021-01-27T09:44:33.443462+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"26'21","reported_seq":"35","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.618079+0000","last_change":"2021-01-27T09:44:28.930780+0000","last_active":"2021-01-27T09:44:51.618079+0000","last_peered":"2021-01-27T09:44:51.618079+0000","last_clean":"2021-01-27T09:44:51.618079+0000","last_became_active":"2021-01-27T09:44:28.930374+0000","last_became_peered":"2021-01-27T09:44:28.930374+0000","last_unstale":"2021-01-27T09:44:51.618079+0000","last_undegraded":"2021-01-27T09:44:51.618079+0000","last_fullsized":"2021-01-27T09:44:51.618079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":112,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"17","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.372343+0000","last_change":"2021-01-27T09:44:25.838965+0000","last_active":"2021-01-27T09:44:33.372343+0000","last_peered":"2021-01-27T09:44:33.372343+0000","last_clean":"2021-01-27T09:44:33.372343+0000","last_became_active":"2021-01-27T09:44:25.838635+0000","last_became_peered":"2021-01-27T09:44:25.838635+0000","last_unstale":"2021-01-27T09:44:33.372343+0000","last_undegraded":"2021-01-27T09:44:33.372343+0000","last_fullsized":"2021-01-27T09:44:33.372343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.367109+0000","last_change":"2021-01-27T09:44:29.348218+0000","last_active":"2021-01-27T09:44:33.367109+0000","last_peered":"2021-01-27T09:44:33.367109+0000","last_clean":"2021-01-27T09:44:33.367109+0000","last_became_active":"2021-01-27T09:44:29.347905+0000","last_became_peered":"2021-01-27T09:44:29.347905+0000","last_unstale":"2021-01-27T09:44:33.367109+0000","last_undegraded":"2021-01-27T09:44:33.367109+0000","last_fullsized":"2021-01-27T09:44:33.367109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.380414+0000","last_change":"2021-01-27T09:44:33.378828+0000","last_active":"2021-01-27T09:44:33.380414+0000","last_peered":"2021-01-27T09:44:33.380414+0000","last_clean":"2021-01-27T09:44:33.380414+0000","last_became_active":"2021-01-27T09:44:33.376984+0000","last_became_peered":"2021-01-27T09:44:33.376984+0000","last_unstale":"2021-01-27T09:44:33.380414+0000","last_undegraded":"2021-01-27T09:44:33.380414+0000","last_fullsized":"2021-01-27T09:44:33.380414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"26'14","reported_seq":"28","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:45:13.254443+0000","last_change":"2021-01-27T09:44:28.933091+0000","last_active":"2021-01-27T09:45:13.254443+0000","last_peered":"2021-01-27T09:45:13.254443+0000","last_clean":"2021-01-27T09:45:13.254443+0000","last_became_active":"2021-01-27T09:44:28.932701+0000","last_became_peered":"2021-01-27T09:44:28.932701+0000","last_unstale":"2021-01-27T09:45:13.254443+0000","last_undegraded":"2021-01-27T09:45:13.254443+0000","last_fullsized":"2021-01-27T09:45:13.254443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":984,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368552+0000","last_change":"2021-01-27T09:44:25.737081+0000","last_active":"2021-01-27T09:44:33.368552+0000","last_peered":"2021-01-27T09:44:33.368552+0000","last_clean":"2021-01-27T09:44:33.368552+0000","last_became_active":"2021-01-27T09:44:25.736516+0000","last_became_peered":"2021-01-27T09:44:25.736516+0000","last_unstale":"2021-01-27T09:44:33.368552+0000","last_undegraded":"2021-01-27T09:44:33.368552+0000","last_fullsized":"2021-01-27T09:44:33.368552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.437701+0000","last_change":"2021-01-27T09:44:29.347815+0000","last_active":"2021-01-27T09:44:33.437701+0000","last_peered":"2021-01-27T09:44:33.437701+0000","last_clean":"2021-01-27T09:44:33.437701+0000","last_became_active":"2021-01-27T09:44:29.347415+0000","last_became_peered":"2021-01-27T09:44:29.347415+0000","last_unstale":"2021-01-27T09:44:33.437701+0000","last_undegraded":"2021-01-27T09:44:33.437701+0000","last_fullsized":"2021-01-27T09:44:33.437701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.437850+0000","last_change":"2021-01-27T09:44:33.436705+0000","last_active":"2021-01-27T09:44:33.437850+0000","last_peered":"2021-01-27T09:44:33.437850+0000","last_clean":"2021-01-27T09:44:33.437850+0000","last_became_active":"2021-01-27T09:44:33.435975+0000","last_became_peered":"2021-01-27T09:44:33.435975+0000","last_unstale":"2021-01-27T09:44:33.437850+0000","last_undegraded":"2021-01-27T09:44:33.437850+0000","last_fullsized":"2021-01-27T09:44:33.437850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'8","reported_seq":"22","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.612586+0000","last_change":"2021-01-27T09:44:28.930455+0000","last_active":"2021-01-27T09:44:51.612586+0000","last_peered":"2021-01-27T09:44:51.612586+0000","last_clean":"2021-01-27T09:44:51.612586+0000","last_became_active":"2021-01-27T09:44:28.930088+0000","last_became_peered":"2021-01-27T09:44:28.930088+0000","last_unstale":"2021-01-27T09:44:51.612586+0000","last_undegraded":"2021-01-27T09:44:51.612586+0000","last_fullsized":"2021-01-27T09:44:51.612586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368647+0000","last_change":"2021-01-27T09:44:25.736301+0000","last_active":"2021-01-27T09:44:33.368647+0000","last_peered":"2021-01-27T09:44:33.368647+0000","last_clean":"2021-01-27T09:44:33.368647+0000","last_became_active":"2021-01-27T09:44:25.735741+0000","last_became_peered":"2021-01-27T09:44:25.735741+0000","last_unstale":"2021-01-27T09:44:33.368647+0000","last_undegraded":"2021-01-27T09:44:33.368647+0000","last_fullsized":"2021-01-27T09:44:33.368647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"20","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.432653+0000","last_change":"2021-01-27T09:44:24.570544+0000","last_active":"2021-01-27T09:44:33.432653+0000","last_peered":"2021-01-27T09:44:33.432653+0000","last_clean":"2021-01-27T09:44:33.432653+0000","last_became_active":"2021-01-27T09:44:24.569755+0000","last_became_peered":"2021-01-27T09:44:24.569755+0000","last_unstale":"2021-01-27T09:44:33.432653+0000","last_undegraded":"2021-01-27T09:44:33.432653+0000","last_fullsized":"2021-01-27T09:44:33.432653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:19.429176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:19.429176+0000","last_clean_scrub_stamp":"2021-01-27T09:44:19.429176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368821+0000","last_change":"2021-01-27T09:44:29.337716+0000","last_active":"2021-01-27T09:44:33.368821+0000","last_peered":"2021-01-27T09:44:33.368821+0000","last_clean":"2021-01-27T09:44:33.368821+0000","last_became_active":"2021-01-27T09:44:29.337355+0000","last_became_peered":"2021-01-27T09:44:29.337355+0000","last_unstale":"2021-01-27T09:44:33.368821+0000","last_undegraded":"2021-01-27T09:44:33.368821+0000","last_fullsized":"2021-01-27T09:44:33.368821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":7669,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5136,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366704,"statfs":{"total":96636764160,"available":96631504896,"internally_reserved":0,"allocated":270336,"data_stored":112757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7650000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0579999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8639999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.714}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1360000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5240,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366600,"statfs":{"total":96636764160,"available":96631398400,"internally_reserved":0,"allocated":311296,"data_stored":114333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6839999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.764}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2879999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4420000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6619999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.343}]}]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5136,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366704,"statfs":{"total":96636764160,"available":96631504896,"internally_reserved":0,"allocated":270336,"data_stored":112757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1190000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.98}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8170000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2889999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.762}]}]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5148,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366692,"statfs":{"total":96636764160,"available":96631492608,"internally_reserved":0,"allocated":282624,"data_stored":112613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7969999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0379999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.552}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.855}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.093}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0899999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5204,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366636,"statfs":{"total":96636764160,"available":96631435264,"internally_reserved":0,"allocated":274432,"data_stored":112083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.369}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8520000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5619999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.919}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0449999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":119672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.532}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7749999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0150000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.869}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4239999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3170000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5224,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366616,"statfs":{"total":96636764160,"available":96631414784,"internally_reserved":0,"allocated":294912,"data_stored":117398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.75}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2320000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1440000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9470000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8969999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7639999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5212,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366628,"statfs":{"total":96636764160,"available":96631427072,"internally_reserved":0,"allocated":282624,"data_stored":113423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2890000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7010000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.944}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5019999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4220000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.792}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.25}]}]}]}} 2021-01-27T09:45:19.205 INFO:tasks.mds_thrash.ceph_manager:clean! 2021-01-27T09:45:19.205 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-01-27T09:45:19.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.361+0000 7f72219e3700 1 Processor -- start 2021-01-27T09:45:19.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.361+0000 7f72219e3700 1 -- start start 2021-01-27T09:45:19.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.361+0000 7f72219e3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f721c147b30 0x7f721c0672b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:19.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.361+0000 7f72219e3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f721c147f10 0x7f721c062810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:19.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.361+0000 7f72219e3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f721c1513e0 con 0x7f721c064d20 2021-01-27T09:45:19.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.361+0000 7f72219e3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721c0be8a0 con 0x7f721c147b30 2021-01-27T09:45:19.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.361+0000 7f72219e3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721c0677a0 con 0x7f721c147f10 2021-01-27T09:45:19.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.361+0000 7f72211e2700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f721c064d20 0x7f721c14dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46984/0 (socket says 172.21.15.146:46984) 2021-01-27T09:45:19.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.361+0000 7f72211e2700 1 -- 172.21.15.146:0/4200626650 learned_addr learned my addr 172.21.15.146:0/4200626650 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:19.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.361+0000 7f72209e1700 1 --2- 172.21.15.146:0/4200626650 >> v2:172.21.15.146:3300/0 conn(0x7f721c147b30 0x7f721c0672b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:19.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.365+0000 7f721bfff700 1 --2- 172.21.15.146:0/4200626650 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f721c147f10 0x7f721c062810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:19.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.365+0000 7f721b7fe700 1 -- 172.21.15.146:0/4200626650 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316665023 0 0) 0x7f721c1513e0 con 0x7f721c064d20 2021-01-27T09:45:19.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.365+0000 7f721b7fe700 1 -- 172.21.15.146:0/4200626650 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7200003270 con 0x7f721c064d20 2021-01-27T09:45:19.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.365+0000 7f72209e1700 1 -- 172.21.15.146:0/4200626650 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f721c147f10 msgr2=0x7f721c062810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:19.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.365+0000 7f72209e1700 1 --2- 172.21.15.146:0/4200626650 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f721c147f10 0x7f721c062810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.365+0000 7f72209e1700 1 -- 172.21.15.146:0/4200626650 >> v1:172.21.15.146:6789/0 conn(0x7f721c064d20 legacy=0x7f721c14dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:19.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.365+0000 7f72209e1700 1 -- 172.21.15.146:0/4200626650 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721c151680 con 0x7f721c147b30 2021-01-27T09:45:19.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.365+0000 7f72209e1700 1 --2- 172.21.15.146:0/4200626650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f721c147b30 0x7f721c0672b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f721000b9f0 tx=0x7f7210006e20).ready entity=mon.1 client_cookie=6039f957fb5b84bd server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:19.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.365+0000 7f721b7fe700 1 -- 172.21.15.146:0/4200626650 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72100095f0 con 0x7f721c147b30 2021-01-27T09:45:19.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.365+0000 7f721b7fe700 1 -- 172.21.15.146:0/4200626650 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7210009750 con 0x7f721c147b30 2021-01-27T09:45:19.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.365+0000 7f721b7fe700 1 -- 172.21.15.146:0/4200626650 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7210009ad0 con 0x7f721c147b30 2021-01-27T09:45:19.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.365+0000 7f72219e3700 1 -- 172.21.15.146:0/4200626650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f721c147b30 msgr2=0x7f721c0672b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:19.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.365+0000 7f72219e3700 1 --2- 172.21.15.146:0/4200626650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f721c147b30 0x7f721c0672b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f721000b9f0 tx=0x7f7210006e20).stop 2021-01-27T09:45:19.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.365+0000 7f72219e3700 1 -- 172.21.15.146:0/4200626650 shutdown_connections 2021-01-27T09:45:19.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.365+0000 7f72219e3700 1 --2- 172.21.15.146:0/4200626650 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f721c147f10 0x7f721c062810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.365+0000 7f72219e3700 1 --2- 172.21.15.146:0/4200626650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f721c147b30 0x7f721c0672b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.373 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.365+0000 7f72219e3700 1 -- 172.21.15.146:0/4200626650 >> 172.21.15.146:0/4200626650 conn(0x7f721c067d30 msgr2=0x7f721c068110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:19.373 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.365+0000 7f72219e3700 1 -- 172.21.15.146:0/4200626650 shutdown_connections 2021-01-27T09:45:19.373 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.365+0000 7f72219e3700 1 -- 172.21.15.146:0/4200626650 wait complete. 2021-01-27T09:45:19.375 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.369+0000 7f72219e3700 1 Processor -- start 2021-01-27T09:45:19.375 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.369+0000 7f72219e3700 1 -- start start 2021-01-27T09:45:19.375 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.369+0000 7f72219e3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f721c064d20 0x7f721c15dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:19.376 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.369+0000 7f72219e3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f721c147b30 0x7f721c14c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:19.376 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.369+0000 7f72219e3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f721c147f10 0x7f721c0bd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:19.376 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.369+0000 7f72219e3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c15e0e0 con 0x7f721c147b30 2021-01-27T09:45:19.376 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.369+0000 7f72219e3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c14c7d0 con 0x7f721c147f10 2021-01-27T09:45:19.376 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.369+0000 7f72219e3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721c14cb40 con 0x7f721c064d20 2021-01-27T09:45:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.369+0000 7f72211e2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f721c147f10 0x7f721c0bd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.369+0000 7f72209e1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f721c064d20 0x7f721c15dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.369+0000 7f721bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f721c147b30 0x7f721c14c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.369+0000 7f72211e2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f721c147f10 0x7f721c0bd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47422/0 (socket says 172.21.15.146:47422) 2021-01-27T09:45:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.369+0000 7f72209e1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f721c064d20 0x7f721c15dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36904/0 (socket says 172.21.15.146:36904) 2021-01-27T09:45:19.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.369+0000 7f72211e2700 1 -- 172.21.15.146:0/3413137752 learned_addr learned my addr 172.21.15.146:0/3413137752 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:19.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.373+0000 7f72211e2700 1 -- 172.21.15.146:0/3413137752 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f721c064d20 msgr2=0x7f721c15dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:19.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.373+0000 7f72211e2700 1 --2- 172.21.15.146:0/3413137752 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f721c064d20 0x7f721c15dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.373+0000 7f72211e2700 1 -- 172.21.15.146:0/3413137752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f721c147b30 msgr2=0x7f721c14c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:19.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.373+0000 7f72211e2700 1 --2- 172.21.15.146:0/3413137752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f721c147b30 0x7f721c14c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.373+0000 7f72211e2700 1 -- 172.21.15.146:0/3413137752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721c14cde0 con 0x7f721c147f10 2021-01-27T09:45:19.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.373+0000 7f72211e2700 1 --2- 172.21.15.146:0/3413137752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f721c147f10 0x7f721c0bd5f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f721400ca60 tx=0x7f7214007df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:19.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.373+0000 7f7218ff9700 1 -- 172.21.15.146:0/3413137752 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721400cea0 con 0x7f721c147f10 2021-01-27T09:45:19.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.373+0000 7f7218ff9700 1 -- 172.21.15.146:0/3413137752 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7214005bb0 con 0x7f721c147f10 2021-01-27T09:45:19.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.373+0000 7f72219e3700 1 -- 172.21.15.146:0/3413137752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721c14d080 con 0x7f721c147f10 2021-01-27T09:45:19.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.373+0000 7f7218ff9700 1 -- 172.21.15.146:0/3413137752 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7214007110 con 0x7f721c147f10 2021-01-27T09:45:19.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.373+0000 7f72219e3700 1 -- 172.21.15.146:0/3413137752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721c14bba0 con 0x7f721c147f10 2021-01-27T09:45:19.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.373+0000 7f72219e3700 1 -- 172.21.15.146:0/3413137752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721c044ee0 con 0x7f721c147f10 2021-01-27T09:45:19.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.377+0000 7f7218ff9700 1 -- 172.21.15.146:0/3413137752 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f7214010030 con 0x7f721c147f10 2021-01-27T09:45:19.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.377+0000 7f7218ff9700 1 --2- 172.21.15.146:0/3413137752 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f71fc0561e0 0x7f71fc0586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:19.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.377+0000 7f7218ff9700 1 -- 172.21.15.146:0/3413137752 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f721406f3c0 con 0x7f721c147f10 2021-01-27T09:45:19.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.377+0000 7f72209e1700 1 --2- 172.21.15.146:0/3413137752 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f71fc0561e0 0x7f71fc0586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:19.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.377+0000 7f72209e1700 1 --2- 172.21.15.146:0/3413137752 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f71fc0561e0 0x7f71fc0586a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f7210007fd0 tx=0x7f7210016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:19.384 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.381+0000 7f7218ff9700 1 -- 172.21.15.146:0/3413137752 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f7214044900 con 0x7f721c147f10 2021-01-27T09:45:19.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.521+0000 7f72219e3700 1 -- 172.21.15.146:0/3413137752 --> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f721c044680 con 0x7f71fc0561e0 2021-01-27T09:45:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.529+0000 7f7218ff9700 1 -- 172.21.15.146:0/3413137752 <== mgr.4104 v2:172.21.15.78:6832/15486 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+101232 (secure 0 0 0) 0x7f721c044680 con 0x7f71fc0561e0 2021-01-27T09:45:19.535 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:45:19.538 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.537+0000 7f72219e3700 1 -- 172.21.15.146:0/3413137752 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f71fc0561e0 msgr2=0x7f71fc0586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:19.538 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.537+0000 7f72219e3700 1 --2- 172.21.15.146:0/3413137752 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f71fc0561e0 0x7f71fc0586a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f7210007fd0 tx=0x7f7210016000).stop 2021-01-27T09:45:19.538 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.537+0000 7f72219e3700 1 -- 172.21.15.146:0/3413137752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f721c147f10 msgr2=0x7f721c0bd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:19.539 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.537+0000 7f72219e3700 1 --2- 172.21.15.146:0/3413137752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f721c147f10 0x7f721c0bd5f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f721400ca60 tx=0x7f7214007df0).stop 2021-01-27T09:45:19.539 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.537+0000 7f72219e3700 1 -- 172.21.15.146:0/3413137752 shutdown_connections 2021-01-27T09:45:19.539 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.537+0000 7f72219e3700 1 --2- 172.21.15.146:0/3413137752 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f71fc0561e0 0x7f71fc0586a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.539 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.537+0000 7f72219e3700 1 --2- 172.21.15.146:0/3413137752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f721c147f10 0x7f721c0bd5f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.540 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.537+0000 7f72219e3700 1 --2- 172.21.15.146:0/3413137752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f721c147b30 0x7f721c14c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.540 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.537+0000 7f72219e3700 1 --2- 172.21.15.146:0/3413137752 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f721c064d20 0x7f721c15dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.540 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.537+0000 7f72219e3700 1 -- 172.21.15.146:0/3413137752 >> 172.21.15.146:0/3413137752 conn(0x7f721c067d30 msgr2=0x7f721c0c3890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:19.541 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.537+0000 7f72219e3700 1 -- 172.21.15.146:0/3413137752 shutdown_connections 2021-01-27T09:45:19.541 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.537+0000 7f72219e3700 1 -- 172.21.15.146:0/3413137752 wait complete. 2021-01-27T09:45:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2021-01-27T09:45:19.567 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2021-01-27T09:45:18.455767+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7669,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41620,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":754933100,"statfs":{"total":773094113280,"available":773051494400,"internally_reserved":0,"allocated":2314240,"data_stored":915036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1315,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004129"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.369789+0000","last_change":"2021-01-27T09:44:26.437753+0000","last_active":"2021-01-27T09:44:33.369789+0000","last_peered":"2021-01-27T09:44:33.369789+0000","last_clean":"2021-01-27T09:44:33.369789+0000","last_became_active":"2021-01-27T09:44:26.437402+0000","last_became_peered":"2021-01-27T09:44:26.437402+0000","last_unstale":"2021-01-27T09:44:33.369789+0000","last_undegraded":"2021-01-27T09:44:33.369789+0000","last_fullsized":"2021-01-27T09:44:33.369789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'9","reported_seq":"23","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.616159+0000","last_change":"2021-01-27T09:44:28.931645+0000","last_active":"2021-01-27T09:44:51.616159+0000","last_peered":"2021-01-27T09:44:51.616159+0000","last_clean":"2021-01-27T09:44:51.616159+0000","last_became_active":"2021-01-27T09:44:28.931347+0000","last_became_peered":"2021-01-27T09:44:28.931347+0000","last_unstale":"2021-01-27T09:44:51.616159+0000","last_undegraded":"2021-01-27T09:44:51.616159+0000","last_fullsized":"2021-01-27T09:44:51.616159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.364949+0000","last_change":"2021-01-27T09:44:29.336652+0000","last_active":"2021-01-27T09:44:33.364949+0000","last_peered":"2021-01-27T09:44:33.364949+0000","last_clean":"2021-01-27T09:44:33.364949+0000","last_became_active":"2021-01-27T09:44:29.336207+0000","last_became_peered":"2021-01-27T09:44:29.336207+0000","last_unstale":"2021-01-27T09:44:33.364949+0000","last_undegraded":"2021-01-27T09:44:33.364949+0000","last_fullsized":"2021-01-27T09:44:33.364949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.382353+0000","last_change":"2021-01-27T09:44:33.381360+0000","last_active":"2021-01-27T09:44:33.382353+0000","last_peered":"2021-01-27T09:44:33.382353+0000","last_clean":"2021-01-27T09:44:33.382353+0000","last_became_active":"2021-01-27T09:44:33.380037+0000","last_became_peered":"2021-01-27T09:44:33.380037+0000","last_unstale":"2021-01-27T09:44:33.382353+0000","last_undegraded":"2021-01-27T09:44:33.382353+0000","last_fullsized":"2021-01-27T09:44:33.382353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"17","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.372796+0000","last_change":"2021-01-27T09:44:26.436242+0000","last_active":"2021-01-27T09:44:33.372796+0000","last_peered":"2021-01-27T09:44:33.372796+0000","last_clean":"2021-01-27T09:44:33.372796+0000","last_became_active":"2021-01-27T09:44:26.435467+0000","last_became_peered":"2021-01-27T09:44:26.435467+0000","last_unstale":"2021-01-27T09:44:33.372796+0000","last_undegraded":"2021-01-27T09:44:33.372796+0000","last_fullsized":"2021-01-27T09:44:33.372796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'17","reported_seq":"31","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.618737+0000","last_change":"2021-01-27T09:44:28.934250+0000","last_active":"2021-01-27T09:44:51.618737+0000","last_peered":"2021-01-27T09:44:51.618737+0000","last_clean":"2021-01-27T09:44:51.618737+0000","last_became_active":"2021-01-27T09:44:28.933897+0000","last_became_peered":"2021-01-27T09:44:28.933897+0000","last_unstale":"2021-01-27T09:44:51.618737+0000","last_undegraded":"2021-01-27T09:44:51.618737+0000","last_fullsized":"2021-01-27T09:44:51.618737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":666,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.374140+0000","last_change":"2021-01-27T09:44:29.341412+0000","last_active":"2021-01-27T09:44:33.374140+0000","last_peered":"2021-01-27T09:44:33.374140+0000","last_clean":"2021-01-27T09:44:33.374140+0000","last_became_active":"2021-01-27T09:44:29.341016+0000","last_became_peered":"2021-01-27T09:44:29.341016+0000","last_unstale":"2021-01-27T09:44:33.374140+0000","last_undegraded":"2021-01-27T09:44:33.374140+0000","last_fullsized":"2021-01-27T09:44:33.374140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.380375+0000","last_change":"2021-01-27T09:44:33.378505+0000","last_active":"2021-01-27T09:44:33.380375+0000","last_peered":"2021-01-27T09:44:33.380375+0000","last_clean":"2021-01-27T09:44:33.380375+0000","last_became_active":"2021-01-27T09:44:33.377285+0000","last_became_peered":"2021-01-27T09:44:33.377285+0000","last_unstale":"2021-01-27T09:44:33.380375+0000","last_undegraded":"2021-01-27T09:44:33.380375+0000","last_fullsized":"2021-01-27T09:44:33.380375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368923+0000","last_change":"2021-01-27T09:44:25.841172+0000","last_active":"2021-01-27T09:44:33.368923+0000","last_peered":"2021-01-27T09:44:33.368923+0000","last_clean":"2021-01-27T09:44:33.368923+0000","last_became_active":"2021-01-27T09:44:25.840711+0000","last_became_peered":"2021-01-27T09:44:25.840711+0000","last_unstale":"2021-01-27T09:44:33.368923+0000","last_undegraded":"2021-01-27T09:44:33.368923+0000","last_fullsized":"2021-01-27T09:44:33.368923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'19","reported_seq":"33","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:45:13.556437+0000","last_change":"2021-01-27T09:44:28.932871+0000","last_active":"2021-01-27T09:45:13.556437+0000","last_peered":"2021-01-27T09:45:13.556437+0000","last_clean":"2021-01-27T09:45:13.556437+0000","last_became_active":"2021-01-27T09:44:28.932513+0000","last_became_peered":"2021-01-27T09:44:28.932513+0000","last_unstale":"2021-01-27T09:45:13.556437+0000","last_undegraded":"2021-01-27T09:45:13.556437+0000","last_fullsized":"2021-01-27T09:45:13.556437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4529,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.366893+0000","last_change":"2021-01-27T09:44:29.350508+0000","last_active":"2021-01-27T09:44:33.366893+0000","last_peered":"2021-01-27T09:44:33.366893+0000","last_clean":"2021-01-27T09:44:33.366893+0000","last_became_active":"2021-01-27T09:44:29.350179+0000","last_became_peered":"2021-01-27T09:44:29.350179+0000","last_unstale":"2021-01-27T09:44:33.366893+0000","last_undegraded":"2021-01-27T09:44:33.366893+0000","last_fullsized":"2021-01-27T09:44:33.366893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.442441+0000","last_change":"2021-01-27T09:44:33.441051+0000","last_active":"2021-01-27T09:44:33.442441+0000","last_peered":"2021-01-27T09:44:33.442441+0000","last_clean":"2021-01-27T09:44:33.442441+0000","last_became_active":"2021-01-27T09:44:33.439809+0000","last_became_peered":"2021-01-27T09:44:33.439809+0000","last_unstale":"2021-01-27T09:44:33.442441+0000","last_undegraded":"2021-01-27T09:44:33.442441+0000","last_fullsized":"2021-01-27T09:44:33.442441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"17","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.437810+0000","last_change":"2021-01-27T09:44:26.405089+0000","last_active":"2021-01-27T09:44:33.437810+0000","last_peered":"2021-01-27T09:44:33.437810+0000","last_clean":"2021-01-27T09:44:33.437810+0000","last_became_active":"2021-01-27T09:44:26.403537+0000","last_became_peered":"2021-01-27T09:44:26.403537+0000","last_unstale":"2021-01-27T09:44:33.437810+0000","last_undegraded":"2021-01-27T09:44:33.437810+0000","last_fullsized":"2021-01-27T09:44:33.437810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'10","reported_seq":"23","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.617676+0000","last_change":"2021-01-27T09:44:28.932480+0000","last_active":"2021-01-27T09:44:51.617676+0000","last_peered":"2021-01-27T09:44:51.617676+0000","last_clean":"2021-01-27T09:44:51.617676+0000","last_became_active":"2021-01-27T09:44:28.932127+0000","last_became_peered":"2021-01-27T09:44:28.932127+0000","last_unstale":"2021-01-27T09:44:51.617676+0000","last_undegraded":"2021-01-27T09:44:51.617676+0000","last_fullsized":"2021-01-27T09:44:51.617676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":736,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.366915+0000","last_change":"2021-01-27T09:44:29.338414+0000","last_active":"2021-01-27T09:44:33.366915+0000","last_peered":"2021-01-27T09:44:33.366915+0000","last_clean":"2021-01-27T09:44:33.366915+0000","last_became_active":"2021-01-27T09:44:29.337813+0000","last_became_peered":"2021-01-27T09:44:29.337813+0000","last_unstale":"2021-01-27T09:44:33.366915+0000","last_undegraded":"2021-01-27T09:44:33.366915+0000","last_fullsized":"2021-01-27T09:44:33.366915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.448516+0000","last_change":"2021-01-27T09:44:33.442248+0000","last_active":"2021-01-27T09:44:33.448516+0000","last_peered":"2021-01-27T09:44:33.448516+0000","last_clean":"2021-01-27T09:44:33.448516+0000","last_became_active":"2021-01-27T09:44:33.440410+0000","last_became_peered":"2021-01-27T09:44:33.440410+0000","last_unstale":"2021-01-27T09:44:33.448516+0000","last_undegraded":"2021-01-27T09:44:33.448516+0000","last_fullsized":"2021-01-27T09:44:33.448516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.442528+0000","last_change":"2021-01-27T09:44:33.441395+0000","last_active":"2021-01-27T09:44:33.442528+0000","last_peered":"2021-01-27T09:44:33.442528+0000","last_clean":"2021-01-27T09:44:33.442528+0000","last_became_active":"2021-01-27T09:44:33.440377+0000","last_became_peered":"2021-01-27T09:44:33.440377+0000","last_unstale":"2021-01-27T09:44:33.442528+0000","last_undegraded":"2021-01-27T09:44:33.442528+0000","last_fullsized":"2021-01-27T09:44:33.442528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"26'18","reported_seq":"31","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.608717+0000","last_change":"2021-01-27T09:44:28.929059+0000","last_active":"2021-01-27T09:44:51.608717+0000","last_peered":"2021-01-27T09:44:51.608717+0000","last_clean":"2021-01-27T09:44:51.608717+0000","last_became_active":"2021-01-27T09:44:28.928444+0000","last_became_peered":"2021-01-27T09:44:28.928444+0000","last_unstale":"2021-01-27T09:44:51.608717+0000","last_undegraded":"2021-01-27T09:44:51.608717+0000","last_fullsized":"2021-01-27T09:44:51.608717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":642,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368690+0000","last_change":"2021-01-27T09:44:26.403671+0000","last_active":"2021-01-27T09:44:33.368690+0000","last_peered":"2021-01-27T09:44:33.368690+0000","last_clean":"2021-01-27T09:44:33.368690+0000","last_became_active":"2021-01-27T09:44:26.403137+0000","last_became_peered":"2021-01-27T09:44:26.403137+0000","last_unstale":"2021-01-27T09:44:33.368690+0000","last_undegraded":"2021-01-27T09:44:33.368690+0000","last_fullsized":"2021-01-27T09:44:33.368690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.367795+0000","last_change":"2021-01-27T09:44:29.347824+0000","last_active":"2021-01-27T09:44:33.367795+0000","last_peered":"2021-01-27T09:44:33.367795+0000","last_clean":"2021-01-27T09:44:33.367795+0000","last_became_active":"2021-01-27T09:44:29.347463+0000","last_became_peered":"2021-01-27T09:44:29.347463+0000","last_unstale":"2021-01-27T09:44:33.367795+0000","last_undegraded":"2021-01-27T09:44:33.367795+0000","last_fullsized":"2021-01-27T09:44:33.367795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.443462+0000","last_change":"2021-01-27T09:44:33.441988+0000","last_active":"2021-01-27T09:44:33.443462+0000","last_peered":"2021-01-27T09:44:33.443462+0000","last_clean":"2021-01-27T09:44:33.443462+0000","last_became_active":"2021-01-27T09:44:33.440172+0000","last_became_peered":"2021-01-27T09:44:33.440172+0000","last_unstale":"2021-01-27T09:44:33.443462+0000","last_undegraded":"2021-01-27T09:44:33.443462+0000","last_fullsized":"2021-01-27T09:44:33.443462+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"26'21","reported_seq":"35","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.618079+0000","last_change":"2021-01-27T09:44:28.930780+0000","last_active":"2021-01-27T09:44:51.618079+0000","last_peered":"2021-01-27T09:44:51.618079+0000","last_clean":"2021-01-27T09:44:51.618079+0000","last_became_active":"2021-01-27T09:44:28.930374+0000","last_became_peered":"2021-01-27T09:44:28.930374+0000","last_unstale":"2021-01-27T09:44:51.618079+0000","last_undegraded":"2021-01-27T09:44:51.618079+0000","last_fullsized":"2021-01-27T09:44:51.618079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":112,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"17","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.372343+0000","last_change":"2021-01-27T09:44:25.838965+0000","last_active":"2021-01-27T09:44:33.372343+0000","last_peered":"2021-01-27T09:44:33.372343+0000","last_clean":"2021-01-27T09:44:33.372343+0000","last_became_active":"2021-01-27T09:44:25.838635+0000","last_became_peered":"2021-01-27T09:44:25.838635+0000","last_unstale":"2021-01-27T09:44:33.372343+0000","last_undegraded":"2021-01-27T09:44:33.372343+0000","last_fullsized":"2021-01-27T09:44:33.372343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.367109+0000","last_change":"2021-01-27T09:44:29.348218+0000","last_active":"2021-01-27T09:44:33.367109+0000","last_peered":"2021-01-27T09:44:33.367109+0000","last_clean":"2021-01-27T09:44:33.367109+0000","last_became_active":"2021-01-27T09:44:29.347905+0000","last_became_peered":"2021-01-27T09:44:29.347905+0000","last_unstale":"2021-01-27T09:44:33.367109+0000","last_undegraded":"2021-01-27T09:44:33.367109+0000","last_fullsized":"2021-01-27T09:44:33.367109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.380414+0000","last_change":"2021-01-27T09:44:33.378828+0000","last_active":"2021-01-27T09:44:33.380414+0000","last_peered":"2021-01-27T09:44:33.380414+0000","last_clean":"2021-01-27T09:44:33.380414+0000","last_became_active":"2021-01-27T09:44:33.376984+0000","last_became_peered":"2021-01-27T09:44:33.376984+0000","last_unstale":"2021-01-27T09:44:33.380414+0000","last_undegraded":"2021-01-27T09:44:33.380414+0000","last_fullsized":"2021-01-27T09:44:33.380414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"26'14","reported_seq":"28","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:45:13.254443+0000","last_change":"2021-01-27T09:44:28.933091+0000","last_active":"2021-01-27T09:45:13.254443+0000","last_peered":"2021-01-27T09:45:13.254443+0000","last_clean":"2021-01-27T09:45:13.254443+0000","last_became_active":"2021-01-27T09:44:28.932701+0000","last_became_peered":"2021-01-27T09:44:28.932701+0000","last_unstale":"2021-01-27T09:45:13.254443+0000","last_undegraded":"2021-01-27T09:45:13.254443+0000","last_fullsized":"2021-01-27T09:45:13.254443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":984,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368552+0000","last_change":"2021-01-27T09:44:25.737081+0000","last_active":"2021-01-27T09:44:33.368552+0000","last_peered":"2021-01-27T09:44:33.368552+0000","last_clean":"2021-01-27T09:44:33.368552+0000","last_became_active":"2021-01-27T09:44:25.736516+0000","last_became_peered":"2021-01-27T09:44:25.736516+0000","last_unstale":"2021-01-27T09:44:33.368552+0000","last_undegraded":"2021-01-27T09:44:33.368552+0000","last_fullsized":"2021-01-27T09:44:33.368552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.437701+0000","last_change":"2021-01-27T09:44:29.347815+0000","last_active":"2021-01-27T09:44:33.437701+0000","last_peered":"2021-01-27T09:44:33.437701+0000","last_clean":"2021-01-27T09:44:33.437701+0000","last_became_active":"2021-01-27T09:44:29.347415+0000","last_became_peered":"2021-01-27T09:44:29.347415+0000","last_unstale":"2021-01-27T09:44:33.437701+0000","last_undegraded":"2021-01-27T09:44:33.437701+0000","last_fullsized":"2021-01-27T09:44:33.437701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.437850+0000","last_change":"2021-01-27T09:44:33.436705+0000","last_active":"2021-01-27T09:44:33.437850+0000","last_peered":"2021-01-27T09:44:33.437850+0000","last_clean":"2021-01-27T09:44:33.437850+0000","last_became_active":"2021-01-27T09:44:33.435975+0000","last_became_peered":"2021-01-27T09:44:33.435975+0000","last_unstale":"2021-01-27T09:44:33.437850+0000","last_undegraded":"2021-01-27T09:44:33.437850+0000","last_fullsized":"2021-01-27T09:44:33.437850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'8","reported_seq":"22","reported_epoch":"26","state":"active+clean","last_fresh":"2021-01-27T09:44:51.612586+0000","last_change":"2021-01-27T09:44:28.930455+0000","last_active":"2021-01-27T09:44:51.612586+0000","last_peered":"2021-01-27T09:44:51.612586+0000","last_clean":"2021-01-27T09:44:51.612586+0000","last_became_active":"2021-01-27T09:44:28.930088+0000","last_became_peered":"2021-01-27T09:44:28.930088+0000","last_unstale":"2021-01-27T09:44:51.612586+0000","last_undegraded":"2021-01-27T09:44:51.612586+0000","last_fullsized":"2021-01-27T09:44:51.612586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368647+0000","last_change":"2021-01-27T09:44:25.736301+0000","last_active":"2021-01-27T09:44:33.368647+0000","last_peered":"2021-01-27T09:44:33.368647+0000","last_clean":"2021-01-27T09:44:33.368647+0000","last_became_active":"2021-01-27T09:44:25.735741+0000","last_became_peered":"2021-01-27T09:44:25.735741+0000","last_unstale":"2021-01-27T09:44:33.368647+0000","last_undegraded":"2021-01-27T09:44:33.368647+0000","last_fullsized":"2021-01-27T09:44:33.368647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"20","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.432653+0000","last_change":"2021-01-27T09:44:24.570544+0000","last_active":"2021-01-27T09:44:33.432653+0000","last_peered":"2021-01-27T09:44:33.432653+0000","last_clean":"2021-01-27T09:44:33.432653+0000","last_became_active":"2021-01-27T09:44:24.569755+0000","last_became_peered":"2021-01-27T09:44:24.569755+0000","last_unstale":"2021-01-27T09:44:33.432653+0000","last_undegraded":"2021-01-27T09:44:33.432653+0000","last_fullsized":"2021-01-27T09:44:33.432653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:19.429176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:19.429176+0000","last_clean_scrub_stamp":"2021-01-27T09:44:19.429176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"12","reported_epoch":"25","state":"active+clean","last_fresh":"2021-01-27T09:44:33.368821+0000","last_change":"2021-01-27T09:44:29.337716+0000","last_active":"2021-01-27T09:44:33.368821+0000","last_peered":"2021-01-27T09:44:33.368821+0000","last_clean":"2021-01-27T09:44:33.368821+0000","last_became_active":"2021-01-27T09:44:29.337355+0000","last_became_peered":"2021-01-27T09:44:29.337355+0000","last_unstale":"2021-01-27T09:44:33.368821+0000","last_undegraded":"2021-01-27T09:44:33.368821+0000","last_fullsized":"2021-01-27T09:44:33.368821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":7669,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5136,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366704,"statfs":{"total":96636764160,"available":96631504896,"internally_reserved":0,"allocated":270336,"data_stored":112757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7650000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0579999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8639999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.714}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1360000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5240,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366600,"statfs":{"total":96636764160,"available":96631398400,"internally_reserved":0,"allocated":311296,"data_stored":114333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6839999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.764}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2879999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4420000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6619999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.343}]}]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5136,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366704,"statfs":{"total":96636764160,"available":96631504896,"internally_reserved":0,"allocated":270336,"data_stored":112757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1190000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.98}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8170000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2889999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.762}]}]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5148,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366692,"statfs":{"total":96636764160,"available":96631492608,"internally_reserved":0,"allocated":282624,"data_stored":112613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7969999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0379999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.552}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.855}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.093}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0899999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5204,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366636,"statfs":{"total":96636764160,"available":96631435264,"internally_reserved":0,"allocated":274432,"data_stored":112083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.369}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8520000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5619999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.919}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0449999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366520,"statfs":{"total":96636764160,"available":96631316480,"internally_reserved":0,"allocated":327680,"data_stored":119672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.532}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7749999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0150000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.869}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4239999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3170000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5224,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366616,"statfs":{"total":96636764160,"available":96631414784,"internally_reserved":0,"allocated":294912,"data_stored":117398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.75}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2320000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1440000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9470000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8969999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7639999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5212,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366628,"statfs":{"total":96636764160,"available":96631427072,"internally_reserved":0,"allocated":282624,"data_stored":113423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2890000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7010000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.944}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5019999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4220000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.792}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.25}]}]}]}} 2021-01-27T09:45:19.570 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-01-27T09:45:19.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.729+0000 7fd2b1470700 1 Processor -- start 2021-01-27T09:45:19.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.729+0000 7fd2b1470700 1 -- start start 2021-01-27T09:45:19.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.729+0000 7fd2b1470700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd2ac0614a0 0x7fd2ac069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:19.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.729+0000 7fd2b1470700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd2ac061880 0x7fd2ac14f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:19.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.733+0000 7fd2b1470700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2ac0befd0 con 0x7fd2ac065d70 2021-01-27T09:45:19.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.733+0000 7fd2b1470700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2ac0b56c0 con 0x7fd2ac0614a0 2021-01-27T09:45:19.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.733+0000 7fd2b1470700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac0b5960 con 0x7fd2ac061880 2021-01-27T09:45:19.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.733+0000 7fd2aa7fc700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd2ac065d70 0x7fd2ac14f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:35036/0 (socket says 172.21.15.146:35036) 2021-01-27T09:45:19.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.733+0000 7fd2aa7fc700 1 -- 172.21.15.146:0/3746708088 learned_addr learned my addr 172.21.15.146:0/3746708088 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:19.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.733+0000 7fd2aaffd700 1 --2- 172.21.15.146:0/3746708088 >> v2:172.21.15.146:3300/0 conn(0x7fd2ac0614a0 0x7fd2ac069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:19.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.733+0000 7fd2abfff700 1 --2- 172.21.15.146:0/3746708088 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd2ac061880 0x7fd2ac14f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:19.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.733+0000 7fd2a9ffb700 1 -- 172.21.15.146:0/3746708088 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968175388 0 0) 0x7fd2ac0befd0 con 0x7fd2ac065d70 2021-01-27T09:45:19.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.733+0000 7fd2a9ffb700 1 -- 172.21.15.146:0/3746708088 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd298003270 con 0x7fd2ac065d70 2021-01-27T09:45:19.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.733+0000 7fd2aaffd700 1 -- 172.21.15.146:0/3746708088 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd2ac061880 msgr2=0x7fd2ac14f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:19.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.733+0000 7fd2aaffd700 1 --2- 172.21.15.146:0/3746708088 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd2ac061880 0x7fd2ac14f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.733+0000 7fd2aaffd700 1 -- 172.21.15.146:0/3746708088 >> v1:172.21.15.78:6789/0 conn(0x7fd2ac065d70 legacy=0x7fd2ac14f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:19.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.733+0000 7fd2aaffd700 1 -- 172.21.15.146:0/3746708088 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ac0b5c00 con 0x7fd2ac0614a0 2021-01-27T09:45:19.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.733+0000 7fd2aaffd700 1 --2- 172.21.15.146:0/3746708088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2ac0614a0 0x7fd2ac069bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fd29c009cb0 tx=0x7fd29c009220).ready entity=mon.1 client_cookie=fae50caebbb70b14 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:19.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.733+0000 7fd2a9ffb700 1 -- 172.21.15.146:0/3746708088 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c00b9e0 con 0x7fd2ac0614a0 2021-01-27T09:45:19.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.733+0000 7fd2a9ffb700 1 -- 172.21.15.146:0/3746708088 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c00bb40 con 0x7fd2ac0614a0 2021-01-27T09:45:19.740 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.733+0000 7fd2a9ffb700 1 -- 172.21.15.146:0/3746708088 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c011400 con 0x7fd2ac0614a0 2021-01-27T09:45:19.740 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.733+0000 7fd2b1470700 1 -- 172.21.15.146:0/3746708088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2ac0614a0 msgr2=0x7fd2ac069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:19.740 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.733+0000 7fd2b1470700 1 --2- 172.21.15.146:0/3746708088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2ac0614a0 0x7fd2ac069bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fd29c009cb0 tx=0x7fd29c009220).stop 2021-01-27T09:45:19.741 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.733+0000 7fd2b1470700 1 -- 172.21.15.146:0/3746708088 shutdown_connections 2021-01-27T09:45:19.741 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.733+0000 7fd2b1470700 1 --2- 172.21.15.146:0/3746708088 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd2ac061880 0x7fd2ac14f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.741 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.733+0000 7fd2b1470700 1 --2- 172.21.15.146:0/3746708088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2ac0614a0 0x7fd2ac069bf0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.741 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.733+0000 7fd2b1470700 1 -- 172.21.15.146:0/3746708088 >> 172.21.15.146:0/3746708088 conn(0x7fd2ac062810 msgr2=0x7fd2ac063330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:19.741 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.737+0000 7fd2b1470700 1 -- 172.21.15.146:0/3746708088 shutdown_connections 2021-01-27T09:45:19.742 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.737+0000 7fd2b1470700 1 -- 172.21.15.146:0/3746708088 wait complete. 2021-01-27T09:45:19.744 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.737+0000 7fd2b1470700 1 Processor -- start 2021-01-27T09:45:19.744 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.737+0000 7fd2b1470700 1 -- start start 2021-01-27T09:45:19.744 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.737+0000 7fd2b1470700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2ac061880 0x7fd2ac0bc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:19.744 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.737+0000 7fd2b1470700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd2ac065d70 0x7fd2ac0bdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:19.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.737+0000 7fd2b1470700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2ac13eba0 0x7fd2ac14e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:19.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.737+0000 7fd2b1470700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac13e4d0 con 0x7fd2ac13eba0 2021-01-27T09:45:19.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.737+0000 7fd2b1470700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac0bdfb0 con 0x7fd2ac061880 2021-01-27T09:45:19.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.737+0000 7fd2b1470700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac13dc00 con 0x7fd2ac065d70 2021-01-27T09:45:19.746 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.737+0000 7fd2aaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2ac061880 0x7fd2ac0bc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:19.746 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.741+0000 7fd2aaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2ac061880 0x7fd2ac0bc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47432/0 (socket says 172.21.15.146:47432) 2021-01-27T09:45:19.746 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.741+0000 7fd2aaffd700 1 -- 172.21.15.146:0/508926111 learned_addr learned my addr 172.21.15.146:0/508926111 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:19.746 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.741+0000 7fd2aa7fc700 1 --2- 172.21.15.146:0/508926111 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd2ac065d70 0x7fd2ac0bdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:19.747 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.741+0000 7fd2abfff700 1 --2- 172.21.15.146:0/508926111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2ac13eba0 0x7fd2ac14e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:19.747 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.741+0000 7fd2aaffd700 1 -- 172.21.15.146:0/508926111 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd2ac065d70 msgr2=0x7fd2ac0bdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:19.747 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.741+0000 7fd2aaffd700 1 --2- 172.21.15.146:0/508926111 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd2ac065d70 0x7fd2ac0bdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.747 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.741+0000 7fd2aaffd700 1 -- 172.21.15.146:0/508926111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2ac13eba0 msgr2=0x7fd2ac14e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:19.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.741+0000 7fd2aaffd700 1 --2- 172.21.15.146:0/508926111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2ac13eba0 0x7fd2ac14e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.741+0000 7fd2aaffd700 1 -- 172.21.15.146:0/508926111 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ac13dea0 con 0x7fd2ac061880 2021-01-27T09:45:19.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.741+0000 7fd2aa7fc700 1 --2- 172.21.15.146:0/508926111 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd2ac065d70 0x7fd2ac0bdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:45:19.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.741+0000 7fd2aaffd700 1 --2- 172.21.15.146:0/508926111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2ac061880 0x7fd2ac0bc0b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fd29c009260 tx=0x7fd29c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:19.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.741+0000 7fd292ffd700 1 -- 172.21.15.146:0/508926111 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c023470 con 0x7fd2ac061880 2021-01-27T09:45:19.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.741+0000 7fd292ffd700 1 -- 172.21.15.146:0/508926111 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c01e070 con 0x7fd2ac061880 2021-01-27T09:45:19.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.741+0000 7fd2b1470700 1 -- 172.21.15.146:0/508926111 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2ac13e140 con 0x7fd2ac061880 2021-01-27T09:45:19.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.741+0000 7fd292ffd700 1 -- 172.21.15.146:0/508926111 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c023800 con 0x7fd2ac061880 2021-01-27T09:45:19.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.741+0000 7fd2b1470700 1 -- 172.21.15.146:0/508926111 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2ac13f050 con 0x7fd2ac061880 2021-01-27T09:45:19.750 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.741+0000 7fd2b1470700 1 -- 172.21.15.146:0/508926111 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2ac044ee0 con 0x7fd2ac061880 2021-01-27T09:45:19.751 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.741+0000 7fd292ffd700 1 -- 172.21.15.146:0/508926111 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fd29c00f070 con 0x7fd2ac061880 2021-01-27T09:45:19.751 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.745+0000 7fd292ffd700 1 --2- 172.21.15.146:0/508926111 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd28c0561e0 0x7fd28c0586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:19.751 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.745+0000 7fd292ffd700 1 -- 172.21.15.146:0/508926111 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fd29c071140 con 0x7fd2ac061880 2021-01-27T09:45:19.751 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.745+0000 7fd2aa7fc700 1 --2- 172.21.15.146:0/508926111 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd28c0561e0 0x7fd28c0586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:19.752 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.745+0000 7fd2aa7fc700 1 --2- 172.21.15.146:0/508926111 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd28c0561e0 0x7fd28c0586a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fd2a0007fd0 tx=0x7fd2a0009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:19.752 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.749+0000 7fd292ffd700 1 -- 172.21.15.146:0/508926111 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fd29c0467f0 con 0x7fd2ac061880 2021-01-27T09:45:19.892 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.889+0000 7fd2b1470700 1 -- 172.21.15.146:0/508926111 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2ac044680 con 0x7fd2ac061880 2021-01-27T09:45:19.894 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.893+0000 7fd292ffd700 1 -- 172.21.15.146:0/508926111 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18638 (secure 0 0 0) 0x7fd29c049e10 con 0x7fd2ac061880 2021-01-27T09:45:19.895 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:45:19.895 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":26,"fsid":"968a1bec-aac5-444e-b70f-7770587be945","created":"2021-01-27T09:44:13.797940+0000","modified":"2021-01-27T09:44:33.763400+0000","last_up_change":"2021-01-27T09:44:23.479967+0000","last_in_change":"2021-01-27T09:44:23.479967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T09:44:18.497521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-27T09:44:24.550303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-27T09:44:27.607542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-27T09:44:28.331389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-01-27T09:44:31.378452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25441909-a40b-4d82-828d-326685513ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":14470},{"type":"v1","addr":"172.21.15.146:6801","nonce":14470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":14470},{"type":"v1","addr":"172.21.15.146:6803","nonce":14470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":14470},{"type":"v1","addr":"172.21.15.146:6810","nonce":14470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":14470},{"type":"v1","addr":"172.21.15.146:6807","nonce":14470}]},"public_addr":"172.21.15.146:6801/14470","cluster_addr":"172.21.15.146:6803/14470","heartbeat_back_addr":"172.21.15.146:6810/14470","heartbeat_front_addr":"172.21.15.146:6807/14470","state":["exists","up"]},{"osd":1,"uuid":"825bbc51-2ffe-4612-a300-00960e48be02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":14472},{"type":"v1","addr":"172.21.15.146:6817","nonce":14472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":14472},{"type":"v1","addr":"172.21.15.146:6819","nonce":14472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":14472},{"type":"v1","addr":"172.21.15.146:6827","nonce":14472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":14472},{"type":"v1","addr":"172.21.15.146:6823","nonce":14472}]},"public_addr":"172.21.15.146:6817/14472","cluster_addr":"172.21.15.146:6819/14472","heartbeat_back_addr":"172.21.15.146:6827/14472","heartbeat_front_addr":"172.21.15.146:6823/14472","state":["exists","up"]},{"osd":2,"uuid":"e568b97a-8e71-4ab9-bd64-056892110b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":14474},{"type":"v1","addr":"172.21.15.146:6822","nonce":14474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":14474},{"type":"v1","addr":"172.21.15.146:6826","nonce":14474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":14474},{"type":"v1","addr":"172.21.15.146:6831","nonce":14474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":14474},{"type":"v1","addr":"172.21.15.146:6829","nonce":14474}]},"public_addr":"172.21.15.146:6822/14474","cluster_addr":"172.21.15.146:6826/14474","heartbeat_back_addr":"172.21.15.146:6831/14474","heartbeat_front_addr":"172.21.15.146:6829/14474","state":["exists","up"]},{"osd":3,"uuid":"f5d50f63-f74a-4aea-a62d-51c38db4d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":14471},{"type":"v1","addr":"172.21.15.146:6806","nonce":14471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":14471},{"type":"v1","addr":"172.21.15.146:6811","nonce":14471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":14471},{"type":"v1","addr":"172.21.15.146:6815","nonce":14471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":14471},{"type":"v1","addr":"172.21.15.146:6813","nonce":14471}]},"public_addr":"172.21.15.146:6806/14471","cluster_addr":"172.21.15.146:6811/14471","heartbeat_back_addr":"172.21.15.146:6815/14471","heartbeat_front_addr":"172.21.15.146:6813/14471","state":["exists","up"]},{"osd":4,"uuid":"782458d7-6f52-48f4-9466-67b61ef27016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":15826},{"type":"v1","addr":"172.21.15.78:6817","nonce":15826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":15826},{"type":"v1","addr":"172.21.15.78:6819","nonce":15826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":15826},{"type":"v1","addr":"172.21.15.78:6823","nonce":15826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":15826},{"type":"v1","addr":"172.21.15.78:6821","nonce":15826}]},"public_addr":"172.21.15.78:6817/15826","cluster_addr":"172.21.15.78:6819/15826","heartbeat_back_addr":"172.21.15.78:6823/15826","heartbeat_front_addr":"172.21.15.78:6821/15826","state":["exists","up"]},{"osd":5,"uuid":"1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":15827},{"type":"v1","addr":"172.21.15.78:6801","nonce":15827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":15827},{"type":"v1","addr":"172.21.15.78:6803","nonce":15827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":15827},{"type":"v1","addr":"172.21.15.78:6807","nonce":15827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":15827},{"type":"v1","addr":"172.21.15.78:6805","nonce":15827}]},"public_addr":"172.21.15.78:6801/15827","cluster_addr":"172.21.15.78:6803/15827","heartbeat_back_addr":"172.21.15.78:6807/15827","heartbeat_front_addr":"172.21.15.78:6805/15827","state":["exists","up"]},{"osd":6,"uuid":"4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":15825},{"type":"v1","addr":"172.21.15.78:6809","nonce":15825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":15825},{"type":"v1","addr":"172.21.15.78:6811","nonce":15825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":15825},{"type":"v1","addr":"172.21.15.78:6815","nonce":15825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":15825},{"type":"v1","addr":"172.21.15.78:6813","nonce":15825}]},"public_addr":"172.21.15.78:6809/15825","cluster_addr":"172.21.15.78:6811/15825","heartbeat_back_addr":"172.21.15.78:6815/15825","heartbeat_front_addr":"172.21.15.78:6813/15825","state":["exists","up"]},{"osd":7,"uuid":"851aeaf3-bcdc-4ac6-b578-c42e1bf87c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":15828},{"type":"v1","addr":"172.21.15.78:6825","nonce":15828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":15828},{"type":"v1","addr":"172.21.15.78:6827","nonce":15828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":15828},{"type":"v1","addr":"172.21.15.78:6831","nonce":15828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":15828},{"type":"v1","addr":"172.21.15.78:6829","nonce":15828}]},"public_addr":"172.21.15.78:6825/15828","cluster_addr":"172.21.15.78:6827/15828","heartbeat_back_addr":"172.21.15.78:6831/15828","heartbeat_front_addr":"172.21.15.78:6829/15828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.573930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.718144+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.641838+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.551598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.374444+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.171108+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.360910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.356020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:45:19.896 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.893+0000 7fd2b1470700 1 -- 172.21.15.146:0/508926111 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd28c0561e0 msgr2=0x7fd28c0586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:19.897 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.893+0000 7fd2b1470700 1 --2- 172.21.15.146:0/508926111 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd28c0561e0 0x7fd28c0586a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fd2a0007fd0 tx=0x7fd2a0009040).stop 2021-01-27T09:45:19.897 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.893+0000 7fd2b1470700 1 -- 172.21.15.146:0/508926111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2ac061880 msgr2=0x7fd2ac0bc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:19.897 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.893+0000 7fd2b1470700 1 --2- 172.21.15.146:0/508926111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2ac061880 0x7fd2ac0bc0b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fd29c009260 tx=0x7fd29c017000).stop 2021-01-27T09:45:19.897 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.893+0000 7fd2b1470700 1 -- 172.21.15.146:0/508926111 shutdown_connections 2021-01-27T09:45:19.898 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.893+0000 7fd2b1470700 1 --2- 172.21.15.146:0/508926111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2ac13eba0 0x7fd2ac14e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.898 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.893+0000 7fd2b1470700 1 --2- 172.21.15.146:0/508926111 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd2ac065d70 0x7fd2ac0bdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.898 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.893+0000 7fd2b1470700 1 --2- 172.21.15.146:0/508926111 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd28c0561e0 0x7fd28c0586a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.898 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.893+0000 7fd2b1470700 1 --2- 172.21.15.146:0/508926111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2ac061880 0x7fd2ac0bc0b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:19.898 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.893+0000 7fd2b1470700 1 -- 172.21.15.146:0/508926111 >> 172.21.15.146:0/508926111 conn(0x7fd2ac062810 msgr2=0x7fd2ac142350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:19.899 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.893+0000 7fd2b1470700 1 -- 172.21.15.146:0/508926111 shutdown_connections 2021-01-27T09:45:19.899 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:19.893+0000 7fd2b1470700 1 -- 172.21.15.146:0/508926111 wait complete. 2021-01-27T09:45:19.922 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-27T09:44:18.497521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-27T09:44:24.550303+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-27T09:44:27.607542+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-01-27T09:44:28.331389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2021-01-27T09:44:31.378452+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-27T09:45:19.923 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-01-27T09:45:20.095 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.093+0000 7ff3f4bbf700 1 Processor -- start 2021-01-27T09:45:20.096 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.093+0000 7ff3f4bbf700 1 -- start start 2021-01-27T09:45:20.098 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.097+0000 7ff3f4bbf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff3f00c4600 0x7ff3f0060450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:20.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.097+0000 7ff3f4bbf700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff3f00c49e0 0x7ff3f00c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:20.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.097+0000 7ff3f4bbf700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f014e2b0 con 0x7ff3f014dd70 2021-01-27T09:45:20.100 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.097+0000 7ff3f4bbf700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f014e550 con 0x7ff3f00c49e0 2021-01-27T09:45:20.100 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.097+0000 7ff3f4bbf700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f014e7f0 con 0x7ff3f00c4600 2021-01-27T09:45:20.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.097+0000 7ff3ef7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff3f00c4600 0x7ff3f0060450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:20.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.097+0000 7ff3ef7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff3f00c4600 0x7ff3f0060450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47440/0 (socket says 172.21.15.146:47440) 2021-01-27T09:45:20.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.097+0000 7ff3ef7fe700 1 -- 172.21.15.146:0/1865034776 learned_addr learned my addr 172.21.15.146:0/1865034776 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:20.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.097+0000 7ff3eeffd700 1 --2- 172.21.15.146:0/1865034776 >> v2:172.21.15.78:3300/0 conn(0x7ff3f00c49e0 0x7ff3f00c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:20.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.097+0000 7ff3ef7fe700 1 -- 172.21.15.146:0/1865034776 >> v2:172.21.15.78:3300/0 conn(0x7ff3f00c49e0 msgr2=0x7ff3f00c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:20.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.097+0000 7ff3ef7fe700 1 --2- 172.21.15.146:0/1865034776 >> v2:172.21.15.78:3300/0 conn(0x7ff3f00c49e0 0x7ff3f00c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.097+0000 7ff3ef7fe700 1 -- 172.21.15.146:0/1865034776 >> v1:172.21.15.146:6789/0 conn(0x7ff3f014dd70 legacy=0x7ff3f014ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:20.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.097+0000 7ff3ef7fe700 1 -- 172.21.15.146:0/1865034776 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f014ea90 con 0x7ff3f00c4600 2021-01-27T09:45:20.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.097+0000 7ff3ef7fe700 1 --2- 172.21.15.146:0/1865034776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3f00c4600 0x7ff3f0060450 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7ff3f005c990 tx=0x7ff3e0006ee0).ready entity=mon.1 client_cookie=f2a9ae8e79632bbd server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:20.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.101+0000 7ff3ee7fc700 1 -- 172.21.15.146:0/1865034776 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e00098d0 con 0x7ff3f00c4600 2021-01-27T09:45:20.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.101+0000 7ff3ee7fc700 1 -- 172.21.15.146:0/1865034776 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e0009a30 con 0x7ff3f00c4600 2021-01-27T09:45:20.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.101+0000 7ff3ee7fc700 1 -- 172.21.15.146:0/1865034776 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0009db0 con 0x7ff3f00c4600 2021-01-27T09:45:20.106 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.101+0000 7ff3f4bbf700 1 -- 172.21.15.146:0/1865034776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3f00c4600 msgr2=0x7ff3f0060450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:20.106 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.101+0000 7ff3f4bbf700 1 --2- 172.21.15.146:0/1865034776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3f00c4600 0x7ff3f0060450 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7ff3f005c990 tx=0x7ff3e0006ee0).stop 2021-01-27T09:45:20.106 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.101+0000 7ff3f4bbf700 1 -- 172.21.15.146:0/1865034776 shutdown_connections 2021-01-27T09:45:20.106 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.101+0000 7ff3f4bbf700 1 --2- 172.21.15.146:0/1865034776 >> v2:172.21.15.78:3300/0 conn(0x7ff3f00c49e0 0x7ff3f00c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.107 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.101+0000 7ff3f4bbf700 1 --2- 172.21.15.146:0/1865034776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3f00c4600 0x7ff3f0060450 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.108 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.101+0000 7ff3f4bbf700 1 -- 172.21.15.146:0/1865034776 >> 172.21.15.146:0/1865034776 conn(0x7ff3f0064f90 msgr2=0x7ff3f00653a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:20.108 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.101+0000 7ff3f4bbf700 1 -- 172.21.15.146:0/1865034776 shutdown_connections 2021-01-27T09:45:20.108 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.101+0000 7ff3f4bbf700 1 -- 172.21.15.146:0/1865034776 wait complete. 2021-01-27T09:45:20.108 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.101+0000 7ff3f4bbf700 1 Processor -- start 2021-01-27T09:45:20.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.101+0000 7ff3f4bbf700 1 -- start start 2021-01-27T09:45:20.111 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3f4bbf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3f00c49e0 0x7ff3f015e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:20.111 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3f4bbf700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3f014dd70 0x7ff3f00c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:20.112 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3f4bbf700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3f014ace0 0x7ff3f00bd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:20.112 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3f4bbf700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f0160960 con 0x7ff3f014ace0 2021-01-27T09:45:20.112 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3f4bbf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f015e560 con 0x7ff3f00c49e0 2021-01-27T09:45:20.112 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3f4bbf700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f00b2230 con 0x7ff3f014dd70 2021-01-27T09:45:20.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3ef7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3f00c49e0 0x7ff3f015e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:20.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3eeffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3f014dd70 0x7ff3f00c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:20.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3ef7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3f00c49e0 0x7ff3f015e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47448/0 (socket says 172.21.15.146:47448) 2021-01-27T09:45:20.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3ef7fe700 1 -- 172.21.15.146:0/624466106 learned_addr learned my addr 172.21.15.146:0/624466106 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:20.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3eeffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3f014dd70 0x7ff3f00c12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36932/0 (socket says 172.21.15.146:36932) 2021-01-27T09:45:20.114 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3effff700 1 --2- 172.21.15.146:0/624466106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3f014ace0 0x7ff3f00bd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:20.114 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3ef7fe700 1 -- 172.21.15.146:0/624466106 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3f014dd70 msgr2=0x7ff3f00c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:20.114 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3ef7fe700 1 --2- 172.21.15.146:0/624466106 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3f014dd70 0x7ff3f00c12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.115 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3ef7fe700 1 -- 172.21.15.146:0/624466106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3f014ace0 msgr2=0x7ff3f00bd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:20.115 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3ef7fe700 1 --2- 172.21.15.146:0/624466106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3f014ace0 0x7ff3f00bd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.115 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3ef7fe700 1 -- 172.21.15.146:0/624466106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f00b24d0 con 0x7ff3f00c49e0 2021-01-27T09:45:20.115 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3ef7fe700 1 --2- 172.21.15.146:0/624466106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3f00c49e0 0x7ff3f015e070 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7ff3e000b1d0 tx=0x7ff3e0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:20.115 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3d77fe700 1 -- 172.21.15.146:0/624466106 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0012d20 con 0x7ff3f00c49e0 2021-01-27T09:45:20.116 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3d77fe700 1 -- 172.21.15.146:0/624466106 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e0012e80 con 0x7ff3f00c49e0 2021-01-27T09:45:20.116 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3f4bbf700 1 -- 172.21.15.146:0/624466106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f00b2770 con 0x7ff3f00c49e0 2021-01-27T09:45:20.116 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3d77fe700 1 -- 172.21.15.146:0/624466106 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e001c650 con 0x7ff3f00c49e0 2021-01-27T09:45:20.116 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3f4bbf700 1 -- 172.21.15.146:0/624466106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f00bcd10 con 0x7ff3f00c49e0 2021-01-27T09:45:20.117 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.105+0000 7ff3f4bbf700 1 -- 172.21.15.146:0/624466106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f00b2900 con 0x7ff3f00c49e0 2021-01-27T09:45:20.117 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.109+0000 7ff3d77fe700 1 -- 172.21.15.146:0/624466106 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7ff3e000f070 con 0x7ff3f00c49e0 2021-01-27T09:45:20.118 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.109+0000 7ff3d77fe700 1 --2- 172.21.15.146:0/624466106 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff3d00561b0 0x7ff3d0058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:20.118 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.109+0000 7ff3d77fe700 1 -- 172.21.15.146:0/624466106 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7ff3e0070bf0 con 0x7ff3f00c49e0 2021-01-27T09:45:20.118 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.109+0000 7ff3eeffd700 1 --2- 172.21.15.146:0/624466106 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff3d00561b0 0x7ff3d0058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:20.118 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.113+0000 7ff3eeffd700 1 --2- 172.21.15.146:0/624466106 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff3d00561b0 0x7ff3d0058670 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7ff3f0152390 tx=0x7ff3e4006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:20.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.113+0000 7ff3d77fe700 1 -- 172.21.15.146:0/624466106 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7ff3e0046190 con 0x7ff3f00c49e0 2021-01-27T09:45:20.261 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.257+0000 7ff3f4bbf700 1 -- 172.21.15.146:0/624466106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff3f00bb530 con 0x7ff3f00c49e0 2021-01-27T09:45:20.262 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.261+0000 7ff3d77fe700 1 -- 172.21.15.146:0/624466106 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff3e00497b0 con 0x7ff3f00c49e0 2021-01-27T09:45:20.262 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2021-01-27T09:45:20.266 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.261+0000 7ff3f4bbf700 1 -- 172.21.15.146:0/624466106 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff3d00561b0 msgr2=0x7ff3d0058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:20.266 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.261+0000 7ff3f4bbf700 1 --2- 172.21.15.146:0/624466106 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff3d00561b0 0x7ff3d0058670 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7ff3f0152390 tx=0x7ff3e4006e20).stop 2021-01-27T09:45:20.266 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.261+0000 7ff3f4bbf700 1 -- 172.21.15.146:0/624466106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3f00c49e0 msgr2=0x7ff3f015e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:20.266 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.261+0000 7ff3f4bbf700 1 --2- 172.21.15.146:0/624466106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3f00c49e0 0x7ff3f015e070 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7ff3e000b1d0 tx=0x7ff3e0016000).stop 2021-01-27T09:45:20.267 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.265+0000 7ff3f4bbf700 1 -- 172.21.15.146:0/624466106 shutdown_connections 2021-01-27T09:45:20.267 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.265+0000 7ff3f4bbf700 1 --2- 172.21.15.146:0/624466106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3f014ace0 0x7ff3f00bd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.267 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.265+0000 7ff3f4bbf700 1 --2- 172.21.15.146:0/624466106 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3f014dd70 0x7ff3f00c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.267 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.265+0000 7ff3f4bbf700 1 --2- 172.21.15.146:0/624466106 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff3d00561b0 0x7ff3d0058670 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.270 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.265+0000 7ff3f4bbf700 1 --2- 172.21.15.146:0/624466106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3f00c49e0 0x7ff3f015e070 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.270 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.265+0000 7ff3f4bbf700 1 -- 172.21.15.146:0/624466106 >> 172.21.15.146:0/624466106 conn(0x7ff3f0064f90 msgr2=0x7ff3f0060480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:20.271 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.265+0000 7ff3f4bbf700 1 -- 172.21.15.146:0/624466106 shutdown_connections 2021-01-27T09:45:20.271 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.265+0000 7ff3f4bbf700 1 -- 172.21.15.146:0/624466106 wait complete. 2021-01-27T09:45:20.293 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-01-27T09:45:20.455 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.453+0000 7f30f526e700 1 Processor -- start 2021-01-27T09:45:20.455 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.453+0000 7f30f526e700 1 -- start start 2021-01-27T09:45:20.458 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.457+0000 7f30f526e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f30f0061360 0x7f30f0061740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:20.458 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.457+0000 7f30f526e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f30f0062c20 0x7f30f014afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:20.459 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.457+0000 7f30f526e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f0151500 con 0x7f30f00c2470 2021-01-27T09:45:20.459 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.457+0000 7f30f526e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f00bfcd0 con 0x7f30f0061360 2021-01-27T09:45:20.459 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.457+0000 7f30f526e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f01517a0 con 0x7f30f0062c20 2021-01-27T09:45:20.460 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.457+0000 7f30ee7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f30f0062c20 0x7f30f014afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:20.460 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.457+0000 7f30ee7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f30f0062c20 0x7f30f014afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47456/0 (socket says 172.21.15.146:47456) 2021-01-27T09:45:20.461 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.457+0000 7f30ee7fc700 1 -- 172.21.15.146:0/1823603094 learned_addr learned my addr 172.21.15.146:0/1823603094 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:20.461 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.457+0000 7f30eeffd700 1 --2- 172.21.15.146:0/1823603094 >> v2:172.21.15.78:3300/0 conn(0x7f30f0061360 0x7f30f0061740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:20.461 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.457+0000 7f30effff700 1 --1- 172.21.15.146:0/1823603094 >> v1:172.21.15.78:6789/0 conn(0x7f30f00c2470 0x7f30f014ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:35064/0 (socket says 172.21.15.146:35064) 2021-01-27T09:45:20.461 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.457+0000 7f30ee7fc700 1 -- 172.21.15.146:0/1823603094 >> v2:172.21.15.78:3300/0 conn(0x7f30f0061360 msgr2=0x7f30f0061740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:20.462 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.457+0000 7f30ee7fc700 1 --2- 172.21.15.146:0/1823603094 >> v2:172.21.15.78:3300/0 conn(0x7f30f0061360 0x7f30f0061740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.462 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.457+0000 7f30ee7fc700 1 -- 172.21.15.146:0/1823603094 >> v1:172.21.15.78:6789/0 conn(0x7f30f00c2470 legacy=0x7f30f014ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:20.462 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.457+0000 7f30ee7fc700 1 -- 172.21.15.146:0/1823603094 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f0151a40 con 0x7f30f0062c20 2021-01-27T09:45:20.462 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.457+0000 7f30ee7fc700 1 --2- 172.21.15.146:0/1823603094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30f0062c20 0x7f30f014afc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f30f014ef20 tx=0x7f30e4006ee0).ready entity=mon.1 client_cookie=2b1baae41e72c16c server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.457+0000 7f30edffb700 1 -- 172.21.15.146:0/1823603094 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e40098d0 con 0x7f30f0062c20 2021-01-27T09:45:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.457+0000 7f30edffb700 1 -- 172.21.15.146:0/1823603094 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e4009a30 con 0x7f30f0062c20 2021-01-27T09:45:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.457+0000 7f30edffb700 1 -- 172.21.15.146:0/1823603094 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e4009db0 con 0x7f30f0062c20 2021-01-27T09:45:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.461+0000 7f30f526e700 1 -- 172.21.15.146:0/1823603094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30f0062c20 msgr2=0x7f30f014afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:20.468 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.461+0000 7f30f526e700 1 --2- 172.21.15.146:0/1823603094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30f0062c20 0x7f30f014afc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f30f014ef20 tx=0x7f30e4006ee0).stop 2021-01-27T09:45:20.468 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.461+0000 7f30f526e700 1 -- 172.21.15.146:0/1823603094 shutdown_connections 2021-01-27T09:45:20.468 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.461+0000 7f30f526e700 1 --2- 172.21.15.146:0/1823603094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30f0062c20 0x7f30f014afc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.468 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.461+0000 7f30f526e700 1 --2- 172.21.15.146:0/1823603094 >> v2:172.21.15.78:3300/0 conn(0x7f30f0061360 0x7f30f0061740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.469 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.461+0000 7f30f526e700 1 -- 172.21.15.146:0/1823603094 >> 172.21.15.146:0/1823603094 conn(0x7f30f0062810 msgr2=0x7f30f0067ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:20.469 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.461+0000 7f30f526e700 1 -- 172.21.15.146:0/1823603094 shutdown_connections 2021-01-27T09:45:20.469 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.461+0000 7f30f526e700 1 -- 172.21.15.146:0/1823603094 wait complete. 2021-01-27T09:45:20.469 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.461+0000 7f30f526e700 1 Processor -- start 2021-01-27T09:45:20.470 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.461+0000 7f30f526e700 1 -- start start 2021-01-27T09:45:20.470 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30f526e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f30f0061360 0x7f30f01458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:20.470 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30f526e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f00c2470 0x7f30f014d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:20.471 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30f526e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30f0145dc0 0x7f30f0143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:20.471 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30f526e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f0160ef0 con 0x7f30f00c2470 2021-01-27T09:45:20.471 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30f526e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f0161190 con 0x7f30f0145dc0 2021-01-27T09:45:20.472 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30f526e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f0161430 con 0x7f30f0061360 2021-01-27T09:45:20.472 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30effff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30f0145dc0 0x7f30f0143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:20.473 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30effff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30f0145dc0 0x7f30f0143560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47460/0 (socket says 172.21.15.146:47460) 2021-01-27T09:45:20.473 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30effff700 1 -- 172.21.15.146:0/1330801747 learned_addr learned my addr 172.21.15.146:0/1330801747 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:20.473 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30ee7fc700 1 --2- 172.21.15.146:0/1330801747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f00c2470 0x7f30f014d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:20.474 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30eeffd700 1 --2- 172.21.15.146:0/1330801747 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f30f0061360 0x7f30f01458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:20.475 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30effff700 1 -- 172.21.15.146:0/1330801747 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f30f0061360 msgr2=0x7f30f01458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:20.475 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30effff700 1 --2- 172.21.15.146:0/1330801747 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f30f0061360 0x7f30f01458d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.476 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30effff700 1 -- 172.21.15.146:0/1330801747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f00c2470 msgr2=0x7f30f014d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:20.476 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30effff700 1 --2- 172.21.15.146:0/1330801747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f00c2470 0x7f30f014d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.476 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30effff700 1 -- 172.21.15.146:0/1330801747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f01616d0 con 0x7f30f0145dc0 2021-01-27T09:45:20.476 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30ee7fc700 1 --2- 172.21.15.146:0/1330801747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f00c2470 0x7f30f014d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:45:20.476 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30effff700 1 --2- 172.21.15.146:0/1330801747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30f0145dc0 0x7f30f0143560 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f30e800ca90 tx=0x7f30e80013a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:20.478 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30d6ffd700 1 -- 172.21.15.146:0/1330801747 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8005af0 con 0x7f30f0145dc0 2021-01-27T09:45:20.478 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30d6ffd700 1 -- 172.21.15.146:0/1330801747 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e8005c50 con 0x7f30f0145dc0 2021-01-27T09:45:20.478 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30f526e700 1 -- 172.21.15.146:0/1330801747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f0161970 con 0x7f30f0145dc0 2021-01-27T09:45:20.479 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30d6ffd700 1 -- 172.21.15.146:0/1330801747 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8007110 con 0x7f30f0145dc0 2021-01-27T09:45:20.479 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30f526e700 1 -- 172.21.15.146:0/1330801747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f014b640 con 0x7f30f0145dc0 2021-01-27T09:45:20.479 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.465+0000 7f30f526e700 1 -- 172.21.15.146:0/1330801747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f014f1b0 con 0x7f30f0145dc0 2021-01-27T09:45:20.480 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.469+0000 7f30d6ffd700 1 -- 172.21.15.146:0/1330801747 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f30e8010030 con 0x7f30f0145dc0 2021-01-27T09:45:20.480 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.469+0000 7f30d6ffd700 1 --2- 172.21.15.146:0/1330801747 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f30d00561b0 0x7f30d0058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:20.480 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.469+0000 7f30d6ffd700 1 -- 172.21.15.146:0/1330801747 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f30e806f4a0 con 0x7f30f0145dc0 2021-01-27T09:45:20.480 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.469+0000 7f30eeffd700 1 --2- 172.21.15.146:0/1330801747 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f30d00561b0 0x7f30d0058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:20.480 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.469+0000 7f30eeffd700 1 --2- 172.21.15.146:0/1330801747 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f30d00561b0 0x7f30d0058670 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f30e000bbc0 tx=0x7f30e0008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:20.481 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.473+0000 7f30d6ffd700 1 -- 172.21.15.146:0/1330801747 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f30f014f1b0 con 0x7f30f0145dc0 2021-01-27T09:45:20.618 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.617+0000 7f30f526e700 1 -- 172.21.15.146:0/1330801747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f30f014f1b0 con 0x7f30f0145dc0 2021-01-27T09:45:20.619 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.617+0000 7f30d6ffd700 1 -- 172.21.15.146:0/1330801747 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f30f014f1b0 con 0x7f30f0145dc0 2021-01-27T09:45:20.619 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:45:20.622 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.617+0000 7f30f526e700 1 -- 172.21.15.146:0/1330801747 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f30d00561b0 msgr2=0x7f30d0058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:20.622 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.617+0000 7f30f526e700 1 --2- 172.21.15.146:0/1330801747 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f30d00561b0 0x7f30d0058670 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f30e000bbc0 tx=0x7f30e0008040).stop 2021-01-27T09:45:20.622 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.617+0000 7f30f526e700 1 -- 172.21.15.146:0/1330801747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30f0145dc0 msgr2=0x7f30f0143560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:20.622 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.617+0000 7f30f526e700 1 --2- 172.21.15.146:0/1330801747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30f0145dc0 0x7f30f0143560 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f30e800ca90 tx=0x7f30e80013a0).stop 2021-01-27T09:45:20.623 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.617+0000 7f30f526e700 1 -- 172.21.15.146:0/1330801747 shutdown_connections 2021-01-27T09:45:20.623 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.617+0000 7f30f526e700 1 --2- 172.21.15.146:0/1330801747 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f30d00561b0 0x7f30d0058670 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.623 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.617+0000 7f30f526e700 1 --2- 172.21.15.146:0/1330801747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30f0145dc0 0x7f30f0143560 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.623 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.617+0000 7f30f526e700 1 --2- 172.21.15.146:0/1330801747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f00c2470 0x7f30f014d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.623 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.617+0000 7f30f526e700 1 --2- 172.21.15.146:0/1330801747 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f30f0061360 0x7f30f01458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.624 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.621+0000 7f30f526e700 1 -- 172.21.15.146:0/1330801747 >> 172.21.15.146:0/1330801747 conn(0x7f30f0062810 msgr2=0x7f30f00bea40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:20.624 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.621+0000 7f30f526e700 1 -- 172.21.15.146:0/1330801747 shutdown_connections 2021-01-27T09:45:20.624 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.621+0000 7f30f526e700 1 -- 172.21.15.146:0/1330801747 wait complete. 2021-01-27T09:45:20.648 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-01-27T09:45:20.810 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.809+0000 7f483d719700 1 Processor -- start 2021-01-27T09:45:20.810 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.809+0000 7f483d719700 1 -- start start 2021-01-27T09:45:20.812 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.809+0000 7f483d719700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f48380676b0 0x7f48380c0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:20.812 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.809+0000 7f483d719700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4838151a00 con 0x7f4838069580 2021-01-27T09:45:20.812 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.809+0000 7f483d719700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48380c1140 con 0x7f48380672d0 2021-01-27T09:45:20.812 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.809+0000 7f483d719700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4838065110 con 0x7f48380676b0 2021-01-27T09:45:20.813 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.809+0000 7f48377fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f48380676b0 0x7f48380c0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:20.813 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.809+0000 7f4837fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f48380672d0 0x7f48381512e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47040/0 (socket says 172.21.15.146:47040) 2021-01-27T09:45:20.814 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.809+0000 7f4837fff700 1 -- 172.21.15.146:0/631136470 learned_addr learned my addr 172.21.15.146:0/631136470 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:20.814 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.809+0000 7f48377fe700 1 -- 172.21.15.146:0/631136470 >> v1:172.21.15.146:6789/0 conn(0x7f48380672d0 legacy=0x7f48381512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:20.814 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.809+0000 7f48377fe700 1 -- 172.21.15.146:0/631136470 >> v1:172.21.15.78:6789/0 conn(0x7f4838069580 legacy=0x7f483814ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:20.815 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.809+0000 7f48377fe700 1 -- 172.21.15.146:0/631136470 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48380653b0 con 0x7f48380676b0 2021-01-27T09:45:20.815 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.809+0000 7f4836ffd700 1 -- 172.21.15.146:0/631136470 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3466083446 0 0) 0x7f48380c1140 con 0x7f48380672d0 2021-01-27T09:45:20.815 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.813+0000 7f48377fe700 1 --2- 172.21.15.146:0/631136470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48380676b0 0x7f48380c0c50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f482c00b9c0 tx=0x7f482c006e20).ready entity=mon.0 client_cookie=5be647416708824c server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:20.816 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.813+0000 7f4836ffd700 1 -- 172.21.15.146:0/631136470 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c0096e0 con 0x7f48380676b0 2021-01-27T09:45:20.817 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.813+0000 7f4836ffd700 1 -- 172.21.15.146:0/631136470 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482c009840 con 0x7f48380676b0 2021-01-27T09:45:20.817 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.813+0000 7f4836ffd700 1 -- 172.21.15.146:0/631136470 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c009bc0 con 0x7f48380676b0 2021-01-27T09:45:20.817 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.813+0000 7f483d719700 1 -- 172.21.15.146:0/631136470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48380676b0 msgr2=0x7f48380c0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:20.817 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.813+0000 7f483d719700 1 --2- 172.21.15.146:0/631136470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48380676b0 0x7f48380c0c50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f482c00b9c0 tx=0x7f482c006e20).stop 2021-01-27T09:45:20.817 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.813+0000 7f483d719700 1 -- 172.21.15.146:0/631136470 shutdown_connections 2021-01-27T09:45:20.818 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.813+0000 7f483d719700 1 --2- 172.21.15.146:0/631136470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48380676b0 0x7f48380c0c50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.818 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.813+0000 7f483d719700 1 -- 172.21.15.146:0/631136470 >> 172.21.15.146:0/631136470 conn(0x7f4838067da0 msgr2=0x7f48380681b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:20.818 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.813+0000 7f483d719700 1 -- 172.21.15.146:0/631136470 shutdown_connections 2021-01-27T09:45:20.818 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.813+0000 7f483d719700 1 -- 172.21.15.146:0/631136470 wait complete. 2021-01-27T09:45:20.820 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.817+0000 7f483d719700 1 Processor -- start 2021-01-27T09:45:20.820 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.817+0000 7f483d719700 1 -- start start 2021-01-27T09:45:20.820 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.817+0000 7f483d719700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48380672d0 0x7f483814e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:20.821 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.817+0000 7f483d719700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48380676b0 0x7f48380c3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:20.821 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.817+0000 7f483d719700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4838069580 0x7f483814bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:20.821 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.817+0000 7f483d719700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48381540c0 con 0x7f4838069580 2021-01-27T09:45:20.821 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.817+0000 7f483d719700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4838154360 con 0x7f48380676b0 2021-01-27T09:45:20.821 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.817+0000 7f483d719700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4838154600 con 0x7f48380672d0 2021-01-27T09:45:20.822 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.817+0000 7f48377fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48380676b0 0x7f48380c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:20.823 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.817+0000 7f48377fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48380676b0 0x7f48380c3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47476/0 (socket says 172.21.15.146:47476) 2021-01-27T09:45:20.824 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.817+0000 7f48377fe700 1 -- 172.21.15.146:0/2640876597 learned_addr learned my addr 172.21.15.146:0/2640876597 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:20.824 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.817+0000 7f483cf18700 1 --2- 172.21.15.146:0/2640876597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4838069580 0x7f483814bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:20.824 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.817+0000 7f4837fff700 1 --2- 172.21.15.146:0/2640876597 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48380672d0 0x7f483814e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:20.824 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.817+0000 7f48377fe700 1 -- 172.21.15.146:0/2640876597 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48380672d0 msgr2=0x7f483814e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:20.825 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.817+0000 7f48377fe700 1 --2- 172.21.15.146:0/2640876597 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48380672d0 0x7f483814e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.825 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.817+0000 7f48377fe700 1 -- 172.21.15.146:0/2640876597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4838069580 msgr2=0x7f483814bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:20.825 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.817+0000 7f48377fe700 1 --2- 172.21.15.146:0/2640876597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4838069580 0x7f483814bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.825 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.817+0000 7f48377fe700 1 -- 172.21.15.146:0/2640876597 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48381548a0 con 0x7f48380676b0 2021-01-27T09:45:20.825 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.821+0000 7f48377fe700 1 --2- 172.21.15.146:0/2640876597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48380676b0 0x7f48380c3420 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f482c006e60 tx=0x7f482c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:20.826 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.821+0000 7f481ffff700 1 -- 172.21.15.146:0/2640876597 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c011c40 con 0x7f48380676b0 2021-01-27T09:45:20.826 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.821+0000 7f481ffff700 1 -- 172.21.15.146:0/2640876597 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482c011da0 con 0x7f48380676b0 2021-01-27T09:45:20.826 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.821+0000 7f483d719700 1 -- 172.21.15.146:0/2640876597 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f483815d6f0 con 0x7f48380676b0 2021-01-27T09:45:20.826 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.821+0000 7f481ffff700 1 -- 172.21.15.146:0/2640876597 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c01d660 con 0x7f48380676b0 2021-01-27T09:45:20.827 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.821+0000 7f483d719700 1 -- 172.21.15.146:0/2640876597 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48380c3dc0 con 0x7f48380676b0 2021-01-27T09:45:20.827 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.821+0000 7f483d719700 1 -- 172.21.15.146:0/2640876597 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483806a190 con 0x7f48380676b0 2021-01-27T09:45:20.828 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.821+0000 7f481ffff700 1 -- 172.21.15.146:0/2640876597 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f482c00f070 con 0x7f48380676b0 2021-01-27T09:45:20.829 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.821+0000 7f481ffff700 1 --2- 172.21.15.146:0/2640876597 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4818056210 0x7f48180586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:20.829 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.825+0000 7f481ffff700 1 -- 172.21.15.146:0/2640876597 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f482c070ef0 con 0x7f48380676b0 2021-01-27T09:45:20.829 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.825+0000 7f4837fff700 1 --2- 172.21.15.146:0/2640876597 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4818056210 0x7f48180586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:20.829 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.825+0000 7f4837fff700 1 --2- 172.21.15.146:0/2640876597 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4818056210 0x7f48180586d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f48280011e0 tx=0x7f4828007a30).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:20.832 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.829+0000 7f481ffff700 1 -- 172.21.15.146:0/2640876597 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f482c0465a0 con 0x7f48380676b0 2021-01-27T09:45:20.978 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.977+0000 7f483d719700 1 -- 172.21.15.146:0/2640876597 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4838060810 con 0x7f48380676b0 2021-01-27T09:45:20.979 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.977+0000 7f481ffff700 1 -- 172.21.15.146:0/2640876597 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+10 (secure 0 0 0) 0x7f482c049bc0 con 0x7f48380676b0 2021-01-27T09:45:20.979 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:45:20.983 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.981+0000 7f483d719700 1 -- 172.21.15.146:0/2640876597 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4818056210 msgr2=0x7f48180586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:20.983 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.981+0000 7f483d719700 1 --2- 172.21.15.146:0/2640876597 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4818056210 0x7f48180586d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f48280011e0 tx=0x7f4828007a30).stop 2021-01-27T09:45:20.984 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.981+0000 7f483d719700 1 -- 172.21.15.146:0/2640876597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48380676b0 msgr2=0x7f48380c3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:20.984 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.981+0000 7f483d719700 1 --2- 172.21.15.146:0/2640876597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48380676b0 0x7f48380c3420 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f482c006e60 tx=0x7f482c016000).stop 2021-01-27T09:45:20.984 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.981+0000 7f483d719700 1 -- 172.21.15.146:0/2640876597 shutdown_connections 2021-01-27T09:45:20.985 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.981+0000 7f483d719700 1 --2- 172.21.15.146:0/2640876597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4838069580 0x7f483814bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.985 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.981+0000 7f483d719700 1 --2- 172.21.15.146:0/2640876597 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4818056210 0x7f48180586d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.985 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.981+0000 7f483d719700 1 --2- 172.21.15.146:0/2640876597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48380676b0 0x7f48380c3420 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.986 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.981+0000 7f483d719700 1 --2- 172.21.15.146:0/2640876597 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48380672d0 0x7f483814e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:20.986 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.981+0000 7f483d719700 1 -- 172.21.15.146:0/2640876597 >> 172.21.15.146:0/2640876597 conn(0x7f4838067da0 msgr2=0x7f4838062750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:20.987 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.981+0000 7f483d719700 1 -- 172.21.15.146:0/2640876597 shutdown_connections 2021-01-27T09:45:20.988 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:20.981+0000 7f483d719700 1 -- 172.21.15.146:0/2640876597 wait complete. 2021-01-27T09:45:21.013 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-01-27T09:45:21.187 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.185+0000 7f3209b25700 1 Processor -- start 2021-01-27T09:45:21.187 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.185+0000 7f3209b25700 1 -- start start 2021-01-27T09:45:21.189 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.185+0000 7f3209b25700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3204065260 0x7f32040bf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:21.190 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.189+0000 7f3209b25700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32040bf5c0 con 0x7f32040bbb20 2021-01-27T09:45:21.190 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.189+0000 7f3209b25700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32040bf860 con 0x7f3204065640 2021-01-27T09:45:21.190 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.189+0000 7f3209b25700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3204063830 con 0x7f3204065260 2021-01-27T09:45:21.191 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.189+0000 7f32037fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3204065260 0x7f32040bf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:21.191 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.189+0000 7f3203fff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f32040bbb20 0x7f320414af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:35092/0 (socket says 172.21.15.146:35092) 2021-01-27T09:45:21.191 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.189+0000 7f3203fff700 1 -- 172.21.15.146:0/1346750137 learned_addr learned my addr 172.21.15.146:0/1346750137 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:21.192 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.189+0000 7f32027fc700 1 -- 172.21.15.146:0/1346750137 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591203161 0 0) 0x7f32040bf860 con 0x7f3204065640 2021-01-27T09:45:21.193 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.189+0000 7f32027fc700 1 -- 172.21.15.146:0/1346750137 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31f0003270 con 0x7f3204065640 2021-01-27T09:45:21.193 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.189+0000 7f32027fc700 1 -- 172.21.15.146:0/1346750137 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820085903 0 0) 0x7f32040bf5c0 con 0x7f32040bbb20 2021-01-27T09:45:21.193 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.189+0000 7f32037fe700 1 -- 172.21.15.146:0/1346750137 >> v1:172.21.15.146:6789/0 conn(0x7f3204065640 legacy=0x7f3204151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:21.193 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.189+0000 7f32037fe700 1 -- 172.21.15.146:0/1346750137 >> v1:172.21.15.78:6789/0 conn(0x7f32040bbb20 legacy=0x7f320414af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:21.194 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.189+0000 7f32037fe700 1 -- 172.21.15.146:0/1346750137 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32040bfb00 con 0x7f3204065260 2021-01-27T09:45:21.194 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.189+0000 7f32037fe700 1 --2- 172.21.15.146:0/1346750137 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3204065260 0x7f32040bf010 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f31f400b9f0 tx=0x7f31f4006e20).ready entity=mon.2 client_cookie=44bfceaa863449e7 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:21.195 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.189+0000 7f32027fc700 1 -- 172.21.15.146:0/1346750137 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f400bee0 con 0x7f3204065260 2021-01-27T09:45:21.195 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.193+0000 7f32027fc700 1 -- 172.21.15.146:0/1346750137 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f40097e0 con 0x7f3204065260 2021-01-27T09:45:21.195 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.193+0000 7f32027fc700 1 -- 172.21.15.146:0/1346750137 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4009b60 con 0x7f3204065260 2021-01-27T09:45:21.196 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.193+0000 7f3209b25700 1 -- 172.21.15.146:0/1346750137 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3204065260 msgr2=0x7f32040bf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:21.196 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.193+0000 7f3209b25700 1 --2- 172.21.15.146:0/1346750137 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3204065260 0x7f32040bf010 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f31f400b9f0 tx=0x7f31f4006e20).stop 2021-01-27T09:45:21.196 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.193+0000 7f3209b25700 1 -- 172.21.15.146:0/1346750137 shutdown_connections 2021-01-27T09:45:21.196 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.193+0000 7f3209b25700 1 --2- 172.21.15.146:0/1346750137 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3204065260 0x7f32040bf010 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:21.197 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.193+0000 7f3209b25700 1 -- 172.21.15.146:0/1346750137 >> 172.21.15.146:0/1346750137 conn(0x7f3204069110 msgr2=0x7f3204067e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:21.197 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.193+0000 7f3209b25700 1 -- 172.21.15.146:0/1346750137 shutdown_connections 2021-01-27T09:45:21.197 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.193+0000 7f3209b25700 1 -- 172.21.15.146:0/1346750137 wait complete. 2021-01-27T09:45:21.200 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.193+0000 7f3209b25700 1 Processor -- start 2021-01-27T09:45:21.200 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.193+0000 7f3209b25700 1 -- start start 2021-01-27T09:45:21.201 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.197+0000 7f3209b25700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3204065640 0x7f32041616e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:21.201 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.197+0000 7f3209b25700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32040bbb20 0x7f320414dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:21.201 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.197+0000 7f3209b25700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32040bae40 0x7f320414e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:21.201 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.197+0000 7f3209b25700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3204161bd0 con 0x7f3204065640 2021-01-27T09:45:21.202 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.197+0000 7f3209b25700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320414e980 con 0x7f32040bbb20 2021-01-27T09:45:21.202 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.197+0000 7f3209b25700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32040c2560 con 0x7f32040bae40 2021-01-27T09:45:21.202 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.197+0000 7f3203fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32040bae40 0x7f320414e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:21.202 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.197+0000 7f3202ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32040bbb20 0x7f320414dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:21.203 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.197+0000 7f32037fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3204065640 0x7f32041616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:21.203 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.197+0000 7f3203fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32040bae40 0x7f320414e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:36976/0 (socket says 172.21.15.146:36976) 2021-01-27T09:45:21.203 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.197+0000 7f3203fff700 1 -- 172.21.15.146:0/3448033309 learned_addr learned my addr 172.21.15.146:0/3448033309 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:21.203 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.197+0000 7f3203fff700 1 -- 172.21.15.146:0/3448033309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32040bbb20 msgr2=0x7f320414dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:21.204 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.197+0000 7f3203fff700 1 --2- 172.21.15.146:0/3448033309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32040bbb20 0x7f320414dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:21.204 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.197+0000 7f3203fff700 1 -- 172.21.15.146:0/3448033309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3204065640 msgr2=0x7f32041616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:21.204 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.197+0000 7f3203fff700 1 --2- 172.21.15.146:0/3448033309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3204065640 0x7f32041616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:21.204 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.197+0000 7f3203fff700 1 -- 172.21.15.146:0/3448033309 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320414db70 con 0x7f32040bae40 2021-01-27T09:45:21.205 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.197+0000 7f3202ffd700 1 --2- 172.21.15.146:0/3448033309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32040bbb20 0x7f320414dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:45:21.205 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.197+0000 7f3203fff700 1 --2- 172.21.15.146:0/3448033309 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32040bae40 0x7f320414e490 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f31fc00cb40 tx=0x7f31fc0013f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:21.205 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.197+0000 7f31eb7fe700 1 -- 172.21.15.146:0/3448033309 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc00ce50 con 0x7f32040bae40 2021-01-27T09:45:21.205 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.197+0000 7f31eb7fe700 1 -- 172.21.15.146:0/3448033309 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc005bb0 con 0x7f32040bae40 2021-01-27T09:45:21.206 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.197+0000 7f3209b25700 1 -- 172.21.15.146:0/3448033309 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32040bb360 con 0x7f32040bae40 2021-01-27T09:45:21.206 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.197+0000 7f31eb7fe700 1 -- 172.21.15.146:0/3448033309 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc007110 con 0x7f32040bae40 2021-01-27T09:45:21.206 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.197+0000 7f3209b25700 1 -- 172.21.15.146:0/3448033309 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32040ba900 con 0x7f32040bae40 2021-01-27T09:45:21.207 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.201+0000 7f3209b25700 1 -- 172.21.15.146:0/3448033309 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3204044ee0 con 0x7f32040bae40 2021-01-27T09:45:21.207 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.201+0000 7f31eb7fe700 1 -- 172.21.15.146:0/3448033309 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f31fc010030 con 0x7f32040bae40 2021-01-27T09:45:21.208 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.201+0000 7f31eb7fe700 1 --2- 172.21.15.146:0/3448033309 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f31e40561e0 0x7f31e40586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:21.208 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.201+0000 7f31eb7fe700 1 -- 172.21.15.146:0/3448033309 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f31fc06f550 con 0x7f32040bae40 2021-01-27T09:45:21.208 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.201+0000 7f32037fe700 1 --2- 172.21.15.146:0/3448033309 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f31e40561e0 0x7f31e40586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:21.208 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.205+0000 7f32037fe700 1 --2- 172.21.15.146:0/3448033309 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f31e40561e0 0x7f31e40586a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f32040642b0 tx=0x7f31f4016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:21.212 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.209+0000 7f31eb7fe700 1 -- 172.21.15.146:0/3448033309 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f31fc044af0 con 0x7f32040bae40 2021-01-27T09:45:21.358 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.357+0000 7f3209b25700 1 -- 172.21.15.146:0/3448033309 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f32040c43c0 con 0x7f32040bae40 2021-01-27T09:45:21.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.357+0000 7f31eb7fe700 1 -- 172.21.15.146:0/3448033309 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+10 (secure 0 0 0) 0x7f31fc048110 con 0x7f32040bae40 2021-01-27T09:45:21.360 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:45:21.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.361+0000 7f3209b25700 1 -- 172.21.15.146:0/3448033309 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f31e40561e0 msgr2=0x7f31e40586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:21.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.361+0000 7f3209b25700 1 --2- 172.21.15.146:0/3448033309 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f31e40561e0 0x7f31e40586a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f32040642b0 tx=0x7f31f4016000).stop 2021-01-27T09:45:21.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.361+0000 7f3209b25700 1 -- 172.21.15.146:0/3448033309 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32040bae40 msgr2=0x7f320414e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:21.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.361+0000 7f3209b25700 1 --2- 172.21.15.146:0/3448033309 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32040bae40 0x7f320414e490 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f31fc00cb40 tx=0x7f31fc0013f0).stop 2021-01-27T09:45:21.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.361+0000 7f3209b25700 1 -- 172.21.15.146:0/3448033309 shutdown_connections 2021-01-27T09:45:21.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.361+0000 7f3209b25700 1 --2- 172.21.15.146:0/3448033309 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32040bae40 0x7f320414e490 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:21.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.361+0000 7f3209b25700 1 --2- 172.21.15.146:0/3448033309 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f31e40561e0 0x7f31e40586a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:21.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.361+0000 7f3209b25700 1 --2- 172.21.15.146:0/3448033309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32040bbb20 0x7f320414dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:21.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.361+0000 7f3209b25700 1 --2- 172.21.15.146:0/3448033309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3204065640 0x7f32041616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:21.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.361+0000 7f3209b25700 1 -- 172.21.15.146:0/3448033309 >> 172.21.15.146:0/3448033309 conn(0x7f3204069110 msgr2=0x7f3204067e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:21.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.361+0000 7f3209b25700 1 -- 172.21.15.146:0/3448033309 shutdown_connections 2021-01-27T09:45:21.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.361+0000 7f3209b25700 1 -- 172.21.15.146:0/3448033309 wait complete. 2021-01-27T09:45:21.390 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2021-01-27T09:45:21.559 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.557+0000 7fd3315c8700 1 Processor -- start 2021-01-27T09:45:21.559 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.557+0000 7fd3315c8700 1 -- start start 2021-01-27T09:45:21.561 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.557+0000 7fd3315c8700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd32c0bc000 0x7fd32c14fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:21.561 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.557+0000 7fd3315c8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd32c0648c0 0x7fd32c148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:21.562 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.557+0000 7fd3315c8700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32c0b97a0 con 0x7fd32c062e20 2021-01-27T09:45:21.563 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.561+0000 7fd3315c8700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32c069da0 con 0x7fd32c0bc000 2021-01-27T09:45:21.563 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.561+0000 7fd3315c8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32c0b99d0 con 0x7fd32c0648c0 2021-01-27T09:45:21.563 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.561+0000 7fd32a7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd32c0bc000 0x7fd32c14fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:21.563 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.561+0000 7fd32a7fc700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd32c0bc000 0x7fd32c14fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:50372/0 (socket says 172.21.15.146:50372) 2021-01-27T09:45:21.564 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.561+0000 7fd32a7fc700 1 -- 172.21.15.146:0/722175393 learned_addr learned my addr 172.21.15.146:0/722175393 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:21.564 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.561+0000 7fd32affd700 1 --1- 172.21.15.146:0/722175393 >> v1:172.21.15.78:6789/0 conn(0x7fd32c062e20 0x7fd32c0bb8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:35102/0 (socket says 172.21.15.146:35102) 2021-01-27T09:45:21.564 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.561+0000 7fd32b7fe700 1 --2- 172.21.15.146:0/722175393 >> v2:172.21.15.146:3300/0 conn(0x7fd32c0648c0 0x7fd32c148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:21.564 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.561+0000 7fd32a7fc700 1 -- 172.21.15.146:0/722175393 >> v2:172.21.15.146:3300/0 conn(0x7fd32c0648c0 msgr2=0x7fd32c148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:21.565 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.561+0000 7fd32a7fc700 1 --2- 172.21.15.146:0/722175393 >> v2:172.21.15.146:3300/0 conn(0x7fd32c0648c0 0x7fd32c148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:21.565 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.561+0000 7fd32a7fc700 1 -- 172.21.15.146:0/722175393 >> v1:172.21.15.78:6789/0 conn(0x7fd32c062e20 legacy=0x7fd32c0bb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:21.565 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.561+0000 7fd32a7fc700 1 -- 172.21.15.146:0/722175393 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c0b9c70 con 0x7fd32c0bc000 2021-01-27T09:45:21.569 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.561+0000 7fd32a7fc700 1 --2- 172.21.15.146:0/722175393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd32c0bc000 0x7fd32c14fb10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fd32c0c3470 tx=0x7fd320006ee0).ready entity=mon.0 client_cookie=84255975cf954f8e server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:21.569 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.561+0000 7fd329ffb700 1 -- 172.21.15.146:0/722175393 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3200098d0 con 0x7fd32c0bc000 2021-01-27T09:45:21.569 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.561+0000 7fd329ffb700 1 -- 172.21.15.146:0/722175393 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd320009a30 con 0x7fd32c0bc000 2021-01-27T09:45:21.570 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.561+0000 7fd329ffb700 1 -- 172.21.15.146:0/722175393 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd320009db0 con 0x7fd32c0bc000 2021-01-27T09:45:21.570 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.561+0000 7fd3315c8700 1 -- 172.21.15.146:0/722175393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd32c0bc000 msgr2=0x7fd32c14fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:21.570 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.561+0000 7fd3315c8700 1 --2- 172.21.15.146:0/722175393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd32c0bc000 0x7fd32c14fb10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fd32c0c3470 tx=0x7fd320006ee0).stop 2021-01-27T09:45:21.571 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.561+0000 7fd3315c8700 1 -- 172.21.15.146:0/722175393 shutdown_connections 2021-01-27T09:45:21.571 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.561+0000 7fd3315c8700 1 --2- 172.21.15.146:0/722175393 >> v2:172.21.15.146:3300/0 conn(0x7fd32c0648c0 0x7fd32c148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:21.571 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.561+0000 7fd3315c8700 1 --2- 172.21.15.146:0/722175393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd32c0bc000 0x7fd32c14fb10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:21.572 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.561+0000 7fd3315c8700 1 -- 172.21.15.146:0/722175393 >> 172.21.15.146:0/722175393 conn(0x7fd32c064240 msgr2=0x7fd32c069110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:21.572 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.561+0000 7fd3315c8700 1 -- 172.21.15.146:0/722175393 shutdown_connections 2021-01-27T09:45:21.572 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.561+0000 7fd3315c8700 1 -- 172.21.15.146:0/722175393 wait complete. 2021-01-27T09:45:21.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.565+0000 7fd3315c8700 1 Processor -- start 2021-01-27T09:45:21.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.565+0000 7fd3315c8700 1 -- start start 2021-01-27T09:45:21.578 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.565+0000 7fd3315c8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd32c062e20 0x7fd32c0bd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:21.579 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.565+0000 7fd3315c8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd32c0648c0 0x7fd32c148b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:21.579 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.569+0000 7fd3315c8700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd32c14cf70 0x7fd32c1609f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:21.579 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.569+0000 7fd3315c8700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c15d630 con 0x7fd32c062e20 2021-01-27T09:45:21.580 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.569+0000 7fd3315c8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c161560 con 0x7fd32c0648c0 2021-01-27T09:45:21.580 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.569+0000 7fd3315c8700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c15d860 con 0x7fd32c14cf70 2021-01-27T09:45:21.580 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.569+0000 7fd32a7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd32c0648c0 0x7fd32c148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:21.580 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.569+0000 7fd32affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd32c062e20 0x7fd32c0bd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:21.580 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.569+0000 7fd32a7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd32c0648c0 0x7fd32c148b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47504/0 (socket says 172.21.15.146:47504) 2021-01-27T09:45:21.581 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.569+0000 7fd32a7fc700 1 -- 172.21.15.146:0/3621131082 learned_addr learned my addr 172.21.15.146:0/3621131082 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:21.581 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.569+0000 7fd32b7fe700 1 --2- 172.21.15.146:0/3621131082 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd32c14cf70 0x7fd32c1609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:21.581 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.569+0000 7fd32a7fc700 1 -- 172.21.15.146:0/3621131082 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd32c14cf70 msgr2=0x7fd32c1609f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:21.581 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.569+0000 7fd32a7fc700 1 --2- 172.21.15.146:0/3621131082 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd32c14cf70 0x7fd32c1609f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:21.581 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.569+0000 7fd32a7fc700 1 -- 172.21.15.146:0/3621131082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd32c062e20 msgr2=0x7fd32c0bd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:21.582 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.569+0000 7fd32a7fc700 1 --2- 172.21.15.146:0/3621131082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd32c062e20 0x7fd32c0bd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:21.582 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.569+0000 7fd32a7fc700 1 -- 172.21.15.146:0/3621131082 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c15db00 con 0x7fd32c0648c0 2021-01-27T09:45:21.582 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.569+0000 7fd32a7fc700 1 --2- 172.21.15.146:0/3621131082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd32c0648c0 0x7fd32c148b60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fd32000b000 tx=0x7fd320016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:21.582 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.569+0000 7fd312ffd700 1 -- 172.21.15.146:0/3621131082 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd320021070 con 0x7fd32c0648c0 2021-01-27T09:45:21.583 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.569+0000 7fd312ffd700 1 -- 172.21.15.146:0/3621131082 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd320011d30 con 0x7fd32c0648c0 2021-01-27T09:45:21.583 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.569+0000 7fd312ffd700 1 -- 172.21.15.146:0/3621131082 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd320011ea0 con 0x7fd32c0648c0 2021-01-27T09:45:21.583 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.569+0000 7fd3315c8700 1 -- 172.21.15.146:0/3621131082 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd32c15dda0 con 0x7fd32c0648c0 2021-01-27T09:45:21.583 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.569+0000 7fd3315c8700 1 -- 172.21.15.146:0/3621131082 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32c0bd8e0 con 0x7fd32c0648c0 2021-01-27T09:45:21.583 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.573+0000 7fd3315c8700 1 -- 172.21.15.146:0/3621131082 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32c0b94a0 con 0x7fd32c0648c0 2021-01-27T09:45:21.584 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.573+0000 7fd312ffd700 1 -- 172.21.15.146:0/3621131082 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fd32000f070 con 0x7fd32c0648c0 2021-01-27T09:45:21.584 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.573+0000 7fd312ffd700 1 --2- 172.21.15.146:0/3621131082 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd30c0561b0 0x7fd30c058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:21.584 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.573+0000 7fd312ffd700 1 -- 172.21.15.146:0/3621131082 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fd320070c80 con 0x7fd32c0648c0 2021-01-27T09:45:21.584 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.573+0000 7fd32affd700 1 --2- 172.21.15.146:0/3621131082 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd30c0561b0 0x7fd30c058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:21.584 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.573+0000 7fd32affd700 1 --2- 172.21.15.146:0/3621131082 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd30c0561b0 0x7fd30c058670 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fd31c004610 tx=0x7fd31c007bb0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:21.585 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.581+0000 7fd312ffd700 1 -- 172.21.15.146:0/3621131082 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fd320046220 con 0x7fd32c0648c0 2021-01-27T09:45:21.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.721+0000 7fd3315c8700 1 -- 172.21.15.146:0/3621131082 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd32c05d020 con 0x7fd32c0648c0 2021-01-27T09:45:21.726 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.725+0000 7fd312ffd700 1 -- 172.21.15.146:0/3621131082 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+10 (secure 0 0 0) 0x7fd320049840 con 0x7fd32c0648c0 2021-01-27T09:45:21.726 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2021-01-27T09:45:21.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.725+0000 7fd3315c8700 1 -- 172.21.15.146:0/3621131082 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd30c0561b0 msgr2=0x7fd30c058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:21.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.725+0000 7fd3315c8700 1 --2- 172.21.15.146:0/3621131082 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd30c0561b0 0x7fd30c058670 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fd31c004610 tx=0x7fd31c007bb0).stop 2021-01-27T09:45:21.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.725+0000 7fd3315c8700 1 -- 172.21.15.146:0/3621131082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd32c0648c0 msgr2=0x7fd32c148b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:21.729 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.725+0000 7fd3315c8700 1 --2- 172.21.15.146:0/3621131082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd32c0648c0 0x7fd32c148b60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fd32000b000 tx=0x7fd320016000).stop 2021-01-27T09:45:21.729 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.725+0000 7fd3315c8700 1 -- 172.21.15.146:0/3621131082 shutdown_connections 2021-01-27T09:45:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.725+0000 7fd3315c8700 1 --2- 172.21.15.146:0/3621131082 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd32c14cf70 0x7fd32c1609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.725+0000 7fd3315c8700 1 --2- 172.21.15.146:0/3621131082 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd30c0561b0 0x7fd30c058670 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.725+0000 7fd3315c8700 1 --2- 172.21.15.146:0/3621131082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd32c0648c0 0x7fd32c148b60 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.725+0000 7fd3315c8700 1 --2- 172.21.15.146:0/3621131082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd32c062e20 0x7fd32c0bd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.725+0000 7fd3315c8700 1 -- 172.21.15.146:0/3621131082 >> 172.21.15.146:0/3621131082 conn(0x7fd32c064240 msgr2=0x7fd32c1434c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.725+0000 7fd3315c8700 1 -- 172.21.15.146:0/3621131082 shutdown_connections 2021-01-27T09:45:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.725+0000 7fd3315c8700 1 -- 172.21.15.146:0/3621131082 wait complete. 2021-01-27T09:45:21.754 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:45:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.905+0000 7f9949d3d700 1 Processor -- start 2021-01-27T09:45:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.905+0000 7f9949d3d700 1 -- start start 2021-01-27T09:45:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f9949d3d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f99440ba3c0 0x7f994414c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f9949d3d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f99440ba7a0 0x7f994414c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f9949d3d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9944067ba0 0x7f9944067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:21.911 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f9949d3d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f994414cde0 con 0x7f99440ba7a0 2021-01-27T09:45:21.911 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f9949d3d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9944060a20 con 0x7f99440ba3c0 2021-01-27T09:45:21.911 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f9949d3d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9944060cc0 con 0x7f9944067ba0 2021-01-27T09:45:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f994953c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9944067ba0 0x7f9944067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:21.913 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f994953c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9944067ba0 0x7f9944067fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:37000/0 (socket says 172.21.15.146:37000) 2021-01-27T09:45:21.913 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f994953c700 1 -- 172.21.15.146:0/2909360218 learned_addr learned my addr 172.21.15.146:0/2909360218 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:21.913 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f9948d3b700 1 --2- 172.21.15.146:0/2909360218 >> v2:172.21.15.146:3300/0 conn(0x7f99440ba3c0 0x7f994414c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:21.913 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f9943fff700 1 --2- 172.21.15.146:0/2909360218 >> v2:172.21.15.78:3300/0 conn(0x7f99440ba7a0 0x7f994414c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:21.913 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f994953c700 1 -- 172.21.15.146:0/2909360218 >> v2:172.21.15.146:3300/0 conn(0x7f99440ba3c0 msgr2=0x7f994414c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:21.914 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f994953c700 1 --2- 172.21.15.146:0/2909360218 >> v2:172.21.15.146:3300/0 conn(0x7f99440ba3c0 0x7f994414c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:21.914 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f994953c700 1 -- 172.21.15.146:0/2909360218 >> v2:172.21.15.78:3300/0 conn(0x7f99440ba7a0 msgr2=0x7f994414c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:45:21.914 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f994953c700 1 --2- 172.21.15.146:0/2909360218 >> v2:172.21.15.78:3300/0 conn(0x7f99440ba7a0 0x7f994414c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:21.914 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f994953c700 1 -- 172.21.15.146:0/2909360218 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9944060f60 con 0x7f9944067ba0 2021-01-27T09:45:21.914 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f994953c700 1 --2- 172.21.15.146:0/2909360218 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9944067ba0 0x7f9944067fc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f9944065320 tx=0x7f993c0092d0).ready entity=mon.2 client_cookie=7da84757ef287093 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:21.915 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f99437fe700 1 -- 172.21.15.146:0/2909360218 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c00bb40 con 0x7f9944067ba0 2021-01-27T09:45:21.915 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f99437fe700 1 -- 172.21.15.146:0/2909360218 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c00bca0 con 0x7f9944067ba0 2021-01-27T09:45:21.915 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f99437fe700 1 -- 172.21.15.146:0/2909360218 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c011610 con 0x7f9944067ba0 2021-01-27T09:45:21.916 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f9949d3d700 1 -- 172.21.15.146:0/2909360218 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9944067ba0 msgr2=0x7f9944067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:21.917 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f9949d3d700 1 --2- 172.21.15.146:0/2909360218 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9944067ba0 0x7f9944067fc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f9944065320 tx=0x7f993c0092d0).stop 2021-01-27T09:45:21.917 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f9949d3d700 1 -- 172.21.15.146:0/2909360218 shutdown_connections 2021-01-27T09:45:21.917 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f9949d3d700 1 --2- 172.21.15.146:0/2909360218 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9944067ba0 0x7f9944067fc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:21.917 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f9949d3d700 1 --2- 172.21.15.146:0/2909360218 >> v2:172.21.15.78:3300/0 conn(0x7f99440ba7a0 0x7f994414c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:21.917 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f9949d3d700 1 --2- 172.21.15.146:0/2909360218 >> v2:172.21.15.146:3300/0 conn(0x7f99440ba3c0 0x7f994414c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:21.918 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f9949d3d700 1 -- 172.21.15.146:0/2909360218 >> 172.21.15.146:0/2909360218 conn(0x7f9944064240 msgr2=0x7f9944064620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:21.918 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.909+0000 7f9949d3d700 1 -- 172.21.15.146:0/2909360218 shutdown_connections 2021-01-27T09:45:21.918 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.913+0000 7f9949d3d700 1 -- 172.21.15.146:0/2909360218 wait complete. 2021-01-27T09:45:21.918 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.913+0000 7f9949d3d700 1 Processor -- start 2021-01-27T09:45:21.918 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.913+0000 7f9949d3d700 1 -- start start 2021-01-27T09:45:21.920 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.913+0000 7f9949d3d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9944067ba0 0x7f9944159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:21.921 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.913+0000 7f9949d3d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99440ba3c0 0x7f99440bc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:21.921 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.913+0000 7f9949d3d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99440ba7a0 0x7f994414a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:21.921 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.917+0000 7f9949d3d700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99440b9fc0 con 0x7f99440ba3c0 2021-01-27T09:45:21.921 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.917+0000 7f9949d3d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9944146100 con 0x7f99440ba7a0 2021-01-27T09:45:21.922 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.917+0000 7f9949d3d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9944145bc0 con 0x7f9944067ba0 2021-01-27T09:45:21.922 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.917+0000 7f994953c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99440ba7a0 0x7f994414a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:21.922 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.917+0000 7f9948d3b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9944067ba0 0x7f9944159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:21.923 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.917+0000 7f994953c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99440ba7a0 0x7f994414a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47520/0 (socket says 172.21.15.146:47520) 2021-01-27T09:45:21.923 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.917+0000 7f9948d3b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9944067ba0 0x7f9944159df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:37002/0 (socket says 172.21.15.146:37002) 2021-01-27T09:45:21.923 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.917+0000 7f994953c700 1 -- 172.21.15.146:0/697561963 learned_addr learned my addr 172.21.15.146:0/697561963 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:21.923 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.917+0000 7f9943fff700 1 --2- 172.21.15.146:0/697561963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99440ba3c0 0x7f99440bc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:21.924 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.917+0000 7f994953c700 1 -- 172.21.15.146:0/697561963 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9944067ba0 msgr2=0x7f9944159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:21.924 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.917+0000 7f994953c700 1 --2- 172.21.15.146:0/697561963 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9944067ba0 0x7f9944159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:21.925 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.917+0000 7f994953c700 1 -- 172.21.15.146:0/697561963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99440ba3c0 msgr2=0x7f99440bc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:21.925 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.917+0000 7f994953c700 1 --2- 172.21.15.146:0/697561963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99440ba3c0 0x7f99440bc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:21.925 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.917+0000 7f994953c700 1 -- 172.21.15.146:0/697561963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9944145e60 con 0x7f99440ba7a0 2021-01-27T09:45:21.925 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.917+0000 7f994953c700 1 --2- 172.21.15.146:0/697561963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99440ba7a0 0x7f994414a650 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f993c009310 tx=0x7f993c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:21.926 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.917+0000 7f9940ff9700 1 -- 172.21.15.146:0/697561963 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c01b440 con 0x7f99440ba7a0 2021-01-27T09:45:21.926 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.917+0000 7f9940ff9700 1 -- 172.21.15.146:0/697561963 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c01b5a0 con 0x7f99440ba7a0 2021-01-27T09:45:21.926 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.917+0000 7f9940ff9700 1 -- 172.21.15.146:0/697561963 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c01b920 con 0x7f99440ba7a0 2021-01-27T09:45:21.926 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.917+0000 7f9949d3d700 1 -- 172.21.15.146:0/697561963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9944149c70 con 0x7f99440ba7a0 2021-01-27T09:45:21.926 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.917+0000 7f9949d3d700 1 -- 172.21.15.146:0/697561963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f994414a1b0 con 0x7f99440ba7a0 2021-01-27T09:45:21.927 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.917+0000 7f9949d3d700 1 -- 172.21.15.146:0/697561963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f994415a2e0 con 0x7f99440ba7a0 2021-01-27T09:45:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.921+0000 7f9940ff9700 1 -- 172.21.15.146:0/697561963 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f993c02a070 con 0x7f99440ba7a0 2021-01-27T09:45:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.921+0000 7f9940ff9700 1 --2- 172.21.15.146:0/697561963 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f99240561b0 0x7f9924058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.921+0000 7f9940ff9700 1 -- 172.21.15.146:0/697561963 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f993c070fe0 con 0x7f99440ba7a0 2021-01-27T09:45:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.921+0000 7f9948d3b700 1 --2- 172.21.15.146:0/697561963 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f99240561b0 0x7f9924058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.921+0000 7f9948d3b700 1 --2- 172.21.15.146:0/697561963 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f99240561b0 0x7f9924058670 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f993800cb00 tx=0x7f9938006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:21.929 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:21.925+0000 7f9940ff9700 1 -- 172.21.15.146:0/697561963 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f993c0465a0 con 0x7f99440ba7a0 2021-01-27T09:45:22.096 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.093+0000 7f9949d3d700 1 -- 172.21.15.146:0/697561963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9944063d60 con 0x7f99440ba7a0 2021-01-27T09:45:22.098 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.097+0000 7f9940ff9700 1 -- 172.21.15.146:0/697561963 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3574 (secure 0 0 0) 0x7f993c028020 con 0x7f99440ba7a0 2021-01-27T09:45:22.098 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:45:22.098 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:44:52.595879+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6837/745099427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":745099427},{"type":"v1","addr":"172.21.15.146:6837","nonce":745099427}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:45:22.100 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.097+0000 7f9949d3d700 1 -- 172.21.15.146:0/697561963 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f99240561b0 msgr2=0x7f9924058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:22.100 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.097+0000 7f9949d3d700 1 --2- 172.21.15.146:0/697561963 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f99240561b0 0x7f9924058670 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f993800cb00 tx=0x7f9938006e20).stop 2021-01-27T09:45:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.097+0000 7f9949d3d700 1 -- 172.21.15.146:0/697561963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99440ba7a0 msgr2=0x7f994414a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.097+0000 7f9949d3d700 1 --2- 172.21.15.146:0/697561963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99440ba7a0 0x7f994414a650 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f993c009310 tx=0x7f993c017000).stop 2021-01-27T09:45:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.097+0000 7f9949d3d700 1 -- 172.21.15.146:0/697561963 shutdown_connections 2021-01-27T09:45:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.097+0000 7f9949d3d700 1 --2- 172.21.15.146:0/697561963 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f99240561b0 0x7f9924058670 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.097+0000 7f9949d3d700 1 --2- 172.21.15.146:0/697561963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99440ba7a0 0x7f994414a650 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.097+0000 7f9949d3d700 1 --2- 172.21.15.146:0/697561963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99440ba3c0 0x7f99440bc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.097+0000 7f9949d3d700 1 --2- 172.21.15.146:0/697561963 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9944067ba0 0x7f9944159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.097+0000 7f9949d3d700 1 -- 172.21.15.146:0/697561963 >> 172.21.15.146:0/697561963 conn(0x7f9944064240 msgr2=0x7f99441415d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.097+0000 7f9949d3d700 1 -- 172.21.15.146:0/697561963 shutdown_connections 2021-01-27T09:45:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.097+0000 7f9949d3d700 1 -- 172.21.15.146:0/697561963 wait complete. 2021-01-27T09:45:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 13 2021-01-27T09:45:22.128 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-01-27T09:45:22.297 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.293+0000 7f68ad06e700 1 Processor -- start 2021-01-27T09:45:22.297 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.293+0000 7f68ad06e700 1 -- start start 2021-01-27T09:45:22.299 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.297+0000 7f68ad06e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f68a80be7f0 0x7f68a80bcf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:22.299 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.297+0000 7f68ad06e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a80698b0 con 0x7f68a80b9e70 2021-01-27T09:45:22.300 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.297+0000 7f68ad06e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a814be70 con 0x7f68a80b9a90 2021-01-27T09:45:22.300 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.297+0000 7f68ad06e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a814bc80 con 0x7f68a80be7f0 2021-01-27T09:45:22.301 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.297+0000 7f68a759e700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f68a80b9e70 0x7f68a80bd460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:35134/0 (socket says 172.21.15.146:35134) 2021-01-27T09:45:22.301 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.297+0000 7f68a759e700 1 -- 172.21.15.146:0/1602153824 learned_addr learned my addr 172.21.15.146:0/1602153824 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:45:22.302 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.297+0000 7f68a659c700 1 --2- 172.21.15.146:0/1602153824 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f68a80be7f0 0x7f68a80bcf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:22.302 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.297+0000 7f68a5d9b700 1 -- 172.21.15.146:0/1602153824 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3229076576 0 0) 0x7f68a80698b0 con 0x7f68a80b9e70 2021-01-27T09:45:22.302 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.297+0000 7f68a5d9b700 1 -- 172.21.15.146:0/1602153824 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6894003270 con 0x7f68a80b9e70 2021-01-27T09:45:22.302 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.297+0000 7f68a659c700 1 -- 172.21.15.146:0/1602153824 >> v1:172.21.15.146:6789/0 conn(0x7f68a80b9a90 legacy=0x7f68a80be0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:22.303 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.297+0000 7f68a5d9b700 1 -- 172.21.15.146:0/1602153824 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326612848 0 0) 0x7f68a814be70 con 0x7f68a80b9a90 2021-01-27T09:45:22.303 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.297+0000 7f68a659c700 1 -- 172.21.15.146:0/1602153824 >> v1:172.21.15.78:6789/0 conn(0x7f68a80b9e70 legacy=0x7f68a80bd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:22.303 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.297+0000 7f68a659c700 1 -- 172.21.15.146:0/1602153824 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a814c110 con 0x7f68a80be7f0 2021-01-27T09:45:22.304 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.301+0000 7f68a659c700 1 --2- 172.21.15.146:0/1602153824 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f68a80be7f0 0x7f68a80bcf70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f689c00b9f0 tx=0x7f689c006e20).ready entity=mon.2 client_cookie=ee0e39be17acb13e server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:22.305 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.301+0000 7f68a5d9b700 1 -- 172.21.15.146:0/1602153824 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c00bee0 con 0x7f68a80be7f0 2021-01-27T09:45:22.305 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.301+0000 7f68a5d9b700 1 -- 172.21.15.146:0/1602153824 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689c009870 con 0x7f68a80be7f0 2021-01-27T09:45:22.305 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.301+0000 7f68a5d9b700 1 -- 172.21.15.146:0/1602153824 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c009bf0 con 0x7f68a80be7f0 2021-01-27T09:45:22.305 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.301+0000 7f68ad06e700 1 -- 172.21.15.146:0/1602153824 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f68a80be7f0 msgr2=0x7f68a80bcf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:22.306 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.301+0000 7f68ad06e700 1 --2- 172.21.15.146:0/1602153824 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f68a80be7f0 0x7f68a80bcf70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f689c00b9f0 tx=0x7f689c006e20).stop 2021-01-27T09:45:22.306 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.301+0000 7f68ad06e700 1 -- 172.21.15.146:0/1602153824 shutdown_connections 2021-01-27T09:45:22.306 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.301+0000 7f68ad06e700 1 --2- 172.21.15.146:0/1602153824 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f68a80be7f0 0x7f68a80bcf70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:22.306 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.301+0000 7f68ad06e700 1 -- 172.21.15.146:0/1602153824 >> 172.21.15.146:0/1602153824 conn(0x7f68a8069110 msgr2=0x7f68a8067e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:22.307 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.301+0000 7f68ad06e700 1 -- 172.21.15.146:0/1602153824 shutdown_connections 2021-01-27T09:45:22.307 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.301+0000 7f68ad06e700 1 -- 172.21.15.146:0/1602153824 wait complete. 2021-01-27T09:45:22.309 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f68ad06e700 1 Processor -- start 2021-01-27T09:45:22.309 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f68ad06e700 1 -- start start 2021-01-27T09:45:22.309 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f68ad06e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a80b9a90 0x7f68a80b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:22.310 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f68ad06e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68a80b9e70 0x7f68a80b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:22.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f68ad06e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f68a80acf10 0x7f68a8148a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:22.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f68ad06e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a80ae680 con 0x7f68a80b9e70 2021-01-27T09:45:22.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f68ad06e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a8146850 con 0x7f68a80b9a90 2021-01-27T09:45:22.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f68ad06e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a8146af0 con 0x7f68a80acf10 2021-01-27T09:45:22.312 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f68a6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a80b9a90 0x7f68a80b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:22.312 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f68a6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a80b9a90 0x7f68a80b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47530/0 (socket says 172.21.15.146:47530) 2021-01-27T09:45:22.312 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f68a6d9d700 1 -- 172.21.15.146:0/1313181854 learned_addr learned my addr 172.21.15.146:0/1313181854 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:45:22.312 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f68a659c700 1 --2- 172.21.15.146:0/1313181854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68a80b9e70 0x7f68a80b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:22.312 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f68a759e700 1 --2- 172.21.15.146:0/1313181854 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f68a80acf10 0x7f68a8148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:22.313 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f68a6d9d700 1 -- 172.21.15.146:0/1313181854 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f68a80acf10 msgr2=0x7f68a8148a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:22.313 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f68a6d9d700 1 --2- 172.21.15.146:0/1313181854 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f68a80acf10 0x7f68a8148a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:22.313 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f68a6d9d700 1 -- 172.21.15.146:0/1313181854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68a80b9e70 msgr2=0x7f68a80b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:22.313 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f68a6d9d700 1 --2- 172.21.15.146:0/1313181854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68a80b9e70 0x7f68a80b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:22.313 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f68a6d9d700 1 -- 172.21.15.146:0/1313181854 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a80ae8b0 con 0x7f68a80b9a90 2021-01-27T09:45:22.314 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f68a6d9d700 1 --2- 172.21.15.146:0/1313181854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a80b9a90 0x7f68a80b34c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f689800c6e0 tx=0x7f6898007af0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:22.314 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f688effd700 1 -- 172.21.15.146:0/1313181854 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689800e4a0 con 0x7f68a80b9a90 2021-01-27T09:45:22.314 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f688effd700 1 -- 172.21.15.146:0/1313181854 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689800e620 con 0x7f68a80b9a90 2021-01-27T09:45:22.314 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f688effd700 1 -- 172.21.15.146:0/1313181854 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689800e9e0 con 0x7f68a80b9a90 2021-01-27T09:45:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f68ad06e700 1 -- 172.21.15.146:0/1313181854 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a80aeb50 con 0x7f68a80b9a90 2021-01-27T09:45:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.305+0000 7f68ad06e700 1 -- 172.21.15.146:0/1313181854 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a8147990 con 0x7f68a80b9a90 2021-01-27T09:45:22.316 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.309+0000 7f68ad06e700 1 -- 172.21.15.146:0/1313181854 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a814c2f0 con 0x7f68a80b9a90 2021-01-27T09:45:22.316 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.309+0000 7f688effd700 1 -- 172.21.15.146:0/1313181854 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f6898019030 con 0x7f68a80b9a90 2021-01-27T09:45:22.316 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.309+0000 7f688effd700 1 --2- 172.21.15.146:0/1313181854 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f688805a620 0x7f688805cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:45:22.316 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.309+0000 7f688effd700 1 -- 172.21.15.146:0/1313181854 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f689806e9c0 con 0x7f68a80b9a90 2021-01-27T09:45:22.317 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.313+0000 7f68a659c700 1 --2- 172.21.15.146:0/1313181854 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f688805a620 0x7f688805cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:45:22.317 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.313+0000 7f68a659c700 1 --2- 172.21.15.146:0/1313181854 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f688805a620 0x7f688805cae0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f68a81462a0 tx=0x7f689c016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:45:22.319 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.317+0000 7f688effd700 1 -- 172.21.15.146:0/1313181854 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f6898044070 con 0x7f68a80b9a90 2021-01-27T09:45:22.461 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.461+0000 7f68ad06e700 1 -- 172.21.15.146:0/1313181854 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68a8145b00 con 0x7f68a80b9a90 2021-01-27T09:45:22.463 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.461+0000 7f688effd700 1 -- 172.21.15.146:0/1313181854 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18638 (secure 0 0 0) 0x7f6898047690 con 0x7f68a80b9a90 2021-01-27T09:45:22.463 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:45:22.464 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":26,"fsid":"968a1bec-aac5-444e-b70f-7770587be945","created":"2021-01-27T09:44:13.797940+0000","modified":"2021-01-27T09:44:33.763400+0000","last_up_change":"2021-01-27T09:44:23.479967+0000","last_in_change":"2021-01-27T09:44:23.479967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T09:44:18.497521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-27T09:44:24.550303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-27T09:44:27.607542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-27T09:44:28.331389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-01-27T09:44:31.378452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25441909-a40b-4d82-828d-326685513ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":14470},{"type":"v1","addr":"172.21.15.146:6801","nonce":14470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":14470},{"type":"v1","addr":"172.21.15.146:6803","nonce":14470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":14470},{"type":"v1","addr":"172.21.15.146:6810","nonce":14470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":14470},{"type":"v1","addr":"172.21.15.146:6807","nonce":14470}]},"public_addr":"172.21.15.146:6801/14470","cluster_addr":"172.21.15.146:6803/14470","heartbeat_back_addr":"172.21.15.146:6810/14470","heartbeat_front_addr":"172.21.15.146:6807/14470","state":["exists","up"]},{"osd":1,"uuid":"825bbc51-2ffe-4612-a300-00960e48be02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":14472},{"type":"v1","addr":"172.21.15.146:6817","nonce":14472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":14472},{"type":"v1","addr":"172.21.15.146:6819","nonce":14472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":14472},{"type":"v1","addr":"172.21.15.146:6827","nonce":14472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":14472},{"type":"v1","addr":"172.21.15.146:6823","nonce":14472}]},"public_addr":"172.21.15.146:6817/14472","cluster_addr":"172.21.15.146:6819/14472","heartbeat_back_addr":"172.21.15.146:6827/14472","heartbeat_front_addr":"172.21.15.146:6823/14472","state":["exists","up"]},{"osd":2,"uuid":"e568b97a-8e71-4ab9-bd64-056892110b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":14474},{"type":"v1","addr":"172.21.15.146:6822","nonce":14474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":14474},{"type":"v1","addr":"172.21.15.146:6826","nonce":14474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":14474},{"type":"v1","addr":"172.21.15.146:6831","nonce":14474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":14474},{"type":"v1","addr":"172.21.15.146:6829","nonce":14474}]},"public_addr":"172.21.15.146:6822/14474","cluster_addr":"172.21.15.146:6826/14474","heartbeat_back_addr":"172.21.15.146:6831/14474","heartbeat_front_addr":"172.21.15.146:6829/14474","state":["exists","up"]},{"osd":3,"uuid":"f5d50f63-f74a-4aea-a62d-51c38db4d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":14471},{"type":"v1","addr":"172.21.15.146:6806","nonce":14471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":14471},{"type":"v1","addr":"172.21.15.146:6811","nonce":14471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":14471},{"type":"v1","addr":"172.21.15.146:6815","nonce":14471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":14471},{"type":"v1","addr":"172.21.15.146:6813","nonce":14471}]},"public_addr":"172.21.15.146:6806/14471","cluster_addr":"172.21.15.146:6811/14471","heartbeat_back_addr":"172.21.15.146:6815/14471","heartbeat_front_addr":"172.21.15.146:6813/14471","state":["exists","up"]},{"osd":4,"uuid":"782458d7-6f52-48f4-9466-67b61ef27016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":15826},{"type":"v1","addr":"172.21.15.78:6817","nonce":15826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":15826},{"type":"v1","addr":"172.21.15.78:6819","nonce":15826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":15826},{"type":"v1","addr":"172.21.15.78:6823","nonce":15826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":15826},{"type":"v1","addr":"172.21.15.78:6821","nonce":15826}]},"public_addr":"172.21.15.78:6817/15826","cluster_addr":"172.21.15.78:6819/15826","heartbeat_back_addr":"172.21.15.78:6823/15826","heartbeat_front_addr":"172.21.15.78:6821/15826","state":["exists","up"]},{"osd":5,"uuid":"1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":15827},{"type":"v1","addr":"172.21.15.78:6801","nonce":15827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":15827},{"type":"v1","addr":"172.21.15.78:6803","nonce":15827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":15827},{"type":"v1","addr":"172.21.15.78:6807","nonce":15827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":15827},{"type":"v1","addr":"172.21.15.78:6805","nonce":15827}]},"public_addr":"172.21.15.78:6801/15827","cluster_addr":"172.21.15.78:6803/15827","heartbeat_back_addr":"172.21.15.78:6807/15827","heartbeat_front_addr":"172.21.15.78:6805/15827","state":["exists","up"]},{"osd":6,"uuid":"4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":15825},{"type":"v1","addr":"172.21.15.78:6809","nonce":15825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":15825},{"type":"v1","addr":"172.21.15.78:6811","nonce":15825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":15825},{"type":"v1","addr":"172.21.15.78:6815","nonce":15825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":15825},{"type":"v1","addr":"172.21.15.78:6813","nonce":15825}]},"public_addr":"172.21.15.78:6809/15825","cluster_addr":"172.21.15.78:6811/15825","heartbeat_back_addr":"172.21.15.78:6815/15825","heartbeat_front_addr":"172.21.15.78:6813/15825","state":["exists","up"]},{"osd":7,"uuid":"851aeaf3-bcdc-4ac6-b578-c42e1bf87c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":15828},{"type":"v1","addr":"172.21.15.78:6825","nonce":15828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":15828},{"type":"v1","addr":"172.21.15.78:6827","nonce":15828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":15828},{"type":"v1","addr":"172.21.15.78:6831","nonce":15828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":15828},{"type":"v1","addr":"172.21.15.78:6829","nonce":15828}]},"public_addr":"172.21.15.78:6825/15828","cluster_addr":"172.21.15.78:6827/15828","heartbeat_back_addr":"172.21.15.78:6831/15828","heartbeat_front_addr":"172.21.15.78:6829/15828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.573930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.718144+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.641838+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.551598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.374444+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.171108+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.360910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.356020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:45:22.466 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.461+0000 7f68ad06e700 1 -- 172.21.15.146:0/1313181854 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f688805a620 msgr2=0x7f688805cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:22.466 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.461+0000 7f68ad06e700 1 --2- 172.21.15.146:0/1313181854 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f688805a620 0x7f688805cae0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f68a81462a0 tx=0x7f689c016000).stop 2021-01-27T09:45:22.466 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.461+0000 7f68ad06e700 1 -- 172.21.15.146:0/1313181854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a80b9a90 msgr2=0x7f68a80b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:45:22.466 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.461+0000 7f68ad06e700 1 --2- 172.21.15.146:0/1313181854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a80b9a90 0x7f68a80b34c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f689800c6e0 tx=0x7f6898007af0).stop 2021-01-27T09:45:22.467 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.465+0000 7f68ad06e700 1 -- 172.21.15.146:0/1313181854 shutdown_connections 2021-01-27T09:45:22.467 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.465+0000 7f68ad06e700 1 --2- 172.21.15.146:0/1313181854 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f68a80acf10 0x7f68a8148a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:22.467 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.465+0000 7f68ad06e700 1 --2- 172.21.15.146:0/1313181854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68a80b9e70 0x7f68a80b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:22.467 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.465+0000 7f68ad06e700 1 --2- 172.21.15.146:0/1313181854 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f688805a620 0x7f688805cae0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:22.468 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.465+0000 7f68ad06e700 1 --2- 172.21.15.146:0/1313181854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a80b9a90 0x7f68a80b34c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:45:22.468 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.465+0000 7f68ad06e700 1 -- 172.21.15.146:0/1313181854 >> 172.21.15.146:0/1313181854 conn(0x7f68a8069110 msgr2=0x7f68a8134800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:45:22.468 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.465+0000 7f68ad06e700 1 -- 172.21.15.146:0/1313181854 shutdown_connections 2021-01-27T09:45:22.468 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:45:22.465+0000 7f68ad06e700 1 -- 172.21.15.146:0/1313181854 wait complete. 2021-01-27T09:45:22.491 DEBUG:tasks.mds_thrash:Yielding 2021-01-27T09:45:22.491 INFO:teuthology.run_tasks:Running task workunit... 2021-01-27T09:45:22.507 INFO:tasks.workunit:Pulling workunits from ref 164b0f632a5fe3384fa7cbb10929c65ed7cc0f12 2021-01-27T09:45:22.508 INFO:tasks.workunit:Making a separate scratch dir for every client... 2021-01-27T09:45:22.508 INFO:tasks.workunit:timeout=3h 2021-01-27T09:45:22.508 INFO:tasks.workunit:cleanup=True 2021-01-27T09:45:22.509 DEBUG:teuthology.orchestra.run.smithi146:> stat -- /home/ubuntu/cephtest/mnt.0 2021-01-27T09:45:22.509 INFO:tasks.mds_thrash.fs.[cephfs]:starting mds_do_thrash for fs cephfs 2021-01-27T09:45:22.510 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 79 secs before thrashing 2021-01-27T09:45:22.530 INFO:teuthology.orchestra.run.smithi146.stdout: File: /home/ubuntu/cephtest/mnt.0 2021-01-27T09:45:22.530 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2021-01-27T09:45:22.531 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 30h/48d Inode: 1 Links: 2 2021-01-27T09:45:22.531 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T09:45:22.531 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2021-01-27T09:45:22.531 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2021-01-27 09:44:29.322173361 +0000 2021-01-27T09:45:22.531 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2021-01-27 09:45:13.545304995 +0000 2021-01-27T09:45:22.532 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2021-01-27T09:45:22.533 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2021-01-27T09:45:22.533 DEBUG:teuthology.orchestra.run.smithi146:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2021-01-27T09:45:22.582 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 164b0f632a5fe3384fa7cbb10929c65ed7cc0f12 2021-01-27T09:45:22.608 INFO:tasks.workunit.client.0.smithi146.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2021-01-27T09:45:39.906 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:45:39.909 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:45:56.097 INFO:tasks.workunit.client.0.smithi146.stderr:Updating files: 69% (6836/9786) Updating files: 70% (6851/9786) Updating files: 71% (6949/9786) Updating files: 72% (7046/9786) Updating files: 73% (7144/9786) Updating files: 74% (7242/9786) Updating files: 75% (7340/9786) Updating files: 76% (7438/9786) Updating files: 77% (7536/9786) Updating files: 78% (7634/9786) Updating files: 79% (7731/9786) Updating files: 80% (7829/9786) Updating files: 81% (7927/9786) Updating files: 82% (8025/9786) Updating files: 83% (8123/9786) Updating files: 84% (8221/9786) Updating files: 85% (8319/9786) Updating files: 86% (8416/9786) Updating files: 87% (8514/9786) Updating files: 88% (8612/9786) Updating files: 89% (8710/9786) Updating files: 90% (8808/9786) Updating files: 91% (8906/9786) Updating files: 92% (9004/9786) Updating files: 93% (9101/9786) Updating files: 94% (9199/9786) Updating files: 95% (9297/9786) Updating files: 96% (9395/9786) Updating files: 97% (9493/9786) Updating files: 98% (9591/9786) Updating files: 99% (9689/9786) Updating files: 100% (9786/9786) Updating files: 100% (9786/9786), done. 2021-01-27T09:45:57.161 INFO:tasks.workunit.client.0.smithi146.stderr:Note: switching to '164b0f632a5fe3384fa7cbb10929c65ed7cc0f12'. 2021-01-27T09:45:57.162 INFO:tasks.workunit.client.0.smithi146.stderr: 2021-01-27T09:45:57.162 INFO:tasks.workunit.client.0.smithi146.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2021-01-27T09:45:57.162 INFO:tasks.workunit.client.0.smithi146.stderr:changes and commit them, and you can discard any commits you make in this 2021-01-27T09:45:57.162 INFO:tasks.workunit.client.0.smithi146.stderr:state without impacting any branches by switching back to a branch. 2021-01-27T09:45:57.163 INFO:tasks.workunit.client.0.smithi146.stderr: 2021-01-27T09:45:57.163 INFO:tasks.workunit.client.0.smithi146.stderr:If you want to create a new branch to retain commits you create, you may 2021-01-27T09:45:57.163 INFO:tasks.workunit.client.0.smithi146.stderr:do so (now or later) by using -c with the switch command. Example: 2021-01-27T09:45:57.163 INFO:tasks.workunit.client.0.smithi146.stderr: 2021-01-27T09:45:57.164 INFO:tasks.workunit.client.0.smithi146.stderr: git switch -c 2021-01-27T09:45:57.164 INFO:tasks.workunit.client.0.smithi146.stderr: 2021-01-27T09:45:57.164 INFO:tasks.workunit.client.0.smithi146.stderr:Or undo this operation with: 2021-01-27T09:45:57.164 INFO:tasks.workunit.client.0.smithi146.stderr: 2021-01-27T09:45:57.164 INFO:tasks.workunit.client.0.smithi146.stderr: git switch - 2021-01-27T09:45:57.165 INFO:tasks.workunit.client.0.smithi146.stderr: 2021-01-27T09:45:57.165 INFO:tasks.workunit.client.0.smithi146.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2021-01-27T09:45:57.165 INFO:tasks.workunit.client.0.smithi146.stderr: 2021-01-27T09:45:57.165 INFO:tasks.workunit.client.0.smithi146.stderr:HEAD is now at 164b0f632a qa: test DispatchQueue throttling 2021-01-27T09:45:57.190 DEBUG:teuthology.orchestra.run.smithi146:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2021-01-27T09:45:57.214 INFO:tasks.workunit.client.0.smithi146.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2021-01-27T09:45:57.223 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-01-27T09:45:57.223 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2021-01-27T09:45:58.041 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2021-01-27T09:45:58.191 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2021-01-27T09:45:58.294 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-01-27T09:45:58.300 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-01-27T09:45:58.300 INFO:tasks.workunit.client.0.smithi146.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2021-01-27T09:45:58.399 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-01-27T09:45:58.414 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2021-01-27T09:45:58.414 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2021-01-27T09:45:58.433 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2021-01-27T09:45:58.434 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2021-01-27T09:45:58.434 DEBUG:teuthology.orchestra.run.smithi146:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=164b0f632a5fe3384fa7cbb10929c65ed7cc0f12 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2021-01-27T09:45:58.528 INFO:tasks.workunit.client.0.smithi146.stderr:--2021-01-27 09:45:58-- http://download.ceph.com/qa/ffsb.tar.bz2 2021-01-27T09:45:58.531 INFO:tasks.workunit.client.0.smithi146.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2021-01-27T09:45:58.554 INFO:tasks.workunit.client.0.smithi146.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2021-01-27T09:45:58.577 INFO:tasks.workunit.client.0.smithi146.stderr:HTTP request sent, awaiting response... 200 OK 2021-01-27T09:45:58.578 INFO:tasks.workunit.client.0.smithi146.stderr:Length: 128931 (126K) [application/octet-stream] 2021-01-27T09:45:58.580 INFO:tasks.workunit.client.0.smithi146.stderr:Saving to: 'ffsb.tar.bz2' 2021-01-27T09:45:58.592 INFO:tasks.workunit.client.0.smithi146.stderr: 2021-01-27T09:45:58.623 INFO:tasks.workunit.client.0.smithi146.stderr: 0K .......... .......... .......... .......... .......... 39% 1.16M 0s 2021-01-27T09:45:58.646 INFO:tasks.workunit.client.0.smithi146.stderr: 50K .......... .......... .......... .......... .......... 79% 2.17M 0s 2021-01-27T09:45:58.646 INFO:tasks.workunit.client.0.smithi146.stderr: 100K .......... .......... ..... 100% 39.2M=0.07s 2021-01-27T09:45:58.646 INFO:tasks.workunit.client.0.smithi146.stderr: 2021-01-27T09:45:58.647 INFO:tasks.workunit.client.0.smithi146.stderr:2021-01-27 09:45:58 (1.89 MB/s) - 'ffsb.tar.bz2' saved [128931/128931] 2021-01-27T09:45:58.647 INFO:tasks.workunit.client.0.smithi146.stderr: 2021-01-27T09:45:58.686 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/ 2021-01-27T09:45:58.689 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/ffsb_fs.c 2021-01-27T09:45:58.692 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/INSTALL 2021-01-27T09:45:58.694 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/fileops.c 2021-01-27T09:45:58.697 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/missing 2021-01-27T09:45:59.342 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/config.h.in 2021-01-27T09:45:59.345 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/config.guess 2021-01-27T09:45:59.348 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/fh.h 2021-01-27T09:45:59.400 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/COPYING 2021-01-27T09:45:59.457 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/util.h 2021-01-27T09:45:59.460 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/main.c 2021-01-27T09:45:59.463 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/ChangeLog 2021-01-27T09:45:59.465 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/rand.c 2021-01-27T09:45:59.467 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/ffsb_fs.h 2021-01-27T09:45:59.469 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/install-sh 2021-01-27T09:45:59.471 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/rwlock.h 2021-01-27T09:45:59.472 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/parser.h 2021-01-27T09:45:59.474 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/filelist.h 2021-01-27T09:45:59.475 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/LICENSE 2021-01-27T09:45:59.477 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/Makefile.in 2021-01-27T09:45:59.479 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/filelist.c 2021-01-27T09:45:59.480 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/configure 2021-01-27T09:45:59.486 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/README 2021-01-27T09:45:59.487 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/cirlist.c 2021-01-27T09:45:59.490 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/metaops.c 2021-01-27T09:45:59.492 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/registration-description 2021-01-27T09:45:59.494 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/list.c 2021-01-27T09:45:59.496 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/list.h 2021-01-27T09:45:59.497 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/rand.h 2021-01-27T09:45:59.499 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/parser.c 2021-01-27T09:45:59.500 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/ffsb_tg.c 2021-01-27T09:45:59.501 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/cirlist.h 2021-01-27T09:45:59.503 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/AUTHORS 2021-01-27T09:45:59.504 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/aclocal.m4 2021-01-27T09:45:59.505 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/configure.in 2021-01-27T09:45:59.507 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/examples/ 2021-01-27T09:45:59.509 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/examples/profile_everything 2021-01-27T09:45:59.512 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/depcomp 2021-01-27T09:45:59.513 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/ffsb_stats.c 2021-01-27T09:45:59.514 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/util.c 2021-01-27T09:45:59.516 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/Makefile.am 2021-01-27T09:45:59.517 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/ffsb_thread.c 2021-01-27T09:45:59.519 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/rbt.c 2021-01-27T09:45:59.521 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/rbt.h 2021-01-27T09:45:59.522 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/ffsb_tg.h 2021-01-27T09:45:59.524 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/stamp-h.in 2021-01-27T09:45:59.525 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/config.sub 2021-01-27T09:45:59.527 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/ffsb_thread.h 2021-01-27T09:45:59.528 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/fileops.h 2021-01-27T09:45:59.530 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/ffsb_op.h 2021-01-27T09:45:59.531 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/public-description 2021-01-27T09:45:59.533 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/mkinstalldirs 2021-01-27T09:45:59.535 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/ffsb.h 2021-01-27T09:45:59.536 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/metaops.h 2021-01-27T09:45:59.538 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/ffsb_op.c 2021-01-27T09:45:59.540 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/fh.c 2021-01-27T09:45:59.541 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/NEWS 2021-01-27T09:45:59.543 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/rwlock.c 2021-01-27T09:45:59.544 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/ffsb_stats.h 2021-01-27T09:45:59.546 INFO:tasks.workunit.client.0.smithi146.stdout:ffsb-6.0-rc2/ffsb_fc.c 2021-01-27T09:45:59.563 INFO:tasks.workunit.client.0.smithi146.stdout:patching file parser.c 2021-01-27T09:46:00.621 INFO:tasks.workunit.client.0.smithi146.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2021-01-27T09:46:01.649 INFO:tasks.workunit.client.0.smithi146.stdout:checking whether build environment is sane... yes 2021-01-27T09:46:01.692 INFO:tasks.workunit.client.0.smithi146.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2021-01-27T09:46:01.693 INFO:tasks.workunit.client.0.smithi146.stdout:checking for gawk... gawk 2021-01-27T09:46:01.747 INFO:tasks.workunit.client.0.smithi146.stdout:checking whether make sets $(MAKE)... yes 2021-01-27T09:46:01.920 INFO:tasks.workunit.client.0.smithi146.stdout:checking build system type... x86_64-unknown-linux-gnu 2021-01-27T09:46:01.921 INFO:tasks.workunit.client.0.smithi146.stdout:checking host system type... x86_64-unknown-linux-gnu 2021-01-27T09:46:01.965 INFO:tasks.workunit.client.0.smithi146.stdout:checking for style of include used by make... GNU 2021-01-27T09:46:01.975 INFO:tasks.workunit.client.0.smithi146.stdout:checking for gcc... gcc 2021-01-27T09:46:02.192 INFO:tasks.workunit.client.0.smithi146.stdout:checking for C compiler default output file name... a.out 2021-01-27T09:46:02.207 INFO:tasks.workunit.client.0.smithi146.stdout:checking whether the C compiler works... yes 2021-01-27T09:46:02.215 INFO:tasks.workunit.client.0.smithi146.stdout:checking whether we are cross compiling... no 2021-01-27T09:46:02.330 INFO:tasks.workunit.client.0.smithi146.stdout:checking for suffix of executables... 2021-01-27T09:46:02.448 INFO:tasks.workunit.client.0.smithi146.stdout:checking for suffix of object files... o 2021-01-27T09:46:02.557 INFO:tasks.workunit.client.0.smithi146.stdout:checking whether we are using the GNU C compiler... yes 2021-01-27T09:46:02.677 INFO:tasks.workunit.client.0.smithi146.stdout:checking whether gcc accepts -g... yes 2021-01-27T09:46:02.838 INFO:tasks.workunit.client.0.smithi146.stdout:checking for gcc option to accept ISO C89... none needed 2021-01-27T09:46:03.122 INFO:tasks.workunit.client.0.smithi146.stdout:checking dependency style of gcc... gcc3 2021-01-27T09:46:03.294 INFO:tasks.workunit.client.0.smithi146.stdout:checking how to run the C preprocessor... gcc -E 2021-01-27T09:46:03.464 INFO:tasks.workunit.client.0.smithi146.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2021-01-27T09:46:03.470 INFO:tasks.workunit.client.0.smithi146.stdout:checking for egrep... /usr/bin/grep -E 2021-01-27T09:46:03.505 INFO:tasks.workunit.client.0.smithi146.stdout:checking for AIX... no 2021-01-27T09:46:03.545 INFO:tasks.workunit.client.0.smithi146.stdout:checking for gcc... (cached) gcc 2021-01-27T09:46:03.593 INFO:tasks.workunit.client.0.smithi146.stdout:checking whether we are using the GNU C compiler... (cached) yes 2021-01-27T09:46:03.598 INFO:tasks.workunit.client.0.smithi146.stdout:checking whether gcc accepts -g... (cached) yes 2021-01-27T09:46:03.598 INFO:tasks.workunit.client.0.smithi146.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2021-01-27T09:46:03.599 INFO:tasks.workunit.client.0.smithi146.stdout:checking dependency style of gcc... (cached) gcc3 2021-01-27T09:46:03.766 INFO:tasks.workunit.client.0.smithi146.stdout:checking for main in -lm... yes 2021-01-27T09:46:03.978 INFO:tasks.workunit.client.0.smithi146.stdout:checking for main in -lpthread... yes 2021-01-27T09:46:04.478 INFO:tasks.workunit.client.0.smithi146.stdout:checking for ANSI C header files... yes 2021-01-27T09:46:04.627 INFO:tasks.workunit.client.0.smithi146.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2021-01-27T09:46:04.804 INFO:tasks.workunit.client.0.smithi146.stdout:checking for sys/types.h... yes 2021-01-27T09:46:04.988 INFO:tasks.workunit.client.0.smithi146.stdout:checking for sys/stat.h... yes 2021-01-27T09:46:05.168 INFO:tasks.workunit.client.0.smithi146.stdout:checking for stdlib.h... yes 2021-01-27T09:46:05.605 INFO:tasks.workunit.client.0.smithi146.stdout:checking for string.h... yes 2021-01-27T09:46:05.799 INFO:tasks.workunit.client.0.smithi146.stdout:checking for memory.h... yes 2021-01-27T09:46:05.988 INFO:tasks.workunit.client.0.smithi146.stdout:checking for strings.h... yes 2021-01-27T09:46:06.169 INFO:tasks.workunit.client.0.smithi146.stdout:checking for inttypes.h... yes 2021-01-27T09:46:06.354 INFO:tasks.workunit.client.0.smithi146.stdout:checking for stdint.h... yes 2021-01-27T09:46:06.772 INFO:tasks.workunit.client.0.smithi146.stdout:checking for unistd.h... yes 2021-01-27T09:46:06.966 INFO:tasks.workunit.client.0.smithi146.stdout:checking pthread.h usability... yes 2021-01-27T09:46:07.051 INFO:tasks.workunit.client.0.smithi146.stdout:checking pthread.h presence... yes 2021-01-27T09:46:07.054 INFO:tasks.workunit.client.0.smithi146.stdout:checking for pthread.h... yes 2021-01-27T09:46:07.245 INFO:tasks.workunit.client.0.smithi146.stdout:checking fcntl.h usability... yes 2021-01-27T09:46:07.326 INFO:tasks.workunit.client.0.smithi146.stdout:checking fcntl.h presence... yes 2021-01-27T09:46:07.330 INFO:tasks.workunit.client.0.smithi146.stdout:checking for fcntl.h... yes 2021-01-27T09:46:07.516 INFO:tasks.workunit.client.0.smithi146.stdout:checking limits.h usability... yes 2021-01-27T09:46:07.595 INFO:tasks.workunit.client.0.smithi146.stdout:checking limits.h presence... yes 2021-01-27T09:46:07.598 INFO:tasks.workunit.client.0.smithi146.stdout:checking for limits.h... yes 2021-01-27T09:46:07.657 INFO:tasks.workunit.client.0.smithi146.stdout:checking for stdint.h... (cached) yes 2021-01-27T09:46:07.823 INFO:tasks.workunit.client.0.smithi146.stdout:checking sys/time.h usability... yes 2021-01-27T09:46:08.504 INFO:tasks.workunit.client.0.smithi146.stdout:checking sys/time.h presence... yes 2021-01-27T09:46:08.507 INFO:tasks.workunit.client.0.smithi146.stdout:checking for sys/time.h... yes 2021-01-27T09:46:08.569 INFO:tasks.workunit.client.0.smithi146.stdout:checking for unistd.h... (cached) yes 2021-01-27T09:46:08.738 INFO:tasks.workunit.client.0.smithi146.stdout:checking sys/vfs.h usability... yes 2021-01-27T09:46:08.813 INFO:tasks.workunit.client.0.smithi146.stdout:checking sys/vfs.h presence... yes 2021-01-27T09:46:08.816 INFO:tasks.workunit.client.0.smithi146.stdout:checking for sys/vfs.h... yes 2021-01-27T09:46:09.001 INFO:tasks.workunit.client.0.smithi146.stdout:checking sys/limits.h usability... no 2021-01-27T09:46:09.337 INFO:tasks.workunit.client.0.smithi146.stdout:checking sys/limits.h presence... no 2021-01-27T09:46:09.340 INFO:tasks.workunit.client.0.smithi146.stdout:checking for sys/limits.h... no 2021-01-27T09:46:09.464 INFO:tasks.workunit.client.0.smithi146.stdout:checking for an ANSI C-conforming const... yes 2021-01-27T09:46:09.587 INFO:tasks.workunit.client.0.smithi146.stdout:checking whether time.h and sys/time.h may both be included... yes 2021-01-27T09:46:09.596 INFO:tasks.workunit.client.0.smithi146.stdout:checking for function prototypes... yes 2021-01-27T09:46:09.701 INFO:tasks.workunit.client.0.smithi146.stdout:checking whether setvbuf arguments are reversed... no 2021-01-27T09:46:09.902 INFO:tasks.workunit.client.0.smithi146.stdout:checking for system... yes 2021-01-27T09:46:09.981 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:46:09.984 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:46:10.109 INFO:tasks.workunit.client.0.smithi146.stdout:checking for gettimeofday... yes 2021-01-27T09:46:10.331 INFO:tasks.workunit.client.0.smithi146.stdout:checking for mkdir... yes 2021-01-27T09:46:10.542 INFO:tasks.workunit.client.0.smithi146.stdout:checking for strerror... yes 2021-01-27T09:46:10.765 INFO:tasks.workunit.client.0.smithi146.stdout:checking for open64... yes 2021-01-27T09:46:10.988 INFO:tasks.workunit.client.0.smithi146.stdout:checking for stat64... yes 2021-01-27T09:46:11.233 INFO:tasks.workunit.client.0.smithi146.stdout:checking for fseeko64... yes 2021-01-27T09:46:11.447 INFO:tasks.workunit.client.0.smithi146.stdout:checking for lrand48_r... yes 2021-01-27T09:46:11.633 INFO:tasks.workunit.client.0.smithi146.stdout:checking for srand48_r... yes 2021-01-27T09:46:11.741 INFO:tasks.workunit.client.0.smithi146.stdout:configure: creating ./config.status 2021-01-27T09:46:13.209 INFO:tasks.workunit.client.0.smithi146.stdout:config.status: creating Makefile 2021-01-27T09:46:15.821 INFO:tasks.workunit.client.0.smithi146.stdout:config.status: creating config.h 2021-01-27T09:46:15.821 INFO:tasks.workunit.client.0.smithi146.stdout:config.status: executing depfiles commands 2021-01-27T09:46:15.821 INFO:tasks.workunit.client.0.smithi146.stdout:config.status: executing default commands 2021-01-27T09:46:15.822 INFO:tasks.workunit.client.0.smithi146.stdout:make all-am 2021-01-27T09:46:15.822 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb-6.0-rc2' 2021-01-27T09:46:15.822 INFO:tasks.workunit.client.0.smithi146.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2021-01-27T09:46:15.822 INFO:tasks.workunit.client.0.smithi146.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2021-01-27T09:46:15.822 INFO:tasks.workunit.client.0.smithi146.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2021-01-27T09:46:15.823 INFO:tasks.workunit.client.0.smithi146.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2021-01-27T09:46:15.823 INFO:tasks.workunit.client.0.smithi146.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2021-01-27T09:46:15.823 INFO:tasks.workunit.client.0.smithi146.stdout:mv -f .deps/main.Tpo .deps/main.Po 2021-01-27T09:46:15.823 INFO:tasks.workunit.client.0.smithi146.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2021-01-27T09:46:15.824 INFO:tasks.workunit.client.0.smithi146.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2021-01-27T09:46:15.824 INFO:tasks.workunit.client.0.smithi146.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2021-01-27T09:46:15.824 INFO:tasks.workunit.client.0.smithi146.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2021-01-27T09:46:15.824 INFO:tasks.workunit.client.0.smithi146.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2021-01-27T09:46:15.824 INFO:tasks.workunit.client.0.smithi146.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2021-01-27T09:46:15.825 INFO:tasks.workunit.client.0.smithi146.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2021-01-27T09:46:15.825 INFO:tasks.workunit.client.0.smithi146.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2021-01-27T09:46:15.825 INFO:tasks.workunit.client.0.smithi146.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2021-01-27T09:46:15.825 INFO:tasks.workunit.client.0.smithi146.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2021-01-27T09:46:15.826 INFO:tasks.workunit.client.0.smithi146.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2021-01-27T09:46:15.826 INFO:tasks.workunit.client.0.smithi146.stderr:fileops.c: In function 'ffsb_readfile': 2021-01-27T09:46:15.826 INFO:tasks.workunit.client.0.smithi146.stderr:fileops.c:138:35: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 2 has type 'uint64_t' {aka 'long unsigned int'} [-Wformat=] 2021-01-27T09:46:15.826 INFO:tasks.workunit.client.0.smithi146.stderr: 138 | printf("Error: read size %llu bytes too big " 2021-01-27T09:46:15.827 INFO:tasks.workunit.client.0.smithi146.stderr: | ~~~^ 2021-01-27T09:46:15.827 INFO:tasks.workunit.client.0.smithi146.stderr: | | 2021-01-27T09:46:15.827 INFO:tasks.workunit.client.0.smithi146.stderr: | long long unsigned int 2021-01-27T09:46:15.827 INFO:tasks.workunit.client.0.smithi146.stderr: | %lu 2021-01-27T09:46:15.828 INFO:tasks.workunit.client.0.smithi146.stderr:...... 2021-01-27T09:46:15.828 INFO:tasks.workunit.client.0.smithi146.stderr: 141 | " aborting\n\n", read_size, 2021-01-27T09:46:15.828 INFO:tasks.workunit.client.0.smithi146.stderr: | ~~~~~~~~~ 2021-01-27T09:46:15.828 INFO:tasks.workunit.client.0.smithi146.stderr: | | 2021-01-27T09:46:15.829 INFO:tasks.workunit.client.0.smithi146.stderr: | uint64_t {aka long unsigned int} 2021-01-27T09:46:15.829 INFO:tasks.workunit.client.0.smithi146.stderr:fileops.c:138:14: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 5 has type 'uint64_t' {aka 'long unsigned int'} [-Wformat=] 2021-01-27T09:46:15.829 INFO:tasks.workunit.client.0.smithi146.stderr: 138 | printf("Error: read size %llu bytes too big " 2021-01-27T09:46:15.829 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2021-01-27T09:46:15.830 INFO:tasks.workunit.client.0.smithi146.stderr:...... 2021-01-27T09:46:15.830 INFO:tasks.workunit.client.0.smithi146.stderr: 143 | filesize); 2021-01-27T09:46:15.830 INFO:tasks.workunit.client.0.smithi146.stderr: | ~~~~~~~~ 2021-01-27T09:46:15.830 INFO:tasks.workunit.client.0.smithi146.stderr: | | 2021-01-27T09:46:15.830 INFO:tasks.workunit.client.0.smithi146.stderr: | uint64_t {aka long unsigned int} 2021-01-27T09:46:15.831 INFO:tasks.workunit.client.0.smithi146.stderr:fileops.c:140:29: note: format string is defined here 2021-01-27T09:46:15.831 INFO:tasks.workunit.client.0.smithi146.stderr: 140 | " for file of size %llu bytes\n" 2021-01-27T09:46:15.831 INFO:tasks.workunit.client.0.smithi146.stderr: | ~~~^ 2021-01-27T09:46:15.831 INFO:tasks.workunit.client.0.smithi146.stderr: | | 2021-01-27T09:46:15.832 INFO:tasks.workunit.client.0.smithi146.stderr: | long long unsigned int 2021-01-27T09:46:15.832 INFO:tasks.workunit.client.0.smithi146.stderr: | %lu 2021-01-27T09:46:15.832 INFO:tasks.workunit.client.0.smithi146.stderr:fileops.c:144:14: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 2 has type 'uint64_t' {aka 'long unsigned int'} [-Wformat=] 2021-01-27T09:46:15.832 INFO:tasks.workunit.client.0.smithi146.stderr: 144 | printf("minimum file size must be at least " 2021-01-27T09:46:15.832 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2021-01-27T09:46:15.833 INFO:tasks.workunit.client.0.smithi146.stderr: 145 | " %llu bytes\n", minfilesize); 2021-01-27T09:46:15.833 INFO:tasks.workunit.client.0.smithi146.stderr: | ~~~~~~~~~~~ 2021-01-27T09:46:15.833 INFO:tasks.workunit.client.0.smithi146.stderr: | | 2021-01-27T09:46:15.833 INFO:tasks.workunit.client.0.smithi146.stderr: | uint64_t {aka long unsigned int} 2021-01-27T09:46:15.833 INFO:tasks.workunit.client.0.smithi146.stderr:fileops.c:145:12: note: format string is defined here 2021-01-27T09:46:15.834 INFO:tasks.workunit.client.0.smithi146.stderr: 145 | " %llu bytes\n", minfilesize); 2021-01-27T09:46:15.834 INFO:tasks.workunit.client.0.smithi146.stderr: | ~~~^ 2021-01-27T09:46:15.834 INFO:tasks.workunit.client.0.smithi146.stderr: | | 2021-01-27T09:46:15.834 INFO:tasks.workunit.client.0.smithi146.stderr: | long long unsigned int 2021-01-27T09:46:15.834 INFO:tasks.workunit.client.0.smithi146.stderr: | %lu 2021-01-27T09:46:15.835 INFO:tasks.workunit.client.0.smithi146.stderr:fileops.c: In function 'ffsb_stat': 2021-01-27T09:46:15.835 INFO:tasks.workunit.client.0.smithi146.stderr:fileops.c:542:2: warning: implicit declaration of function 'fhstat'; did you mean 'fstat'? [-Wimplicit-function-declaration] 2021-01-27T09:46:15.835 INFO:tasks.workunit.client.0.smithi146.stderr: 542 | fhstat(curfile->name, ft, fs); 2021-01-27T09:46:15.835 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~ 2021-01-27T09:46:15.835 INFO:tasks.workunit.client.0.smithi146.stderr: | fstat 2021-01-27T09:46:15.836 INFO:tasks.workunit.client.0.smithi146.stderr:fh.c: In function 'fhwrite': 2021-01-27T09:46:15.836 INFO:tasks.workunit.client.0.smithi146.stderr:fh.c:180:18: warning: format '%d' expects argument of type 'int', but argument 2 has type 'ssize_t' {aka 'long int'} [-Wformat=] 2021-01-27T09:46:15.836 INFO:tasks.workunit.client.0.smithi146.stderr: 180 | printf("Wrote %d instead of %d bytes.\n" 2021-01-27T09:46:15.836 INFO:tasks.workunit.client.0.smithi146.stderr: | ~^ 2021-01-27T09:46:15.836 INFO:tasks.workunit.client.0.smithi146.stderr: | | 2021-01-27T09:46:15.837 INFO:tasks.workunit.client.0.smithi146.stderr: | int 2021-01-27T09:46:15.837 INFO:tasks.workunit.client.0.smithi146.stderr: | %ld 2021-01-27T09:46:15.837 INFO:tasks.workunit.client.0.smithi146.stderr: 181 | "Probably out of disk space\n", realsize, size); 2021-01-27T09:46:15.837 INFO:tasks.workunit.client.0.smithi146.stderr: | ~~~~~~~~ 2021-01-27T09:46:15.837 INFO:tasks.workunit.client.0.smithi146.stderr: | | 2021-01-27T09:46:15.838 INFO:tasks.workunit.client.0.smithi146.stderr: | ssize_t {aka long int} 2021-01-27T09:46:15.838 INFO:tasks.workunit.client.0.smithi146.stderr:fh.c: In function 'fhseek': 2021-01-27T09:46:15.838 INFO:tasks.workunit.client.0.smithi146.stderr:fh.c:212:41: warning: format '%lld' expects argument of type 'long long int', but argument 3 has type 'uint64_t' {aka 'long unsigned int'} [-Wformat=] 2021-01-27T09:46:15.838 INFO:tasks.workunit.client.0.smithi146.stderr: 212 | fprintf(stderr, "tried to seek to %lld\n", offset); 2021-01-27T09:46:15.839 INFO:tasks.workunit.client.0.smithi146.stderr: | ~~~^ ~~~~~~ 2021-01-27T09:46:15.839 INFO:tasks.workunit.client.0.smithi146.stderr: | | | 2021-01-27T09:46:15.839 INFO:tasks.workunit.client.0.smithi146.stderr: | | uint64_t {aka long unsigned int} 2021-01-27T09:46:15.839 INFO:tasks.workunit.client.0.smithi146.stderr: | long long int 2021-01-27T09:46:15.839 INFO:tasks.workunit.client.0.smithi146.stderr: | %ld 2021-01-27T09:46:15.840 INFO:tasks.workunit.client.0.smithi146.stderr:fh.c:214:20: warning: format '%lld' expects argument of type 'long long int', but argument 3 has type 'uint64_t' {aka 'long unsigned int'} [-Wformat=] 2021-01-27T09:46:15.840 INFO:tasks.workunit.client.0.smithi146.stderr: 214 | fprintf(stderr, "tried to seek from current " 2021-01-27T09:46:15.840 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2021-01-27T09:46:15.840 INFO:tasks.workunit.client.0.smithi146.stderr: 215 | "position to %lld\n", offset); 2021-01-27T09:46:15.840 INFO:tasks.workunit.client.0.smithi146.stderr: | ~~~~~~ 2021-01-27T09:46:15.841 INFO:tasks.workunit.client.0.smithi146.stderr: | | 2021-01-27T09:46:15.841 INFO:tasks.workunit.client.0.smithi146.stderr: | uint64_t {aka long unsigned int} 2021-01-27T09:46:15.841 INFO:tasks.workunit.client.0.smithi146.stderr:fh.c:215:21: note: format string is defined here 2021-01-27T09:46:15.841 INFO:tasks.workunit.client.0.smithi146.stderr: 215 | "position to %lld\n", offset); 2021-01-27T09:46:15.841 INFO:tasks.workunit.client.0.smithi146.stderr: | ~~~^ 2021-01-27T09:46:15.842 INFO:tasks.workunit.client.0.smithi146.stderr: | | 2021-01-27T09:46:15.842 INFO:tasks.workunit.client.0.smithi146.stderr: | long long int 2021-01-27T09:46:15.842 INFO:tasks.workunit.client.0.smithi146.stderr: | %ld 2021-01-27T09:46:15.899 INFO:tasks.workunit.client.0.smithi146.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2021-01-27T09:46:15.913 INFO:tasks.workunit.client.0.smithi146.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2021-01-27T09:46:15.970 INFO:tasks.workunit.client.0.smithi146.stderr:ffsb_tg.c: In function 'tg_print_config_helper': 2021-01-27T09:46:15.971 INFO:tasks.workunit.client.0.smithi146.stderr:ffsb_tg.c:274:35: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 2 has type 'uint64_t' {aka 'long unsigned int'} [-Wformat=] 2021-01-27T09:46:15.971 INFO:tasks.workunit.client.0.smithi146.stderr: 274 | printf("\t read_size = %llu\t(%s)\n", tg->read_size, 2021-01-27T09:46:15.971 INFO:tasks.workunit.client.0.smithi146.stderr: | ~~~^ ~~~~~~~~~~~~~ 2021-01-27T09:46:15.971 INFO:tasks.workunit.client.0.smithi146.stderr: | | | 2021-01-27T09:46:15.972 INFO:tasks.workunit.client.0.smithi146.stderr: | | uint64_t {aka long unsigned int} 2021-01-27T09:46:15.972 INFO:tasks.workunit.client.0.smithi146.stderr: | long long unsigned int 2021-01-27T09:46:15.972 INFO:tasks.workunit.client.0.smithi146.stderr: | %lu 2021-01-27T09:46:15.972 INFO:tasks.workunit.client.0.smithi146.stderr:ffsb_tg.c:283:35: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 2 has type 'uint64_t' {aka 'long unsigned int'} [-Wformat=] 2021-01-27T09:46:15.972 INFO:tasks.workunit.client.0.smithi146.stderr: 283 | printf("\t write_size = %llu\t(%s)\n", tg->write_size, 2021-01-27T09:46:15.973 INFO:tasks.workunit.client.0.smithi146.stderr: | ~~~^ ~~~~~~~~~~~~~~ 2021-01-27T09:46:15.973 INFO:tasks.workunit.client.0.smithi146.stderr: | | | 2021-01-27T09:46:15.973 INFO:tasks.workunit.client.0.smithi146.stderr: | | uint64_t {aka long unsigned int} 2021-01-27T09:46:15.973 INFO:tasks.workunit.client.0.smithi146.stderr: | long long unsigned int 2021-01-27T09:46:15.973 INFO:tasks.workunit.client.0.smithi146.stderr: | %lu 2021-01-27T09:46:16.115 INFO:tasks.workunit.client.0.smithi146.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2021-01-27T09:46:16.131 INFO:tasks.workunit.client.0.smithi146.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2021-01-27T09:46:16.190 INFO:tasks.workunit.client.0.smithi146.stderr:ffsb_fs.c: In function 'verify_file': 2021-01-27T09:46:16.191 INFO:tasks.workunit.client.0.smithi146.stderr:ffsb_fs.c:217:19: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 2 has type 'uint64_t' {aka 'long unsigned int'} [-Wformat=] 2021-01-27T09:46:16.191 INFO:tasks.workunit.client.0.smithi146.stderr: 217 | printf("size %llu bytes for file %s is invalid\n", 2021-01-27T09:46:16.191 INFO:tasks.workunit.client.0.smithi146.stderr: | ~~~^ 2021-01-27T09:46:16.191 INFO:tasks.workunit.client.0.smithi146.stderr: | | 2021-01-27T09:46:16.192 INFO:tasks.workunit.client.0.smithi146.stderr: | long long unsigned int 2021-01-27T09:46:16.192 INFO:tasks.workunit.client.0.smithi146.stderr: | %lu 2021-01-27T09:46:16.192 INFO:tasks.workunit.client.0.smithi146.stderr: 218 | filesize, fname); 2021-01-27T09:46:16.192 INFO:tasks.workunit.client.0.smithi146.stderr: | ~~~~~~~~ 2021-01-27T09:46:16.192 INFO:tasks.workunit.client.0.smithi146.stderr: | | 2021-01-27T09:46:16.193 INFO:tasks.workunit.client.0.smithi146.stderr: | uint64_t {aka long unsigned int} 2021-01-27T09:46:16.193 INFO:tasks.workunit.client.0.smithi146.stderr:ffsb_fs.c: In function 'fs_print_config': 2021-01-27T09:46:16.194 INFO:tasks.workunit.client.0.smithi146.stderr:ffsb_fs.c:595:22: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 2 has type 'uint64_t' {aka 'long unsigned int'} [-Wformat=] 2021-01-27T09:46:16.194 INFO:tasks.workunit.client.0.smithi146.stderr: 595 | printf("\t\t %12llu (%6s) -> %u (%.2f\%)\n", 2021-01-27T09:46:16.194 INFO:tasks.workunit.client.0.smithi146.stderr: | ~~~~~^ 2021-01-27T09:46:16.194 INFO:tasks.workunit.client.0.smithi146.stderr: | | 2021-01-27T09:46:16.195 INFO:tasks.workunit.client.0.smithi146.stderr: | long long unsigned int 2021-01-27T09:46:16.195 INFO:tasks.workunit.client.0.smithi146.stderr: | %12lu 2021-01-27T09:46:16.195 INFO:tasks.workunit.client.0.smithi146.stderr: 596 | fs->size_weights[i].size, 2021-01-27T09:46:16.195 INFO:tasks.workunit.client.0.smithi146.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~ 2021-01-27T09:46:16.195 INFO:tasks.workunit.client.0.smithi146.stderr: | | 2021-01-27T09:46:16.196 INFO:tasks.workunit.client.0.smithi146.stderr: | uint64_t {aka long unsigned int} 2021-01-27T09:46:16.196 INFO:tasks.workunit.client.0.smithi146.stderr:ffsb_fs.c:595:43: warning: unknown conversion type character ')' in format [-Wformat=] 2021-01-27T09:46:16.196 INFO:tasks.workunit.client.0.smithi146.stderr: 595 | printf("\t\t %12llu (%6s) -> %u (%.2f\%)\n", 2021-01-27T09:46:16.196 INFO:tasks.workunit.client.0.smithi146.stderr: | ^ 2021-01-27T09:46:16.197 INFO:tasks.workunit.client.0.smithi146.stderr:ffsb_fs.c:603:36: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 2 has type 'uint64_t' {aka 'long unsigned int'} [-Wformat=] 2021-01-27T09:46:16.197 INFO:tasks.workunit.client.0.smithi146.stderr: 603 | printf("\t min file size = %llu\t(%s)\n", fs->minfilesize, 2021-01-27T09:46:16.197 INFO:tasks.workunit.client.0.smithi146.stderr: | ~~~^ ~~~~~~~~~~~~~~~ 2021-01-27T09:46:16.197 INFO:tasks.workunit.client.0.smithi146.stderr: | | | 2021-01-27T09:46:16.197 INFO:tasks.workunit.client.0.smithi146.stderr: | | uint64_t {aka long unsigned int} 2021-01-27T09:46:16.198 INFO:tasks.workunit.client.0.smithi146.stderr: | long long unsigned int 2021-01-27T09:46:16.198 INFO:tasks.workunit.client.0.smithi146.stderr: | %lu 2021-01-27T09:46:16.198 INFO:tasks.workunit.client.0.smithi146.stderr:ffsb_fs.c:605:36: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 2 has type 'uint64_t' {aka 'long unsigned int'} [-Wformat=] 2021-01-27T09:46:16.198 INFO:tasks.workunit.client.0.smithi146.stderr: 605 | printf("\t max file size = %llu\t(%s)\n", fs->maxfilesize, 2021-01-27T09:46:16.198 INFO:tasks.workunit.client.0.smithi146.stderr: | ~~~^ ~~~~~~~~~~~~~~~ 2021-01-27T09:46:16.199 INFO:tasks.workunit.client.0.smithi146.stderr: | | | 2021-01-27T09:46:16.199 INFO:tasks.workunit.client.0.smithi146.stderr: | | uint64_t {aka long unsigned int} 2021-01-27T09:46:16.199 INFO:tasks.workunit.client.0.smithi146.stderr: | long long unsigned int 2021-01-27T09:46:16.199 INFO:tasks.workunit.client.0.smithi146.stderr: | %lu 2021-01-27T09:46:16.200 INFO:tasks.workunit.client.0.smithi146.stderr:ffsb_fs.c:616:41: warning: unknown conversion type character '\x0a' in format [-Wformat=] 2021-01-27T09:46:16.200 INFO:tasks.workunit.client.0.smithi146.stderr: 616 | printf("\t current utilization = %.2f\%\n", getfsutil(fs->basedir)*100); 2021-01-27T09:46:16.200 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~ 2021-01-27T09:46:16.201 INFO:tasks.workunit.client.0.smithi146.stderr:ffsb_fs.c:618:42: warning: unknown conversion type character '\x0a' in format [-Wformat=] 2021-01-27T09:46:16.201 INFO:tasks.workunit.client.0.smithi146.stderr: 618 | printf("\t desired utilization = %.2lf%\n", fs->desired_fsutil * 100); 2021-01-27T09:46:16.201 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~ 2021-01-27T09:46:16.201 INFO:tasks.workunit.client.0.smithi146.stderr:ffsb_fs.c: In function 'fs_needs_stats': 2021-01-27T09:46:16.201 INFO:tasks.workunit.client.0.smithi146.stderr:ffsb_fs.c:627:24: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2021-01-27T09:46:16.202 INFO:tasks.workunit.client.0.smithi146.stderr: 627 | return (fs != NULL) ? (int)fs->fsd.config : 0; 2021-01-27T09:46:16.202 INFO:tasks.workunit.client.0.smithi146.stderr: | ^ 2021-01-27T09:46:16.368 INFO:tasks.workunit.client.0.smithi146.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2021-01-27T09:46:16.380 INFO:tasks.workunit.client.0.smithi146.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2021-01-27T09:46:16.524 INFO:tasks.workunit.client.0.smithi146.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2021-01-27T09:46:16.534 INFO:tasks.workunit.client.0.smithi146.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2021-01-27T09:46:16.588 INFO:tasks.workunit.client.0.smithi146.stderr:ffsb_op.c: In function 'print_op_results': 2021-01-27T09:46:16.589 INFO:tasks.workunit.client.0.smithi146.stderr:ffsb_op.c:83:23: warning: embedded '\0' in format [-Wformat-contains-nul] 2021-01-27T09:46:16.589 INFO:tasks.workunit.client.0.smithi146.stderr: 83 | sprintf(buf, "%s/sec\0", buf); 2021-01-27T09:46:16.589 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~ 2021-01-27T09:46:16.589 INFO:tasks.workunit.client.0.smithi146.stderr:ffsb_op.c:86:19: warning: embedded '\0' in format [-Wformat-contains-nul] 2021-01-27T09:46:16.589 INFO:tasks.workunit.client.0.smithi146.stderr: 86 | sprintf(buf, "NA\0"); 2021-01-27T09:46:16.590 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~ 2021-01-27T09:46:16.590 INFO:tasks.workunit.client.0.smithi146.stderr:ffsb_op.c: In function 'print_results': 2021-01-27T09:46:16.590 INFO:tasks.workunit.client.0.smithi146.stderr:ffsb_op.c:112:61: warning: unknown conversion type character 'T' in format [-Wformat=] 2021-01-27T09:46:16.590 INFO:tasks.workunit.client.0.smithi146.stderr: 112 | printf(" Op Name Transactions\t Trans/sec\t% Trans\t % Op Weight\t Throughput\n"); 2021-01-27T09:46:16.590 INFO:tasks.workunit.client.0.smithi146.stderr: | ^ 2021-01-27T09:46:16.591 INFO:tasks.workunit.client.0.smithi146.stderr:ffsb_op.c:112:74: warning: unknown conversion type character 'O' in format [-Wformat=] 2021-01-27T09:46:16.591 INFO:tasks.workunit.client.0.smithi146.stderr: 112 | printf(" Op Name Transactions\t Trans/sec\t% Trans\t % Op Weight\t Throughput\n"); 2021-01-27T09:46:16.591 INFO:tasks.workunit.client.0.smithi146.stderr: | ^ 2021-01-27T09:46:16.605 INFO:tasks.workunit.client.0.smithi146.stderr:ffsb_op.c:83:19: warning: '/sec' directive writing 4 bytes into a region of size between 1 and 256 [-Wformat-overflow=] 2021-01-27T09:46:16.605 INFO:tasks.workunit.client.0.smithi146.stderr: 83 | sprintf(buf, "%s/sec\0", buf); 2021-01-27T09:46:16.606 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~ 2021-01-27T09:46:16.606 INFO:tasks.workunit.client.0.smithi146.stderr:In file included from /usr/include/stdio.h:867, 2021-01-27T09:46:16.606 INFO:tasks.workunit.client.0.smithi146.stderr: from ffsb_op.c:20: 2021-01-27T09:46:16.606 INFO:tasks.workunit.client.0.smithi146.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:36:10: note: '__builtin___sprintf_chk' output between 5 and 260 bytes into a destination of size 256 2021-01-27T09:46:16.606 INFO:tasks.workunit.client.0.smithi146.stderr: 36 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2021-01-27T09:46:16.607 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2021-01-27T09:46:16.607 INFO:tasks.workunit.client.0.smithi146.stderr: 37 | __bos (__s), __fmt, __va_arg_pack ()); 2021-01-27T09:46:16.607 INFO:tasks.workunit.client.0.smithi146.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2021-01-27T09:46:16.674 INFO:tasks.workunit.client.0.smithi146.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2021-01-27T09:46:16.683 INFO:tasks.workunit.client.0.smithi146.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2021-01-27T09:46:16.746 INFO:tasks.workunit.client.0.smithi146.stderr:util.c: In function 'ffsb_bench_gettimeofday': 2021-01-27T09:46:16.746 INFO:tasks.workunit.client.0.smithi146.stderr:util.c:333:46: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 2 has type 'uint64_t' {aka 'long unsigned int'} [-Wformat=] 2021-01-27T09:46:16.746 INFO:tasks.workunit.client.0.smithi146.stderr: 333 | printf("average time for gettimeofday(): %llu nsec\n", average); 2021-01-27T09:46:16.746 INFO:tasks.workunit.client.0.smithi146.stderr: | ~~~^ ~~~~~~~ 2021-01-27T09:46:16.747 INFO:tasks.workunit.client.0.smithi146.stderr: | | | 2021-01-27T09:46:16.747 INFO:tasks.workunit.client.0.smithi146.stderr: | | uint64_t {aka long unsigned int} 2021-01-27T09:46:16.747 INFO:tasks.workunit.client.0.smithi146.stderr: | long long unsigned int 2021-01-27T09:46:16.747 INFO:tasks.workunit.client.0.smithi146.stderr: | %lu 2021-01-27T09:46:16.747 INFO:tasks.workunit.client.0.smithi146.stderr:util.c: In function 'ffsb_bench_getpid': 2021-01-27T09:46:16.748 INFO:tasks.workunit.client.0.smithi146.stderr:util.c:350:40: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 2 has type 'uint64_t' {aka 'long unsigned int'} [-Wformat=] 2021-01-27T09:46:16.748 INFO:tasks.workunit.client.0.smithi146.stderr: 350 | printf("average time for getpid(): %llu nsec\n", average); 2021-01-27T09:46:16.748 INFO:tasks.workunit.client.0.smithi146.stderr: | ~~~^ ~~~~~~~ 2021-01-27T09:46:16.748 INFO:tasks.workunit.client.0.smithi146.stderr: | | | 2021-01-27T09:46:16.749 INFO:tasks.workunit.client.0.smithi146.stderr: | | uint64_t {aka long unsigned int} 2021-01-27T09:46:16.749 INFO:tasks.workunit.client.0.smithi146.stderr: | long long unsigned int 2021-01-27T09:46:16.749 INFO:tasks.workunit.client.0.smithi146.stderr: | %lu 2021-01-27T09:46:16.858 INFO:tasks.workunit.client.0.smithi146.stdout:mv -f .deps/util.Tpo .deps/util.Po 2021-01-27T09:46:16.870 INFO:tasks.workunit.client.0.smithi146.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2021-01-27T09:46:16.948 INFO:tasks.workunit.client.0.smithi146.stderr:In file included from parser.h:22, 2021-01-27T09:46:16.948 INFO:tasks.workunit.client.0.smithi146.stderr: from parser.c:25: 2021-01-27T09:46:16.948 INFO:tasks.workunit.client.0.smithi146.stderr:parser.c: In function 'init_filesys': 2021-01-27T09:46:16.948 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2021-01-27T09:46:16.949 INFO:tasks.workunit.client.0.smithi146.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2021-01-27T09:46:16.949 INFO:tasks.workunit.client.0.smithi146.stderr: | ^ 2021-01-27T09:46:16.949 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:33:28: note: in expansion of macro 'offsetof' 2021-01-27T09:46:16.949 INFO:tasks.workunit.client.0.smithi146.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2021-01-27T09:46:16.949 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~ 2021-01-27T09:46:16.950 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:36:2: note: in expansion of macro 'container_of' 2021-01-27T09:46:16.950 INFO:tasks.workunit.client.0.smithi146.stderr: 36 | container_of(ptr, type, member) 2021-01-27T09:46:16.950 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~ 2021-01-27T09:46:16.950 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:39:13: note: in expansion of macro 'list_entry' 2021-01-27T09:46:16.950 INFO:tasks.workunit.client.0.smithi146.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2021-01-27T09:46:16.951 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~ 2021-01-27T09:46:16.951 INFO:tasks.workunit.client.0.smithi146.stderr:parser.c:934:3: note: in expansion of macro 'list_for_each_entry' 2021-01-27T09:46:16.951 INFO:tasks.workunit.client.0.smithi146.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2021-01-27T09:46:16.951 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~~~~~~~~ 2021-01-27T09:46:16.951 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2021-01-27T09:46:16.952 INFO:tasks.workunit.client.0.smithi146.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2021-01-27T09:46:16.952 INFO:tasks.workunit.client.0.smithi146.stderr: | ^ 2021-01-27T09:46:16.952 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:33:28: note: in expansion of macro 'offsetof' 2021-01-27T09:46:16.952 INFO:tasks.workunit.client.0.smithi146.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2021-01-27T09:46:16.952 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~ 2021-01-27T09:46:16.953 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:36:2: note: in expansion of macro 'container_of' 2021-01-27T09:46:16.953 INFO:tasks.workunit.client.0.smithi146.stderr: 36 | container_of(ptr, type, member) 2021-01-27T09:46:16.953 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~ 2021-01-27T09:46:16.953 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:41:13: note: in expansion of macro 'list_entry' 2021-01-27T09:46:16.953 INFO:tasks.workunit.client.0.smithi146.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2021-01-27T09:46:16.954 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~ 2021-01-27T09:46:16.954 INFO:tasks.workunit.client.0.smithi146.stderr:parser.c:934:3: note: in expansion of macro 'list_for_each_entry' 2021-01-27T09:46:16.954 INFO:tasks.workunit.client.0.smithi146.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2021-01-27T09:46:16.954 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~~~~~~~~ 2021-01-27T09:46:16.955 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2021-01-27T09:46:16.955 INFO:tasks.workunit.client.0.smithi146.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2021-01-27T09:46:16.956 INFO:tasks.workunit.client.0.smithi146.stderr: | ^ 2021-01-27T09:46:16.956 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:33:28: note: in expansion of macro 'offsetof' 2021-01-27T09:46:16.956 INFO:tasks.workunit.client.0.smithi146.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2021-01-27T09:46:16.956 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~ 2021-01-27T09:46:16.956 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:36:2: note: in expansion of macro 'container_of' 2021-01-27T09:46:16.957 INFO:tasks.workunit.client.0.smithi146.stderr: 36 | container_of(ptr, type, member) 2021-01-27T09:46:16.957 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~ 2021-01-27T09:46:16.957 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:39:13: note: in expansion of macro 'list_entry' 2021-01-27T09:46:16.957 INFO:tasks.workunit.client.0.smithi146.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2021-01-27T09:46:16.957 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~ 2021-01-27T09:46:16.958 INFO:tasks.workunit.client.0.smithi146.stderr:parser.c:941:3: note: in expansion of macro 'list_for_each_entry' 2021-01-27T09:46:16.958 INFO:tasks.workunit.client.0.smithi146.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2021-01-27T09:46:16.958 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~~~~~~~~ 2021-01-27T09:46:16.958 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2021-01-27T09:46:16.959 INFO:tasks.workunit.client.0.smithi146.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2021-01-27T09:46:16.959 INFO:tasks.workunit.client.0.smithi146.stderr: | ^ 2021-01-27T09:46:16.959 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:33:28: note: in expansion of macro 'offsetof' 2021-01-27T09:46:16.959 INFO:tasks.workunit.client.0.smithi146.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2021-01-27T09:46:16.959 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~ 2021-01-27T09:46:16.960 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:36:2: note: in expansion of macro 'container_of' 2021-01-27T09:46:16.960 INFO:tasks.workunit.client.0.smithi146.stderr: 36 | container_of(ptr, type, member) 2021-01-27T09:46:16.960 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~ 2021-01-27T09:46:16.960 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:41:13: note: in expansion of macro 'list_entry' 2021-01-27T09:46:16.960 INFO:tasks.workunit.client.0.smithi146.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2021-01-27T09:46:16.961 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~ 2021-01-27T09:46:16.961 INFO:tasks.workunit.client.0.smithi146.stderr:parser.c:941:3: note: in expansion of macro 'list_for_each_entry' 2021-01-27T09:46:16.961 INFO:tasks.workunit.client.0.smithi146.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2021-01-27T09:46:16.961 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~~~~~~~~ 2021-01-27T09:46:16.961 INFO:tasks.workunit.client.0.smithi146.stderr:parser.c: In function 'init_tg_stats': 2021-01-27T09:46:16.962 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2021-01-27T09:46:16.962 INFO:tasks.workunit.client.0.smithi146.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2021-01-27T09:46:16.962 INFO:tasks.workunit.client.0.smithi146.stderr: | ^ 2021-01-27T09:46:16.962 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:33:28: note: in expansion of macro 'offsetof' 2021-01-27T09:46:16.962 INFO:tasks.workunit.client.0.smithi146.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2021-01-27T09:46:16.963 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~ 2021-01-27T09:46:16.963 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:36:2: note: in expansion of macro 'container_of' 2021-01-27T09:46:16.963 INFO:tasks.workunit.client.0.smithi146.stderr: 36 | container_of(ptr, type, member) 2021-01-27T09:46:16.963 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~ 2021-01-27T09:46:16.963 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:39:13: note: in expansion of macro 'list_entry' 2021-01-27T09:46:16.964 INFO:tasks.workunit.client.0.smithi146.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2021-01-27T09:46:16.964 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~ 2021-01-27T09:46:16.964 INFO:tasks.workunit.client.0.smithi146.stderr:parser.c:971:6: note: in expansion of macro 'list_for_each_entry' 2021-01-27T09:46:16.964 INFO:tasks.workunit.client.0.smithi146.stderr: 971 | list_for_each_entry(tmp_list, 2021-01-27T09:46:16.964 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~~~~~~~~ 2021-01-27T09:46:16.965 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2021-01-27T09:46:16.965 INFO:tasks.workunit.client.0.smithi146.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2021-01-27T09:46:16.965 INFO:tasks.workunit.client.0.smithi146.stderr: | ^ 2021-01-27T09:46:16.965 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:33:28: note: in expansion of macro 'offsetof' 2021-01-27T09:46:16.965 INFO:tasks.workunit.client.0.smithi146.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2021-01-27T09:46:16.966 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~ 2021-01-27T09:46:16.966 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:36:2: note: in expansion of macro 'container_of' 2021-01-27T09:46:16.966 INFO:tasks.workunit.client.0.smithi146.stderr: 36 | container_of(ptr, type, member) 2021-01-27T09:46:16.966 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~ 2021-01-27T09:46:16.966 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:41:13: note: in expansion of macro 'list_entry' 2021-01-27T09:46:16.967 INFO:tasks.workunit.client.0.smithi146.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2021-01-27T09:46:16.967 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~ 2021-01-27T09:46:16.967 INFO:tasks.workunit.client.0.smithi146.stderr:parser.c:971:6: note: in expansion of macro 'list_for_each_entry' 2021-01-27T09:46:16.967 INFO:tasks.workunit.client.0.smithi146.stderr: 971 | list_for_each_entry(tmp_list, 2021-01-27T09:46:16.967 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~~~~~~~~ 2021-01-27T09:46:16.968 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2021-01-27T09:46:16.968 INFO:tasks.workunit.client.0.smithi146.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2021-01-27T09:46:16.968 INFO:tasks.workunit.client.0.smithi146.stderr: | ^ 2021-01-27T09:46:16.968 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:33:28: note: in expansion of macro 'offsetof' 2021-01-27T09:46:16.968 INFO:tasks.workunit.client.0.smithi146.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2021-01-27T09:46:16.969 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~ 2021-01-27T09:46:16.969 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:36:2: note: in expansion of macro 'container_of' 2021-01-27T09:46:16.969 INFO:tasks.workunit.client.0.smithi146.stderr: 36 | container_of(ptr, type, member) 2021-01-27T09:46:16.969 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~ 2021-01-27T09:46:16.969 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:39:13: note: in expansion of macro 'list_entry' 2021-01-27T09:46:16.970 INFO:tasks.workunit.client.0.smithi146.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2021-01-27T09:46:16.970 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~ 2021-01-27T09:46:16.970 INFO:tasks.workunit.client.0.smithi146.stderr:parser.c:980:6: note: in expansion of macro 'list_for_each_entry' 2021-01-27T09:46:16.970 INFO:tasks.workunit.client.0.smithi146.stderr: 980 | list_for_each_entry(tmp_list, 2021-01-27T09:46:16.971 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~~~~~~~~ 2021-01-27T09:46:16.971 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2021-01-27T09:46:16.971 INFO:tasks.workunit.client.0.smithi146.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2021-01-27T09:46:16.971 INFO:tasks.workunit.client.0.smithi146.stderr: | ^ 2021-01-27T09:46:16.971 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:33:28: note: in expansion of macro 'offsetof' 2021-01-27T09:46:16.972 INFO:tasks.workunit.client.0.smithi146.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2021-01-27T09:46:16.972 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~ 2021-01-27T09:46:16.972 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:36:2: note: in expansion of macro 'container_of' 2021-01-27T09:46:16.972 INFO:tasks.workunit.client.0.smithi146.stderr: 36 | container_of(ptr, type, member) 2021-01-27T09:46:16.972 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~ 2021-01-27T09:46:16.973 INFO:tasks.workunit.client.0.smithi146.stderr:list.h:41:13: note: in expansion of macro 'list_entry' 2021-01-27T09:46:16.973 INFO:tasks.workunit.client.0.smithi146.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2021-01-27T09:46:16.973 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~ 2021-01-27T09:46:16.973 INFO:tasks.workunit.client.0.smithi146.stderr:parser.c:980:6: note: in expansion of macro 'list_for_each_entry' 2021-01-27T09:46:16.973 INFO:tasks.workunit.client.0.smithi146.stderr: 980 | list_for_each_entry(tmp_list, 2021-01-27T09:46:16.973 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~~~~~~~~ 2021-01-27T09:46:17.027 INFO:tasks.workunit.client.0.smithi146.stderr:In file included from /usr/include/string.h:495, 2021-01-27T09:46:17.028 INFO:tasks.workunit.client.0.smithi146.stderr: from parser.c:19: 2021-01-27T09:46:17.028 INFO:tasks.workunit.client.0.smithi146.stderr:In function 'memcpy', 2021-01-27T09:46:17.028 INFO:tasks.workunit.client.0.smithi146.stderr: inlined from 'size64_convert' at parser.c:119:2: 2021-01-27T09:46:17.028 INFO:tasks.workunit.client.0.smithi146.stderr:/usr/include/x86_64-linux-gnu/bits/string_fortified.h:34:10: warning: '__builtin_memcpy' reading 3 bytes from a region of size 2 [-Wstringop-overflow=] 2021-01-27T09:46:17.029 INFO:tasks.workunit.client.0.smithi146.stderr: 34 | return __builtin___memcpy_chk (__dest, __src, __len, __bos0 (__dest)); 2021-01-27T09:46:17.029 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2021-01-27T09:46:17.098 INFO:tasks.workunit.client.0.smithi146.stderr:In function 'strncpy', 2021-01-27T09:46:17.098 INFO:tasks.workunit.client.0.smithi146.stderr: inlined from 'set_weight' at parser.c:623:4: 2021-01-27T09:46:17.099 INFO:tasks.workunit.client.0.smithi146.stderr:/usr/include/x86_64-linux-gnu/bits/string_fortified.h:106:10: warning: '__builtin_strncpy' specified bound depends on the length of the source argument [-Wstringop-overflow=] 2021-01-27T09:46:17.099 INFO:tasks.workunit.client.0.smithi146.stderr: 106 | return __builtin___strncpy_chk (__dest, __src, __len, __bos (__dest)); 2021-01-27T09:46:17.099 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2021-01-27T09:46:17.100 INFO:tasks.workunit.client.0.smithi146.stderr:parser.c: In function 'set_weight': 2021-01-27T09:46:17.100 INFO:tasks.workunit.client.0.smithi146.stderr:parser.c:620:10: note: length computed here 2021-01-27T09:46:17.100 INFO:tasks.workunit.client.0.smithi146.stderr: 620 | len = strlen(tmp_config->name); 2021-01-27T09:46:17.100 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2021-01-27T09:46:17.103 INFO:tasks.workunit.client.0.smithi146.stderr:In file included from /usr/include/string.h:495, 2021-01-27T09:46:17.104 INFO:tasks.workunit.client.0.smithi146.stderr: from parser.c:19: 2021-01-27T09:46:17.104 INFO:tasks.workunit.client.0.smithi146.stderr:In function 'strncpy', 2021-01-27T09:46:17.104 INFO:tasks.workunit.client.0.smithi146.stderr: inlined from 'get_weight_total' at parser.c:645:4: 2021-01-27T09:46:17.104 INFO:tasks.workunit.client.0.smithi146.stderr:/usr/include/x86_64-linux-gnu/bits/string_fortified.h:106:10: warning: '__builtin_strncpy' specified bound depends on the length of the source argument [-Wstringop-overflow=] 2021-01-27T09:46:17.105 INFO:tasks.workunit.client.0.smithi146.stderr: 106 | return __builtin___strncpy_chk (__dest, __src, __len, __bos (__dest)); 2021-01-27T09:46:17.105 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2021-01-27T09:46:17.105 INFO:tasks.workunit.client.0.smithi146.stderr:parser.c: In function 'get_weight_total': 2021-01-27T09:46:17.105 INFO:tasks.workunit.client.0.smithi146.stderr:parser.c:642:10: note: length computed here 2021-01-27T09:46:17.105 INFO:tasks.workunit.client.0.smithi146.stderr: 642 | len = strlen(tmp_config->name); 2021-01-27T09:46:17.106 INFO:tasks.workunit.client.0.smithi146.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2021-01-27T09:46:17.286 INFO:tasks.workunit.client.0.smithi146.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2021-01-27T09:46:17.299 INFO:tasks.workunit.client.0.smithi146.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2021-01-27T09:46:17.422 INFO:tasks.workunit.client.0.smithi146.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2021-01-27T09:46:17.436 INFO:tasks.workunit.client.0.smithi146.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2021-01-27T09:46:17.587 INFO:tasks.workunit.client.0.smithi146.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2021-01-27T09:46:17.599 INFO:tasks.workunit.client.0.smithi146.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2021-01-27T09:46:17.672 INFO:tasks.workunit.client.0.smithi146.stdout:mv -f .deps/list.Tpo .deps/list.Po 2021-01-27T09:46:17.692 INFO:tasks.workunit.client.0.smithi146.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2021-01-27T09:46:17.786 INFO:tasks.workunit.client.0.smithi146.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb-6.0-rc2' 2021-01-27T09:46:17.822 INFO:tasks.workunit.client.0.smithi146.stdout:FFSB version 6.0-RC2 started 2021-01-27T09:46:17.822 INFO:tasks.workunit.client.0.smithi146.stdout: 2021-01-27T09:46:17.834 INFO:tasks.workunit.client.0.smithi146.stdout:benchmark time = 300 2021-01-27T09:46:17.834 INFO:tasks.workunit.client.0.smithi146.stdout:ThreadGroup 0 2021-01-27T09:46:17.834 INFO:tasks.workunit.client.0.smithi146.stdout:================ 2021-01-27T09:46:17.834 INFO:tasks.workunit.client.0.smithi146.stdout: num_threads = 32 2021-01-27T09:46:17.835 INFO:tasks.workunit.client.0.smithi146.stdout: 2021-01-27T09:46:17.835 INFO:tasks.workunit.client.0.smithi146.stdout: read_random = off 2021-01-27T09:46:17.835 INFO:tasks.workunit.client.0.smithi146.stdout: read_size = 0 (0B) 2021-01-27T09:46:17.835 INFO:tasks.workunit.client.0.smithi146.stdout: read_blocksize = 0 (0B) 2021-01-27T09:46:17.836 INFO:tasks.workunit.client.0.smithi146.stdout: read_skip = off 2021-01-27T09:46:17.836 INFO:tasks.workunit.client.0.smithi146.stdout: read_skipsize = 0 (0B) 2021-01-27T09:46:17.836 INFO:tasks.workunit.client.0.smithi146.stdout: 2021-01-27T09:46:17.836 INFO:tasks.workunit.client.0.smithi146.stdout: write_random = on 2021-01-27T09:46:17.837 INFO:tasks.workunit.client.0.smithi146.stdout: write_size = 5242880 (5MB) 2021-01-27T09:46:17.837 INFO:tasks.workunit.client.0.smithi146.stdout: fsync_file = 0 2021-01-27T09:46:17.837 INFO:tasks.workunit.client.0.smithi146.stdout: write_blocksize = 4096 (4KB) 2021-01-27T09:46:17.837 INFO:tasks.workunit.client.0.smithi146.stdout: wait time = 0 2021-01-27T09:46:17.838 INFO:tasks.workunit.client.0.smithi146.stdout: 2021-01-27T09:46:17.838 INFO:tasks.workunit.client.0.smithi146.stdout: op weights 2021-01-27T09:46:17.838 INFO:tasks.workunit.client.0.smithi146.stdout: read = 0 (0.00%) 2021-01-27T09:46:17.838 INFO:tasks.workunit.client.0.smithi146.stdout: readall = 0 (0.00%) 2021-01-27T09:46:17.838 INFO:tasks.workunit.client.0.smithi146.stdout: write = 1 (100.00%) 2021-01-27T09:46:17.839 INFO:tasks.workunit.client.0.smithi146.stdout: create = 0 (0.00%) 2021-01-27T09:46:17.839 INFO:tasks.workunit.client.0.smithi146.stdout: append = 0 (0.00%) 2021-01-27T09:46:17.839 INFO:tasks.workunit.client.0.smithi146.stdout: delete = 0 (0.00%) 2021-01-27T09:46:17.839 INFO:tasks.workunit.client.0.smithi146.stdout: metaop = 0 (0.00%) 2021-01-27T09:46:17.840 INFO:tasks.workunit.client.0.smithi146.stdout: createdir = 0 (0.00%) 2021-01-27T09:46:17.840 INFO:tasks.workunit.client.0.smithi146.stdout: stat = 0 (0.00%) 2021-01-27T09:46:17.840 INFO:tasks.workunit.client.0.smithi146.stdout: writeall = 0 (0.00%) 2021-01-27T09:46:17.840 INFO:tasks.workunit.client.0.smithi146.stdout: writeall_fsync = 0 (0.00%) 2021-01-27T09:46:17.841 INFO:tasks.workunit.client.0.smithi146.stdout: open_close = 0 (0.00%) 2021-01-27T09:46:17.841 INFO:tasks.workunit.client.0.smithi146.stdout: write_fsync = 0 (0.00%) 2021-01-27T09:46:17.841 INFO:tasks.workunit.client.0.smithi146.stdout: create_fsync = 0 (0.00%) 2021-01-27T09:46:17.842 INFO:tasks.workunit.client.0.smithi146.stdout: append_fsync = 0 (0.00%) 2021-01-27T09:46:17.842 INFO:tasks.workunit.client.0.smithi146.stdout: 2021-01-27T09:46:17.843 INFO:tasks.workunit.client.0.smithi146.stdout:FileSystem . 2021-01-27T09:46:17.843 INFO:tasks.workunit.client.0.smithi146.stdout:========== 2021-01-27T09:46:17.844 INFO:tasks.workunit.client.0.smithi146.stdout: num_dirs = 0 2021-01-27T09:46:17.844 INFO:tasks.workunit.client.0.smithi146.stdout: starting files = 128 2021-01-27T09:46:17.845 INFO:tasks.workunit.client.0.smithi146.stdout: 2021-01-27T09:46:17.845 INFO:tasks.workunit.client.0.smithi146.stdout: min file size = 104857600 (100MB) 2021-01-27T09:46:17.846 INFO:tasks.workunit.client.0.smithi146.stdout: max file size = 104857600 (100MB) 2021-01-27T09:46:17.846 INFO:tasks.workunit.client.0.smithi146.stdout: directio = off 2021-01-27T09:46:17.846 INFO:tasks.workunit.client.0.smithi146.stdout: alignedio = on 2021-01-27T09:46:17.847 INFO:tasks.workunit.client.0.smithi146.stdout: bufferedio = off 2021-01-27T09:46:17.847 INFO:tasks.workunit.client.0.smithi146.stdout: 2021-01-27T09:46:17.847 INFO:tasks.workunit.client.0.smithi146.stdout: aging is off 2021-01-27T09:46:17.848 INFO:tasks.workunit.client.0.smithi146.stdout: current utilization = 0.01% 2021-01-27T09:46:17.849 INFO:tasks.workunit.client.0.smithi146.stdout: 2021-01-27T09:46:17.849 INFO:tasks.workunit.client.0.smithi146.stdout:checking existing fs: . 2021-01-27T09:46:17.849 INFO:tasks.workunit.client.0.smithi146.stdout:recreating new fileset 2021-01-27T09:46:17.850 INFO:tasks.workunit.client.0.smithi146.stderr:opendir: No such file or directory 2021-01-27T09:46:40.063 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:46:40.066 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:46:41.511 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:46:41.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.725+0000 7fc8f5630700 1 Processor -- start 2021-01-27T09:46:41.726 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.725+0000 7fc8f5630700 1 -- start start 2021-01-27T09:46:41.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.725+0000 7fc8f5630700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8f00614a0 0x7fc8f0069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:41.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.725+0000 7fc8f5630700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc8f0065d70 0x7fc8f014f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:41.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.725+0000 7fc8f5630700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc8f0061880 0x7fc8f014f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:41.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.725+0000 7fc8f5630700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f00befd0 con 0x7fc8f0061880 2021-01-27T09:46:41.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.725+0000 7fc8f5630700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f00b56c0 con 0x7fc8f00614a0 2021-01-27T09:46:41.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.725+0000 7fc8f5630700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f00b5960 con 0x7fc8f0065d70 2021-01-27T09:46:41.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.725+0000 7fc8e7fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc8f0065d70 0x7fc8f014f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:41.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.725+0000 7fc8effff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc8f0061880 0x7fc8f014f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:41.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.725+0000 7fc8effff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc8f0061880 0x7fc8f014f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:50608/0 (socket says 172.21.15.146:50608) 2021-01-27T09:46:41.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.725+0000 7fc8e7fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc8f0065d70 0x7fc8f014f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:37218/0 (socket says 172.21.15.146:37218) 2021-01-27T09:46:41.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.725+0000 7fc8effff700 1 -- 172.21.15.146:0/3391385732 learned_addr learned my addr 172.21.15.146:0/3391385732 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:46:41.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.725+0000 7fc8eeffd700 1 --2- 172.21.15.146:0/3391385732 >> v2:172.21.15.146:3300/0 conn(0x7fc8f00614a0 0x7fc8f0069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:41.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.729+0000 7fc8e7fff700 1 -- 172.21.15.146:0/3391385732 >> v2:172.21.15.146:3300/0 conn(0x7fc8f00614a0 msgr2=0x7fc8f0069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:46:41.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.729+0000 7fc8e7fff700 1 --2- 172.21.15.146:0/3391385732 >> v2:172.21.15.146:3300/0 conn(0x7fc8f00614a0 0x7fc8f0069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:41.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.729+0000 7fc8e7fff700 1 -- 172.21.15.146:0/3391385732 >> v2:172.21.15.78:3300/0 conn(0x7fc8f0061880 msgr2=0x7fc8f014f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:46:41.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.729+0000 7fc8e7fff700 1 --2- 172.21.15.146:0/3391385732 >> v2:172.21.15.78:3300/0 conn(0x7fc8f0061880 0x7fc8f014f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:41.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.729+0000 7fc8e7fff700 1 -- 172.21.15.146:0/3391385732 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f00b5c00 con 0x7fc8f0065d70 2021-01-27T09:46:41.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.729+0000 7fc8effff700 1 --2- 172.21.15.146:0/3391385732 >> v2:172.21.15.78:3300/0 conn(0x7fc8f0061880 0x7fc8f014f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:46:41.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.729+0000 7fc8e7fff700 1 --2- 172.21.15.146:0/3391385732 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc8f0065d70 0x7fc8f014f230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fc8f00bf2c0 tx=0x7fc8d8006e20).ready entity=mon.2 client_cookie=e2fff24816fa9bcb server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:41.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.729+0000 7fc8ee7fc700 1 -- 172.21.15.146:0/3391385732 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8009650 con 0x7fc8f0065d70 2021-01-27T09:46:41.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.729+0000 7fc8ee7fc700 1 -- 172.21.15.146:0/3391385732 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d80097b0 con 0x7fc8f0065d70 2021-01-27T09:46:41.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.729+0000 7fc8ee7fc700 1 -- 172.21.15.146:0/3391385732 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8009b30 con 0x7fc8f0065d70 2021-01-27T09:46:41.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.729+0000 7fc8f5630700 1 -- 172.21.15.146:0/3391385732 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc8f0065d70 msgr2=0x7fc8f014f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:41.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.729+0000 7fc8f5630700 1 --2- 172.21.15.146:0/3391385732 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc8f0065d70 0x7fc8f014f230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fc8f00bf2c0 tx=0x7fc8d8006e20).stop 2021-01-27T09:46:41.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.729+0000 7fc8f5630700 1 -- 172.21.15.146:0/3391385732 shutdown_connections 2021-01-27T09:46:41.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.729+0000 7fc8f5630700 1 --2- 172.21.15.146:0/3391385732 >> v2:172.21.15.78:3300/0 conn(0x7fc8f0061880 0x7fc8f014f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:41.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.729+0000 7fc8f5630700 1 --2- 172.21.15.146:0/3391385732 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc8f0065d70 0x7fc8f014f230 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:41.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.729+0000 7fc8f5630700 1 --2- 172.21.15.146:0/3391385732 >> v2:172.21.15.146:3300/0 conn(0x7fc8f00614a0 0x7fc8f0069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:41.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.729+0000 7fc8f5630700 1 -- 172.21.15.146:0/3391385732 >> 172.21.15.146:0/3391385732 conn(0x7fc8f0062810 msgr2=0x7fc8f0063330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:46:41.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.729+0000 7fc8f5630700 1 -- 172.21.15.146:0/3391385732 shutdown_connections 2021-01-27T09:46:41.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.729+0000 7fc8f5630700 1 -- 172.21.15.146:0/3391385732 wait complete. 2021-01-27T09:46:41.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.733+0000 7fc8f5630700 1 Processor -- start 2021-01-27T09:46:41.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.733+0000 7fc8f5630700 1 -- start start 2021-01-27T09:46:41.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.733+0000 7fc8f5630700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc8f00614a0 0x7fc8f015ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:41.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.733+0000 7fc8f5630700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8f0061880 0x7fc8f015afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:41.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.733+0000 7fc8f5630700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8f0065d70 0x7fc8f014e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:41.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.733+0000 7fc8f5630700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f00bcb50 con 0x7fc8f0061880 2021-01-27T09:46:41.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.733+0000 7fc8f5630700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f015f430 con 0x7fc8f0065d70 2021-01-27T09:46:41.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.733+0000 7fc8f5630700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f0144c00 con 0x7fc8f00614a0 2021-01-27T09:46:41.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.733+0000 7fc8effff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8f0065d70 0x7fc8f014e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:41.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.733+0000 7fc8effff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8f0065d70 0x7fc8f014e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47742/0 (socket says 172.21.15.146:47742) 2021-01-27T09:46:41.740 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.733+0000 7fc8effff700 1 -- 172.21.15.146:0/3708227390 learned_addr learned my addr 172.21.15.146:0/3708227390 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:46:41.741 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.733+0000 7fc8eeffd700 1 --2- 172.21.15.146:0/3708227390 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc8f00614a0 0x7fc8f015ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:41.741 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.737+0000 7fc8effff700 1 -- 172.21.15.146:0/3708227390 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc8f00614a0 msgr2=0x7fc8f015ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:41.741 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.737+0000 7fc8effff700 1 --2- 172.21.15.146:0/3708227390 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc8f00614a0 0x7fc8f015ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:41.742 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.737+0000 7fc8effff700 1 -- 172.21.15.146:0/3708227390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8f0061880 msgr2=0x7fc8f015afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:41.742 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.737+0000 7fc8effff700 1 --2- 172.21.15.146:0/3708227390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8f0061880 0x7fc8f015afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:46:41.742 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.737+0000 7fc8effff700 1 -- 172.21.15.146:0/3708227390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f0144ea0 con 0x7fc8f0065d70 2021-01-27T09:46:41.742 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.737+0000 7fc8effff700 1 --2- 172.21.15.146:0/3708227390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8f0065d70 0x7fc8f014e380 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fc8e800ef20 tx=0x7fc8e80092d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:41.743 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.737+0000 7fc8e6ffd700 1 -- 172.21.15.146:0/3708227390 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e800cc60 con 0x7fc8f0065d70 2021-01-27T09:46:41.743 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.737+0000 7fc8f5630700 1 -- 172.21.15.146:0/3708227390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f0145140 con 0x7fc8f0065d70 2021-01-27T09:46:41.743 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.737+0000 7fc8f5630700 1 -- 172.21.15.146:0/3708227390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f00bd020 con 0x7fc8f0065d70 2021-01-27T09:46:41.743 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.737+0000 7fc8e6ffd700 1 -- 172.21.15.146:0/3708227390 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e800cdc0 con 0x7fc8f0065d70 2021-01-27T09:46:41.743 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.737+0000 7fc8e6ffd700 1 -- 172.21.15.146:0/3708227390 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8012620 con 0x7fc8f0065d70 2021-01-27T09:46:41.744 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.741+0000 7fc8f5630700 1 -- 172.21.15.146:0/3708227390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c8004fa0 con 0x7fc8f0065d70 2021-01-27T09:46:41.744 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.741+0000 7fc8e6ffd700 1 -- 172.21.15.146:0/3708227390 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fc8e8022070 con 0x7fc8f0065d70 2021-01-27T09:46:41.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.741+0000 7fc8e6ffd700 1 --2- 172.21.15.146:0/3708227390 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc8d4056210 0x7fc8d40586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:41.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.741+0000 7fc8e6ffd700 1 -- 172.21.15.146:0/3708227390 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fc8e806fe40 con 0x7fc8f0065d70 2021-01-27T09:46:41.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.741+0000 7fc8eeffd700 1 --2- 172.21.15.146:0/3708227390 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc8d4056210 0x7fc8d40586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:41.746 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.745+0000 7fc8eeffd700 1 --2- 172.21.15.146:0/3708227390 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc8d4056210 0x7fc8d40586d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fc8e000bb80 tx=0x7fc8e0006dc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:41.750 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.749+0000 7fc8e6ffd700 1 -- 172.21.15.146:0/3708227390 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fc8e8045510 con 0x7fc8f0065d70 2021-01-27T09:46:41.912 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.913+0000 7fc8f5630700 1 -- 172.21.15.146:0/3708227390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8c80057d0 con 0x7fc8f0065d70 2021-01-27T09:46:41.914 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.913+0000 7fc8e6ffd700 1 -- 172.21.15.146:0/3708227390 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3575 (secure 0 0 0) 0x7fc8e8016070 con 0x7fc8f0065d70 2021-01-27T09:46:41.914 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:46:41.915 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:46:16.665785+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6837/745099427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":745099427},{"type":"v1","addr":"172.21.15.146:6837","nonce":745099427}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:46:41.917 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.913+0000 7fc8f5630700 1 -- 172.21.15.146:0/3708227390 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc8d4056210 msgr2=0x7fc8d40586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:41.917 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.913+0000 7fc8f5630700 1 --2- 172.21.15.146:0/3708227390 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc8d4056210 0x7fc8d40586d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fc8e000bb80 tx=0x7fc8e0006dc0).stop 2021-01-27T09:46:41.918 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.913+0000 7fc8f5630700 1 -- 172.21.15.146:0/3708227390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8f0065d70 msgr2=0x7fc8f014e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:41.918 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.913+0000 7fc8f5630700 1 --2- 172.21.15.146:0/3708227390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8f0065d70 0x7fc8f014e380 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fc8e800ef20 tx=0x7fc8e80092d0).stop 2021-01-27T09:46:41.918 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.913+0000 7fc8f5630700 1 -- 172.21.15.146:0/3708227390 shutdown_connections 2021-01-27T09:46:41.919 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.913+0000 7fc8f5630700 1 --2- 172.21.15.146:0/3708227390 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc8d4056210 0x7fc8d40586d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:41.919 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.913+0000 7fc8f5630700 1 --2- 172.21.15.146:0/3708227390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8f0065d70 0x7fc8f014e380 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:41.919 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.913+0000 7fc8f5630700 1 --2- 172.21.15.146:0/3708227390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8f0061880 0x7fc8f015afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:46:41.920 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.913+0000 7fc8f5630700 1 --2- 172.21.15.146:0/3708227390 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc8f00614a0 0x7fc8f015ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:41.920 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.913+0000 7fc8f5630700 1 -- 172.21.15.146:0/3708227390 >> 172.21.15.146:0/3708227390 conn(0x7fc8f0062810 msgr2=0x7fc8f0146d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:46:41.921 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.913+0000 7fc8f5630700 1 -- 172.21.15.146:0/3708227390 shutdown_connections 2021-01-27T09:46:41.921 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:41.913+0000 7fc8f5630700 1 -- 172.21.15.146:0/3708227390 wait complete. 2021-01-27T09:46:41.922 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 14 2021-01-27T09:46:41.941 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.e (rank=2) 2021-01-27T09:46:41.942 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2021-01-27T09:46:41.942 INFO:teuthology.orchestra.run:waiting for 300 2021-01-27T09:46:41.973 INFO:tasks.ceph.mds.e:Stopped 2021-01-27T09:46:41.973 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:46:42.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.133+0000 7f20fb025700 1 Processor -- start 2021-01-27T09:46:42.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.133+0000 7f20fb025700 1 -- start start 2021-01-27T09:46:42.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.133+0000 7f20fb025700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f20f40be650 0x7f20f4066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:42.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.133+0000 7f20fb025700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f20f40bec50 0x7f20f4152df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:42.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.133+0000 7f20fb025700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f4156750 con 0x7f20f40be270 2021-01-27T09:46:42.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.133+0000 7f20fb025700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f4155f80 con 0x7f20f40bec50 2021-01-27T09:46:42.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.133+0000 7f20fb025700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f4156210 con 0x7f20f40be650 2021-01-27T09:46:42.137 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.133+0000 7f20f8dc1700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f20f40be270 0x7f20f4155860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47318/0 (socket says 172.21.15.146:47318) 2021-01-27T09:46:42.137 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.133+0000 7f20f8dc1700 1 -- 172.21.15.146:0/1848177469 learned_addr learned my addr 172.21.15.146:0/1848177469 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:46:42.139 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.133+0000 7f20ebfff700 1 --2- 172.21.15.146:0/1848177469 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f20f40be650 0x7f20f4066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:42.139 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.133+0000 7f20f95c2700 1 --2- 172.21.15.146:0/1848177469 >> v2:172.21.15.78:3300/0 conn(0x7f20f40bec50 0x7f20f4152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:42.140 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.137+0000 7f20eb7fe700 1 -- 172.21.15.146:0/1848177469 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153986429 0 0) 0x7f20f4156750 con 0x7f20f40be270 2021-01-27T09:46:42.140 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.137+0000 7f20eb7fe700 1 -- 172.21.15.146:0/1848177469 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20e0003270 con 0x7f20f40be270 2021-01-27T09:46:42.140 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.137+0000 7f20ebfff700 1 -- 172.21.15.146:0/1848177469 >> v2:172.21.15.78:3300/0 conn(0x7f20f40bec50 msgr2=0x7f20f4152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:46:42.140 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.137+0000 7f20ebfff700 1 --2- 172.21.15.146:0/1848177469 >> v2:172.21.15.78:3300/0 conn(0x7f20f40bec50 0x7f20f4152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:42.141 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.137+0000 7f20ebfff700 1 -- 172.21.15.146:0/1848177469 >> v1:172.21.15.146:6789/0 conn(0x7f20f40be270 legacy=0x7f20f4155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:42.141 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.137+0000 7f20ebfff700 1 -- 172.21.15.146:0/1848177469 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f41564b0 con 0x7f20f40be650 2021-01-27T09:46:42.141 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.137+0000 7f20ebfff700 1 --2- 172.21.15.146:0/1848177469 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f20f40be650 0x7f20f4066520 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f20f000b9c0 tx=0x7f20f0006e20).ready entity=mon.2 client_cookie=bd5c95a41d593e7b server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:42.141 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.137+0000 7f20eb7fe700 1 -- 172.21.15.146:0/1848177469 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f0009690 con 0x7f20f40be650 2021-01-27T09:46:42.142 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.137+0000 7f20eb7fe700 1 -- 172.21.15.146:0/1848177469 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f00097f0 con 0x7f20f40be650 2021-01-27T09:46:42.142 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.137+0000 7f20eb7fe700 1 -- 172.21.15.146:0/1848177469 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f0009b70 con 0x7f20f40be650 2021-01-27T09:46:42.142 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.137+0000 7f20fb025700 1 -- 172.21.15.146:0/1848177469 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f20f40be650 msgr2=0x7f20f4066520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:42.142 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.137+0000 7f20fb025700 1 --2- 172.21.15.146:0/1848177469 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f20f40be650 0x7f20f4066520 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f20f000b9c0 tx=0x7f20f0006e20).stop 2021-01-27T09:46:42.142 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.137+0000 7f20fb025700 1 -- 172.21.15.146:0/1848177469 shutdown_connections 2021-01-27T09:46:42.143 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.137+0000 7f20fb025700 1 --2- 172.21.15.146:0/1848177469 >> v2:172.21.15.78:3300/0 conn(0x7f20f40bec50 0x7f20f4152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:42.143 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.137+0000 7f20fb025700 1 --2- 172.21.15.146:0/1848177469 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f20f40be650 0x7f20f4066520 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0x7f20f000b9c0 tx=0x7f20f0006e20).stop 2021-01-27T09:46:42.143 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.137+0000 7f20fb025700 1 -- 172.21.15.146:0/1848177469 >> 172.21.15.146:0/1848177469 conn(0x7f20f4069110 msgr2=0x7f20f4067e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:46:42.145 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.137+0000 7f20fb025700 1 -- 172.21.15.146:0/1848177469 shutdown_connections 2021-01-27T09:46:42.146 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.137+0000 7f20fb025700 1 -- 172.21.15.146:0/1848177469 wait complete. 2021-01-27T09:46:42.146 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.141+0000 7f20fb025700 1 Processor -- start 2021-01-27T09:46:42.146 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.141+0000 7f20fb025700 1 -- start start 2021-01-27T09:46:42.146 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.141+0000 7f20fb025700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f40be270 0x7f20f4162110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:42.147 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.141+0000 7f20fb025700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f20f40bec50 0x7f20f40b6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:42.147 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.141+0000 7f20fb025700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f414b070 0x7f20f40b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:42.147 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.141+0000 7f20fb025700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f4162600 con 0x7f20f40be270 2021-01-27T09:46:42.147 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.141+0000 7f20fb025700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f40b6ca0 con 0x7f20f414b070 2021-01-27T09:46:42.148 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.141+0000 7f20fb025700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f40b7380 con 0x7f20f40bec50 2021-01-27T09:46:42.148 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.141+0000 7f20ebfff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f20f40bec50 0x7f20f40b6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:42.148 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.141+0000 7f20ebfff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f20f40bec50 0x7f20f40b6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:37238/0 (socket says 172.21.15.146:37238) 2021-01-27T09:46:42.148 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.141+0000 7f20ebfff700 1 -- 172.21.15.146:0/3539286667 learned_addr learned my addr 172.21.15.146:0/3539286667 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:46:42.149 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.141+0000 7f20f8dc1700 1 --2- 172.21.15.146:0/3539286667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f40be270 0x7f20f4162110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:42.149 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.141+0000 7f20f95c2700 1 --2- 172.21.15.146:0/3539286667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f414b070 0x7f20f40b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:42.149 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.141+0000 7f20ebfff700 1 -- 172.21.15.146:0/3539286667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f414b070 msgr2=0x7f20f40b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:42.149 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.141+0000 7f20ebfff700 1 --2- 172.21.15.146:0/3539286667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f414b070 0x7f20f40b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:42.149 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.141+0000 7f20ebfff700 1 -- 172.21.15.146:0/3539286667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f40be270 msgr2=0x7f20f4162110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:42.150 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.141+0000 7f20ebfff700 1 --2- 172.21.15.146:0/3539286667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f40be270 0x7f20f4162110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:42.150 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.141+0000 7f20ebfff700 1 -- 172.21.15.146:0/3539286667 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f40bc430 con 0x7f20f40bec50 2021-01-27T09:46:42.150 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.141+0000 7f20f95c2700 1 --2- 172.21.15.146:0/3539286667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f414b070 0x7f20f40b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:46:42.151 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.141+0000 7f20ebfff700 1 --2- 172.21.15.146:0/3539286667 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f20f40bec50 0x7f20f40b6e90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f20f0007fd0 tx=0x7f20f0016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:42.151 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.145+0000 7f20e8ff9700 1 -- 172.21.15.146:0/3539286667 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f0011bf0 con 0x7f20f40bec50 2021-01-27T09:46:42.151 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.145+0000 7f20e8ff9700 1 -- 172.21.15.146:0/3539286667 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f0011d70 con 0x7f20f40bec50 2021-01-27T09:46:42.151 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.145+0000 7f20fb025700 1 -- 172.21.15.146:0/3539286667 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f40b64c0 con 0x7f20f40bec50 2021-01-27T09:46:42.151 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.145+0000 7f20e8ff9700 1 -- 172.21.15.146:0/3539286667 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f001c670 con 0x7f20f40bec50 2021-01-27T09:46:42.152 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.145+0000 7f20fb025700 1 -- 172.21.15.146:0/3539286667 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f40b6a00 con 0x7f20f40bec50 2021-01-27T09:46:42.153 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.145+0000 7f20fb025700 1 -- 172.21.15.146:0/3539286667 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f4044ee0 con 0x7f20f40bec50 2021-01-27T09:46:42.153 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.145+0000 7f20e8ff9700 1 -- 172.21.15.146:0/3539286667 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f20f000f070 con 0x7f20f40bec50 2021-01-27T09:46:42.153 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.145+0000 7f20e8ff9700 1 --2- 172.21.15.146:0/3539286667 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f20d40561e0 0x7f20d40586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:42.153 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.145+0000 7f20e8ff9700 1 -- 172.21.15.146:0/3539286667 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f20f0070c60 con 0x7f20f40bec50 2021-01-27T09:46:42.154 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.149+0000 7f20f8dc1700 1 --2- 172.21.15.146:0/3539286667 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f20d40561e0 0x7f20d40586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:42.154 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.149+0000 7f20f8dc1700 1 --2- 172.21.15.146:0/3539286667 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f20d40561e0 0x7f20d40586a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f20e4007fd0 tx=0x7f20e4009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:42.172 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.165+0000 7f20e8ff9700 1 -- 172.21.15.146:0/3539286667 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f20f0046200 con 0x7f20f40bec50 2021-01-27T09:46:42.505 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.505+0000 7f20fb025700 1 -- 172.21.15.146:0/3539286667 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20f40b94c0 con 0x7f20f40bec50 2021-01-27T09:46:42.506 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.505+0000 7f20e8ff9700 1 -- 172.21.15.146:0/3539286667 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3575 (secure 0 0 0) 0x7f20f0049820 con 0x7f20f40bec50 2021-01-27T09:46:42.506 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:46:42.507 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:46:16.665785+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6837/745099427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":745099427},{"type":"v1","addr":"172.21.15.146:6837","nonce":745099427}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:46:42.509 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.505+0000 7f20fb025700 1 -- 172.21.15.146:0/3539286667 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f20d40561e0 msgr2=0x7f20d40586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:42.510 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.505+0000 7f20fb025700 1 --2- 172.21.15.146:0/3539286667 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f20d40561e0 0x7f20d40586a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f20e4007fd0 tx=0x7f20e4009040).stop 2021-01-27T09:46:42.510 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.505+0000 7f20fb025700 1 -- 172.21.15.146:0/3539286667 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f20f40bec50 msgr2=0x7f20f40b6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:42.510 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.505+0000 7f20fb025700 1 --2- 172.21.15.146:0/3539286667 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f20f40bec50 0x7f20f40b6e90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f20f0007fd0 tx=0x7f20f0016000).stop 2021-01-27T09:46:42.511 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.505+0000 7f20fb025700 1 -- 172.21.15.146:0/3539286667 shutdown_connections 2021-01-27T09:46:42.511 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.505+0000 7f20fb025700 1 --2- 172.21.15.146:0/3539286667 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f20d40561e0 0x7f20d40586a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:42.512 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.505+0000 7f20fb025700 1 --2- 172.21.15.146:0/3539286667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f414b070 0x7f20f40b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:42.512 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.505+0000 7f20fb025700 1 --2- 172.21.15.146:0/3539286667 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f20f40bec50 0x7f20f40b6e90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:42.513 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.505+0000 7f20fb025700 1 --2- 172.21.15.146:0/3539286667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f40be270 0x7f20f4162110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:42.513 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.505+0000 7f20fb025700 1 -- 172.21.15.146:0/3539286667 >> 172.21.15.146:0/3539286667 conn(0x7f20f4069110 msgr2=0x7f20f4155820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:46:42.513 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.509+0000 7f20fb025700 1 -- 172.21.15.146:0/3539286667 shutdown_connections 2021-01-27T09:46:42.514 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:42.509+0000 7f20fb025700 1 -- 172.21.15.146:0/3539286667 wait complete. 2021-01-27T09:46:42.515 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 14 2021-01-27T09:46:42.534 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2021-01-27T09:46:44.535 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:46:45.046 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.045+0000 7f1015943700 1 Processor -- start 2021-01-27T09:46:45.058 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.045+0000 7f1015943700 1 -- start start 2021-01-27T09:46:45.059 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.049+0000 7f1015943700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1010143ac0 0x7f1010067500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:45.059 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.049+0000 7f1015943700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1010143ea0 0x7f1010064d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:45.059 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.049+0000 7f1015943700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f10100bd500 0x7f1010065250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:45.060 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.049+0000 7f1015943700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1010149bf0 con 0x7f1010143ac0 2021-01-27T09:46:45.060 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.049+0000 7f1015943700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1010069710 con 0x7f1010143ea0 2021-01-27T09:46:45.060 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.049+0000 7f1015943700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10100ad280 con 0x7f10100bd500 2021-01-27T09:46:45.060 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.049+0000 7f100ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1010143ea0 0x7f1010064d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:45.061 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.049+0000 7f100ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1010143ea0 0x7f1010064d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47788/0 (socket says 172.21.15.146:47788) 2021-01-27T09:46:45.061 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.049+0000 7f100ffff700 1 -- 172.21.15.146:0/4025100439 learned_addr learned my addr 172.21.15.146:0/4025100439 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:46:45.061 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.049+0000 7f100ffff700 1 -- 172.21.15.146:0/4025100439 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f10100bd500 msgr2=0x7f1010065250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:46:45.061 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.049+0000 7f100ffff700 1 --2- 172.21.15.146:0/4025100439 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f10100bd500 0x7f1010065250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:46:45.061 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.049+0000 7f100ffff700 1 -- 172.21.15.146:0/4025100439 >> v2:172.21.15.78:3300/0 conn(0x7f1010143ac0 msgr2=0x7f1010067500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:46:45.062 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.049+0000 7f100ffff700 1 --2- 172.21.15.146:0/4025100439 >> v2:172.21.15.78:3300/0 conn(0x7f1010143ac0 0x7f1010067500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:46:45.062 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.049+0000 7f100ffff700 1 -- 172.21.15.146:0/4025100439 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1010069940 con 0x7f1010143ea0 2021-01-27T09:46:45.062 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.049+0000 7f100ffff700 1 --2- 172.21.15.146:0/4025100439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1010143ea0 0x7f1010064d60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f10100bd450 tx=0x7f10080092d0).ready entity=mon.1 client_cookie=d856a77360bff049 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:45.076 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.073+0000 7f100f7fe700 1 -- 172.21.15.146:0/4025100439 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100800bc50 con 0x7f1010143ea0 2021-01-27T09:46:45.077 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.077+0000 7f100f7fe700 1 -- 172.21.15.146:0/4025100439 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100800bdb0 con 0x7f1010143ea0 2021-01-27T09:46:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.077+0000 7f100f7fe700 1 -- 172.21.15.146:0/4025100439 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008011610 con 0x7f1010143ea0 2021-01-27T09:46:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.077+0000 7f1015943700 1 -- 172.21.15.146:0/4025100439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1010143ea0 msgr2=0x7f1010064d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.077+0000 7f1015943700 1 --2- 172.21.15.146:0/4025100439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1010143ea0 0x7f1010064d60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f10100bd450 tx=0x7f10080092d0).stop 2021-01-27T09:46:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.077+0000 7f1015943700 1 -- 172.21.15.146:0/4025100439 shutdown_connections 2021-01-27T09:46:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.077+0000 7f1015943700 1 --2- 172.21.15.146:0/4025100439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1010143ea0 0x7f1010064d60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.077+0000 7f1015943700 1 --2- 172.21.15.146:0/4025100439 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f10100bd500 0x7f1010065250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:46:45.080 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.077+0000 7f1015943700 1 --2- 172.21.15.146:0/4025100439 >> v2:172.21.15.78:3300/0 conn(0x7f1010143ac0 0x7f1010067500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:46:45.080 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.077+0000 7f1015943700 1 -- 172.21.15.146:0/4025100439 >> 172.21.15.146:0/4025100439 conn(0x7f1010060a30 msgr2=0x7f1010065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:46:45.080 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.077+0000 7f1015943700 1 -- 172.21.15.146:0/4025100439 shutdown_connections 2021-01-27T09:46:45.083 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.077+0000 7f1015943700 1 -- 172.21.15.146:0/4025100439 wait complete. 2021-01-27T09:46:45.083 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.081+0000 7f1015943700 1 Processor -- start 2021-01-27T09:46:45.084 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.081+0000 7f1015943700 1 -- start start 2021-01-27T09:46:45.085 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.085+0000 7f1015943700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f10100bd500 0x7f1010154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:45.086 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.085+0000 7f1015943700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1010143ac0 0x7f1010153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:45.086 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.085+0000 7f1015943700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1010143ea0 0x7f101016dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:45.086 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.085+0000 7f100ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1010143ac0 0x7f1010153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:45.087 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.085+0000 7f100ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1010143ac0 0x7f1010153790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:50666/0 (socket says 172.21.15.146:50666) 2021-01-27T09:46:45.087 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.085+0000 7f1014941700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f10100bd500 0x7f1010154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:45.087 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.085+0000 7f1014941700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f10100bd500 0x7f1010154180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:37276/0 (socket says 172.21.15.146:37276) 2021-01-27T09:46:45.088 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.085+0000 7f1015142700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1010143ea0 0x7f101016dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:45.088 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.085+0000 7f1015142700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1010143ea0 0x7f101016dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47794/0 (socket says 172.21.15.146:47794) 2021-01-27T09:46:45.088 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.085+0000 7f100ffff700 1 -- 172.21.15.146:0/3220130646 learned_addr learned my addr 172.21.15.146:0/3220130646 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:46:45.088 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.085+0000 7f1015943700 1 -- 172.21.15.146:0/3220130646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10101466e0 con 0x7f1010143ac0 2021-01-27T09:46:45.089 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.085+0000 7f1015943700 1 -- 172.21.15.146:0/3220130646 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1010146980 con 0x7f1010143ea0 2021-01-27T09:46:45.089 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.085+0000 7f1015943700 1 -- 172.21.15.146:0/3220130646 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1010146c20 con 0x7f10100bd500 2021-01-27T09:46:45.090 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.089+0000 7f100ffff700 1 -- 172.21.15.146:0/3220130646 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f10100bd500 msgr2=0x7f1010154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:45.090 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.089+0000 7f100ffff700 1 --2- 172.21.15.146:0/3220130646 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f10100bd500 0x7f1010154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:45.090 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.089+0000 7f100ffff700 1 -- 172.21.15.146:0/3220130646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1010143ea0 msgr2=0x7f101016dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:45.090 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.089+0000 7f100ffff700 1 --2- 172.21.15.146:0/3220130646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1010143ea0 0x7f101016dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:45.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.089+0000 7f100ffff700 1 -- 172.21.15.146:0/3220130646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1010146ec0 con 0x7f1010143ac0 2021-01-27T09:46:45.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.089+0000 7f1015142700 1 --2- 172.21.15.146:0/3220130646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1010143ea0 0x7f101016dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:46:45.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.089+0000 7f100ffff700 1 --2- 172.21.15.146:0/3220130646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1010143ac0 0x7f1010153790 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f10100ba850 tx=0x7f1008017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:45.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.089+0000 7f100cff9700 1 -- 172.21.15.146:0/3220130646 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100801b650 con 0x7f1010143ac0 2021-01-27T09:46:45.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.089+0000 7f100cff9700 1 -- 172.21.15.146:0/3220130646 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100801b7b0 con 0x7f1010143ac0 2021-01-27T09:46:45.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.089+0000 7f100cff9700 1 -- 172.21.15.146:0/3220130646 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100801bb50 con 0x7f1010143ac0 2021-01-27T09:46:45.093 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.089+0000 7f1015943700 1 -- 172.21.15.146:0/3220130646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1010147160 con 0x7f1010143ac0 2021-01-27T09:46:45.093 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.089+0000 7f1015943700 1 -- 172.21.15.146:0/3220130646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1010146330 con 0x7f1010143ac0 2021-01-27T09:46:45.094 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.093+0000 7f100cff9700 1 -- 172.21.15.146:0/3220130646 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f100800f070 con 0x7f1010143ac0 2021-01-27T09:46:45.095 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.093+0000 7f100cff9700 1 --2- 172.21.15.146:0/3220130646 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0ff0056200 0x7f0ff00586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:45.095 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.093+0000 7f100cff9700 1 -- 172.21.15.146:0/3220130646 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f1008071100 con 0x7f1010143ac0 2021-01-27T09:46:45.096 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.093+0000 7f1014941700 1 --2- 172.21.15.146:0/3220130646 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0ff0056200 0x7f0ff00586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:45.097 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.097+0000 7f1014941700 1 --2- 172.21.15.146:0/3220130646 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0ff0056200 0x7f0ff00586c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f1000006fd0 tx=0x7f1000008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:45.111 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.109+0000 7f1015943700 1 -- 172.21.15.146:0/3220130646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe8004fa0 con 0x7f1010143ac0 2021-01-27T09:46:45.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.117+0000 7f100cff9700 1 -- 172.21.15.146:0/3220130646 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f1008046870 con 0x7f1010143ac0 2021-01-27T09:46:45.498 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.497+0000 7f1015943700 1 -- 172.21.15.146:0/3220130646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0fe80057d0 con 0x7f1010143ac0 2021-01-27T09:46:45.498 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.497+0000 7f100cff9700 1 -- 172.21.15.146:0/3220130646 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3575 (secure 0 0 0) 0x7f1008049e90 con 0x7f1010143ac0 2021-01-27T09:46:45.499 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:46:45.499 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:46:16.665785+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6837/745099427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":745099427},{"type":"v1","addr":"172.21.15.146:6837","nonce":745099427}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:46:45.501 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.501+0000 7f1015943700 1 -- 172.21.15.146:0/3220130646 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0ff0056200 msgr2=0x7f0ff00586c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:45.501 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.501+0000 7f1015943700 1 --2- 172.21.15.146:0/3220130646 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0ff0056200 0x7f0ff00586c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f1000006fd0 tx=0x7f1000008040).stop 2021-01-27T09:46:45.501 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.501+0000 7f1015943700 1 -- 172.21.15.146:0/3220130646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1010143ac0 msgr2=0x7f1010153790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:45.502 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.501+0000 7f1015943700 1 --2- 172.21.15.146:0/3220130646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1010143ac0 0x7f1010153790 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f10100ba850 tx=0x7f1008017000).stop 2021-01-27T09:46:45.502 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.501+0000 7f1015943700 1 -- 172.21.15.146:0/3220130646 shutdown_connections 2021-01-27T09:46:45.502 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.501+0000 7f1015943700 1 --2- 172.21.15.146:0/3220130646 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0ff0056200 0x7f0ff00586c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:45.502 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.501+0000 7f1015943700 1 --2- 172.21.15.146:0/3220130646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1010143ea0 0x7f101016dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:45.503 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.501+0000 7f1015943700 1 --2- 172.21.15.146:0/3220130646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1010143ac0 0x7f1010153790 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:45.503 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.501+0000 7f1015943700 1 --2- 172.21.15.146:0/3220130646 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f10100bd500 0x7f1010154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:45.503 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.501+0000 7f1015943700 1 -- 172.21.15.146:0/3220130646 >> 172.21.15.146:0/3220130646 conn(0x7f1010060a30 msgr2=0x7f1010064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:46:45.504 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.501+0000 7f1015943700 1 -- 172.21.15.146:0/3220130646 shutdown_connections 2021-01-27T09:46:45.504 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:45.501+0000 7f1015943700 1 -- 172.21.15.146:0/3220130646 wait complete. 2021-01-27T09:46:45.504 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 14 2021-01-27T09:46:45.531 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2021-01-27T09:46:47.532 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:46:47.995 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:47.989+0000 7fbc49033700 1 Processor -- start 2021-01-27T09:46:47.996 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:47.989+0000 7fbc49033700 1 -- start start 2021-01-27T09:46:47.996 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:47.989+0000 7fbc49033700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbc440692b0 0x7fbc440acf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:47.996 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:47.989+0000 7fbc49033700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbc44069690 0x7fbc44067360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:47.997 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:47.989+0000 7fbc49033700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc44060020 con 0x7fbc440606f0 2021-01-27T09:46:48.000 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:47.989+0000 7fbc49033700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc440ae910 con 0x7fbc440692b0 2021-01-27T09:46:48.001 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:47.989+0000 7fbc49033700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc440aebb0 con 0x7fbc44069690 2021-01-27T09:46:48.001 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:47.993+0000 7fbc4259c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbc44069690 0x7fbc44067360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:48.001 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:47.993+0000 7fbc4259c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbc44069690 0x7fbc44067360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:37318/0 (socket says 172.21.15.146:37318) 2021-01-27T09:46:48.001 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:47.993+0000 7fbc4259c700 1 -- 172.21.15.146:0/1956805563 learned_addr learned my addr 172.21.15.146:0/1956805563 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:46:48.003 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:47.993+0000 7fbc42d9d700 1 --2- 172.21.15.146:0/1956805563 >> v2:172.21.15.78:3300/0 conn(0x7fbc440692b0 0x7fbc440acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:48.004 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:47.993+0000 7fbc4259c700 1 -- 172.21.15.146:0/1956805563 >> v2:172.21.15.78:3300/0 conn(0x7fbc440692b0 msgr2=0x7fbc440acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:46:48.004 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:47.993+0000 7fbc4259c700 1 --2- 172.21.15.146:0/1956805563 >> v2:172.21.15.78:3300/0 conn(0x7fbc440692b0 0x7fbc440acf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:48.004 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:47.993+0000 7fbc4259c700 1 -- 172.21.15.146:0/1956805563 >> v1:172.21.15.78:6789/0 conn(0x7fbc440606f0 legacy=0x7fbc4414bbf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-01-27T09:46:48.004 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:47.993+0000 7fbc4259c700 1 -- 172.21.15.146:0/1956805563 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc440aee50 con 0x7fbc44069690 2021-01-27T09:46:48.005 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:47.993+0000 7fbc4259c700 1 --2- 172.21.15.146:0/1956805563 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbc44069690 0x7fbc44067360 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fbc3c009d80 tx=0x7fbc3c009270).ready entity=mon.2 client_cookie=67d83aa4aa84d3d0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:48.005 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:47.993+0000 7fbc41d9b700 1 -- 172.21.15.146:0/1956805563 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c00bbb0 con 0x7fbc44069690 2021-01-27T09:46:48.005 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:47.993+0000 7fbc41d9b700 1 -- 172.21.15.146:0/1956805563 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3c00bd10 con 0x7fbc44069690 2021-01-27T09:46:48.006 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:47.997+0000 7fbc49033700 1 -- 172.21.15.146:0/1956805563 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbc44069690 msgr2=0x7fbc44067360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:48.006 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:47.997+0000 7fbc49033700 1 --2- 172.21.15.146:0/1956805563 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbc44069690 0x7fbc44067360 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fbc3c009d80 tx=0x7fbc3c009270).stop 2021-01-27T09:46:48.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.013+0000 7fbc49033700 1 -- 172.21.15.146:0/1956805563 shutdown_connections 2021-01-27T09:46:48.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.013+0000 7fbc49033700 1 --2- 172.21.15.146:0/1956805563 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbc44069690 0x7fbc44067360 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:48.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.013+0000 7fbc49033700 1 --2- 172.21.15.146:0/1956805563 >> v2:172.21.15.78:3300/0 conn(0x7fbc440692b0 0x7fbc440acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:48.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.013+0000 7fbc49033700 1 -- 172.21.15.146:0/1956805563 >> 172.21.15.146:0/1956805563 conn(0x7fbc44065f60 msgr2=0x7fbc44067ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:46:48.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.017+0000 7fbc49033700 1 -- 172.21.15.146:0/1956805563 shutdown_connections 2021-01-27T09:46:48.019 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.017+0000 7fbc49033700 1 -- 172.21.15.146:0/1956805563 wait complete. 2021-01-27T09:46:48.019 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.017+0000 7fbc49033700 1 Processor -- start 2021-01-27T09:46:48.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.017+0000 7fbc49033700 1 -- start start 2021-01-27T09:46:48.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.021+0000 7fbc49033700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbc440606f0 0x7fbc441348d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:48.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.021+0000 7fbc49033700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc440692b0 0x7fbc441396b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:48.023 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.021+0000 7fbc42d9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbc440606f0 0x7fbc441348d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:48.023 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.021+0000 7fbc42d9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbc440606f0 0x7fbc441348d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:37324/0 (socket says 172.21.15.146:37324) 2021-01-27T09:46:48.023 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.021+0000 7fbc4259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc440692b0 0x7fbc441396b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:48.023 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.021+0000 7fbc4259c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc440692b0 0x7fbc441396b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:50714/0 (socket says 172.21.15.146:50714) 2021-01-27T09:46:48.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.021+0000 7fbc49033700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc44069690 0x7fbc44155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:48.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.021+0000 7fbc4359e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc44069690 0x7fbc44155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:48.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.021+0000 7fbc4359e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc44069690 0x7fbc44155600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47842/0 (socket says 172.21.15.146:47842) 2021-01-27T09:46:48.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.021+0000 7fbc4259c700 1 -- 172.21.15.146:0/478682255 learned_addr learned my addr 172.21.15.146:0/478682255 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:46:48.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.025+0000 7fbc49033700 1 -- 172.21.15.146:0/478682255 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4412e430 con 0x7fbc440692b0 2021-01-27T09:46:48.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.025+0000 7fbc49033700 1 -- 172.21.15.146:0/478682255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4414d4e0 con 0x7fbc44069690 2021-01-27T09:46:48.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.025+0000 7fbc49033700 1 -- 172.21.15.146:0/478682255 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4414cd00 con 0x7fbc440606f0 2021-01-27T09:46:48.026 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.025+0000 7fbc4259c700 1 -- 172.21.15.146:0/478682255 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbc440606f0 msgr2=0x7fbc441348d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:48.026 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.025+0000 7fbc4259c700 1 --2- 172.21.15.146:0/478682255 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbc440606f0 0x7fbc441348d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:48.027 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.025+0000 7fbc4259c700 1 -- 172.21.15.146:0/478682255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc44069690 msgr2=0x7fbc44155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:48.027 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.025+0000 7fbc4259c700 1 --2- 172.21.15.146:0/478682255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc44069690 0x7fbc44155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:48.027 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.025+0000 7fbc4259c700 1 -- 172.21.15.146:0/478682255 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4414cfa0 con 0x7fbc440692b0 2021-01-27T09:46:48.027 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.025+0000 7fbc4259c700 1 --2- 172.21.15.146:0/478682255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc440692b0 0x7fbc441396b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fbc3c0092b0 tx=0x7fbc3c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:48.028 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.025+0000 7fbc2affd700 1 -- 172.21.15.146:0/478682255 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c011440 con 0x7fbc440692b0 2021-01-27T09:46:48.028 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.025+0000 7fbc49033700 1 -- 172.21.15.146:0/478682255 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4414d240 con 0x7fbc440692b0 2021-01-27T09:46:48.029 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.025+0000 7fbc49033700 1 -- 172.21.15.146:0/478682255 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc44139210 con 0x7fbc440692b0 2021-01-27T09:46:48.031 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.029+0000 7fbc2affd700 1 -- 172.21.15.146:0/478682255 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3c0115a0 con 0x7fbc440692b0 2021-01-27T09:46:48.031 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.029+0000 7fbc2affd700 1 -- 172.21.15.146:0/478682255 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c011920 con 0x7fbc440692b0 2021-01-27T09:46:48.031 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.029+0000 7fbc2affd700 1 -- 172.21.15.146:0/478682255 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fbc3c02a070 con 0x7fbc440692b0 2021-01-27T09:46:48.032 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.033+0000 7fbc2affd700 1 --2- 172.21.15.146:0/478682255 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbc24056280 0x7fbc24058740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:48.033 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.033+0000 7fbc2affd700 1 -- 172.21.15.146:0/478682255 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fbc3c070e20 con 0x7fbc440692b0 2021-01-27T09:46:48.034 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.033+0000 7fbc42d9d700 1 --2- 172.21.15.146:0/478682255 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbc24056280 0x7fbc24058740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:48.035 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.033+0000 7fbc42d9d700 1 --2- 172.21.15.146:0/478682255 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbc24056280 0x7fbc24058740 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fbc38006fd0 tx=0x7fbc38008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:48.036 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.033+0000 7fbc49033700 1 -- 172.21.15.146:0/478682255 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc1c004fa0 con 0x7fbc440692b0 2021-01-27T09:46:48.047 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.045+0000 7fbc2affd700 1 -- 172.21.15.146:0/478682255 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fbc3c046490 con 0x7fbc440692b0 2021-01-27T09:46:48.491 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.489+0000 7fbc49033700 1 -- 172.21.15.146:0/478682255 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc1c0057d0 con 0x7fbc440692b0 2021-01-27T09:46:48.492 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.493+0000 7fbc2affd700 1 -- 172.21.15.146:0/478682255 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3575 (secure 0 0 0) 0x7fbc3c049ab0 con 0x7fbc440692b0 2021-01-27T09:46:48.493 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:46:48.493 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:46:16.665785+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6837/745099427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":745099427},{"type":"v1","addr":"172.21.15.146:6837","nonce":745099427}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:46:48.499 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.497+0000 7fbc49033700 1 -- 172.21.15.146:0/478682255 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbc24056280 msgr2=0x7fbc24058740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:48.499 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.497+0000 7fbc49033700 1 --2- 172.21.15.146:0/478682255 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbc24056280 0x7fbc24058740 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fbc38006fd0 tx=0x7fbc38008040).stop 2021-01-27T09:46:48.500 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.497+0000 7fbc49033700 1 -- 172.21.15.146:0/478682255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc440692b0 msgr2=0x7fbc441396b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:48.500 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.497+0000 7fbc49033700 1 --2- 172.21.15.146:0/478682255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc440692b0 0x7fbc441396b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fbc3c0092b0 tx=0x7fbc3c016000).stop 2021-01-27T09:46:48.501 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.497+0000 7fbc49033700 1 -- 172.21.15.146:0/478682255 shutdown_connections 2021-01-27T09:46:48.501 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.497+0000 7fbc49033700 1 --2- 172.21.15.146:0/478682255 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbc24056280 0x7fbc24058740 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:48.501 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.497+0000 7fbc49033700 1 --2- 172.21.15.146:0/478682255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc44069690 0x7fbc44155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:48.501 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.497+0000 7fbc49033700 1 --2- 172.21.15.146:0/478682255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc440692b0 0x7fbc441396b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:48.502 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.497+0000 7fbc49033700 1 --2- 172.21.15.146:0/478682255 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbc440606f0 0x7fbc441348d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:48.502 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.497+0000 7fbc49033700 1 -- 172.21.15.146:0/478682255 >> 172.21.15.146:0/478682255 conn(0x7fbc44065f60 msgr2=0x7fbc44067ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:46:48.502 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.497+0000 7fbc49033700 1 -- 172.21.15.146:0/478682255 shutdown_connections 2021-01-27T09:46:48.502 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:48.497+0000 7fbc49033700 1 -- 172.21.15.146:0/478682255 wait complete. 2021-01-27T09:46:48.512 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 14 2021-01-27T09:46:48.548 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2021-01-27T09:46:50.550 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:46:50.713 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.713+0000 7fdc35f88700 1 Processor -- start 2021-01-27T09:46:50.713 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.713+0000 7fdc35f88700 1 -- start start 2021-01-27T09:46:50.714 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.713+0000 7fdc35f88700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdc300692b0 0x7fdc3014b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:50.715 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.713+0000 7fdc35f88700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc30069690 0x7fdc301443f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:50.715 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.713+0000 7fdc35f88700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc300afa20 con 0x7fdc300af550 2021-01-27T09:46:50.715 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.713+0000 7fdc35f88700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc3014b770 con 0x7fdc300692b0 2021-01-27T09:46:50.715 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.713+0000 7fdc35f88700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc300be1b0 con 0x7fdc30069690 2021-01-27T09:46:50.716 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.713+0000 7fdc35787700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc30069690 0x7fdc301443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:50.716 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.713+0000 7fdc2ffff700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fdc300af550 0x7fdc300bcbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:35496/0 (socket says 172.21.15.146:35496) 2021-01-27T09:46:50.716 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.713+0000 7fdc2ffff700 1 -- 172.21.15.146:0/2071831701 learned_addr learned my addr 172.21.15.146:0/2071831701 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:46:50.716 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.713+0000 7fdc34f86700 1 --2- 172.21.15.146:0/2071831701 >> v2:172.21.15.78:3300/0 conn(0x7fdc300692b0 0x7fdc3014b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:50.718 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.713+0000 7fdc2f7fe700 1 -- 172.21.15.146:0/2071831701 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659209064 0 0) 0x7fdc300afa20 con 0x7fdc300af550 2021-01-27T09:46:50.718 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.713+0000 7fdc2f7fe700 1 -- 172.21.15.146:0/2071831701 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc14003270 con 0x7fdc300af550 2021-01-27T09:46:50.719 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.713+0000 7fdc34f86700 1 -- 172.21.15.146:0/2071831701 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc30069690 msgr2=0x7fdc301443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:46:50.719 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.713+0000 7fdc34f86700 1 --2- 172.21.15.146:0/2071831701 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc30069690 0x7fdc301443f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:50.719 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.713+0000 7fdc34f86700 1 -- 172.21.15.146:0/2071831701 >> v1:172.21.15.78:6789/0 conn(0x7fdc300af550 legacy=0x7fdc300bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:50.719 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.713+0000 7fdc34f86700 1 -- 172.21.15.146:0/2071831701 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc300be450 con 0x7fdc300692b0 2021-01-27T09:46:50.719 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.717+0000 7fdc34f86700 1 --2- 172.21.15.146:0/2071831701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc300692b0 0x7fdc3014b280 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fdc2400b9c0 tx=0x7fdc24006e20).ready entity=mon.0 client_cookie=202f86401f7032d0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:50.720 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.717+0000 7fdc2f7fe700 1 -- 172.21.15.146:0/2071831701 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc24009600 con 0x7fdc300692b0 2021-01-27T09:46:50.720 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.717+0000 7fdc2f7fe700 1 -- 172.21.15.146:0/2071831701 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc24009760 con 0x7fdc300692b0 2021-01-27T09:46:50.720 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.717+0000 7fdc2f7fe700 1 -- 172.21.15.146:0/2071831701 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc24009ae0 con 0x7fdc300692b0 2021-01-27T09:46:50.720 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.717+0000 7fdc35f88700 1 -- 172.21.15.146:0/2071831701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc300692b0 msgr2=0x7fdc3014b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:50.721 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.717+0000 7fdc35f88700 1 --2- 172.21.15.146:0/2071831701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc300692b0 0x7fdc3014b280 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fdc2400b9c0 tx=0x7fdc24006e20).stop 2021-01-27T09:46:50.721 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.717+0000 7fdc35f88700 1 -- 172.21.15.146:0/2071831701 shutdown_connections 2021-01-27T09:46:50.721 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.717+0000 7fdc35f88700 1 --2- 172.21.15.146:0/2071831701 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc30069690 0x7fdc301443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:50.721 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.717+0000 7fdc35f88700 1 --2- 172.21.15.146:0/2071831701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc300692b0 0x7fdc3014b280 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:50.722 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.717+0000 7fdc35f88700 1 -- 172.21.15.146:0/2071831701 >> 172.21.15.146:0/2071831701 conn(0x7fdc30064240 msgr2=0x7fdc300601f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:46:50.722 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.717+0000 7fdc35f88700 1 -- 172.21.15.146:0/2071831701 shutdown_connections 2021-01-27T09:46:50.722 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.717+0000 7fdc35f88700 1 -- 172.21.15.146:0/2071831701 wait complete. 2021-01-27T09:46:50.724 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.717+0000 7fdc35f88700 1 Processor -- start 2021-01-27T09:46:50.724 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.717+0000 7fdc35f88700 1 -- start start 2021-01-27T09:46:50.724 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.721+0000 7fdc35f88700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc30069690 0x7fdc30159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:50.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.721+0000 7fdc35f88700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc300af550 0x7fdc300bc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:50.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.721+0000 7fdc35f88700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc300b5910 0x7fdc300b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:50.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.721+0000 7fdc35f88700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc30159550 con 0x7fdc300b5910 2021-01-27T09:46:50.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.721+0000 7fdc35f88700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc30159760 con 0x7fdc300af550 2021-01-27T09:46:50.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.721+0000 7fdc35f88700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc30159a00 con 0x7fdc30069690 2021-01-27T09:46:50.726 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.721+0000 7fdc34f86700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc30069690 0x7fdc30159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:50.726 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.721+0000 7fdc34f86700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc30069690 0x7fdc30159060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:37380/0 (socket says 172.21.15.146:37380) 2021-01-27T09:46:50.726 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.721+0000 7fdc34f86700 1 -- 172.21.15.146:0/1134133309 learned_addr learned my addr 172.21.15.146:0/1134133309 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:46:50.726 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.721+0000 7fdc2ffff700 1 --2- 172.21.15.146:0/1134133309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc300af550 0x7fdc300bc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:50.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.721+0000 7fdc34f86700 1 -- 172.21.15.146:0/1134133309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc300af550 msgr2=0x7fdc300bc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:50.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.721+0000 7fdc34f86700 1 --2- 172.21.15.146:0/1134133309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc300af550 0x7fdc300bc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:50.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.721+0000 7fdc34f86700 1 -- 172.21.15.146:0/1134133309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc300b5910 msgr2=0x7fdc300b5d70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-27T09:46:50.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.721+0000 7fdc34f86700 1 --2- 172.21.15.146:0/1134133309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc300b5910 0x7fdc300b5d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:46:50.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.721+0000 7fdc34f86700 1 -- 172.21.15.146:0/1134133309 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc30159ca0 con 0x7fdc30069690 2021-01-27T09:46:50.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.721+0000 7fdc34f86700 1 --2- 172.21.15.146:0/1134133309 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc30069690 0x7fdc30159060 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fdc24006e60 tx=0x7fdc24016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:50.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.721+0000 7fdc2cff9700 1 -- 172.21.15.146:0/1134133309 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc24020070 con 0x7fdc30069690 2021-01-27T09:46:50.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.721+0000 7fdc2cff9700 1 -- 172.21.15.146:0/1134133309 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc24011bf0 con 0x7fdc30069690 2021-01-27T09:46:50.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.721+0000 7fdc35f88700 1 -- 172.21.15.146:0/1134133309 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc30159f40 con 0x7fdc30069690 2021-01-27T09:46:50.729 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.721+0000 7fdc2cff9700 1 -- 172.21.15.146:0/1134133309 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2401c420 con 0x7fdc30069690 2021-01-27T09:46:50.729 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.721+0000 7fdc35f88700 1 -- 172.21.15.146:0/1134133309 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc300b0000 con 0x7fdc30069690 2021-01-27T09:46:50.729 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.721+0000 7fdc35f88700 1 -- 172.21.15.146:0/1134133309 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc30063d90 con 0x7fdc30069690 2021-01-27T09:46:50.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.725+0000 7fdc2cff9700 1 -- 172.21.15.146:0/1134133309 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fdc2400f070 con 0x7fdc30069690 2021-01-27T09:46:50.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.725+0000 7fdc2cff9700 1 --2- 172.21.15.146:0/1134133309 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fdc100561b0 0x7fdc10058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:50.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.725+0000 7fdc2cff9700 1 -- 172.21.15.146:0/1134133309 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7fdc24070780 con 0x7fdc30069690 2021-01-27T09:46:50.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.725+0000 7fdc2ffff700 1 --2- 172.21.15.146:0/1134133309 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fdc100561b0 0x7fdc10058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:50.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.725+0000 7fdc2ffff700 1 --2- 172.21.15.146:0/1134133309 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fdc100561b0 0x7fdc10058670 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fdc30149c40 tx=0x7fdc1c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:50.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.737+0000 7fdc2cff9700 1 -- 172.21.15.146:0/1134133309 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fdc24045d20 con 0x7fdc30069690 2021-01-27T09:46:50.905 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.905+0000 7fdc35f88700 1 -- 172.21.15.146:0/1134133309 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc30044680 con 0x7fdc30069690 2021-01-27T09:46:50.906 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.905+0000 7fdc2cff9700 1 -- 172.21.15.146:0/1134133309 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3575 (secure 0 0 0) 0x7fdc240069b0 con 0x7fdc30069690 2021-01-27T09:46:50.907 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:46:50.908 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:46:16.665785+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6837/745099427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":745099427},{"type":"v1","addr":"172.21.15.146:6837","nonce":745099427}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:46:50.910 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.909+0000 7fdc35f88700 1 -- 172.21.15.146:0/1134133309 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fdc100561b0 msgr2=0x7fdc10058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:50.911 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.909+0000 7fdc35f88700 1 --2- 172.21.15.146:0/1134133309 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fdc100561b0 0x7fdc10058670 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fdc30149c40 tx=0x7fdc1c009040).stop 2021-01-27T09:46:50.911 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.909+0000 7fdc35f88700 1 -- 172.21.15.146:0/1134133309 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc30069690 msgr2=0x7fdc30159060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:50.911 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.909+0000 7fdc35f88700 1 --2- 172.21.15.146:0/1134133309 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc30069690 0x7fdc30159060 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fdc24006e60 tx=0x7fdc24016000).stop 2021-01-27T09:46:50.911 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.909+0000 7fdc35f88700 1 -- 172.21.15.146:0/1134133309 shutdown_connections 2021-01-27T09:46:50.911 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.909+0000 7fdc35f88700 1 --2- 172.21.15.146:0/1134133309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc300b5910 0x7fdc300b5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:46:50.912 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.909+0000 7fdc35f88700 1 --2- 172.21.15.146:0/1134133309 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fdc100561b0 0x7fdc10058670 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:50.912 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.909+0000 7fdc35f88700 1 --2- 172.21.15.146:0/1134133309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc300af550 0x7fdc300bc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:50.912 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.909+0000 7fdc35f88700 1 --2- 172.21.15.146:0/1134133309 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdc30069690 0x7fdc30159060 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:50.912 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.909+0000 7fdc35f88700 1 -- 172.21.15.146:0/1134133309 >> 172.21.15.146:0/1134133309 conn(0x7fdc30064240 msgr2=0x7fdc301486e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:46:50.912 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.909+0000 7fdc35f88700 1 -- 172.21.15.146:0/1134133309 shutdown_connections 2021-01-27T09:46:50.913 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:50.909+0000 7fdc35f88700 1 -- 172.21.15.146:0/1134133309 wait complete. 2021-01-27T09:46:50.913 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 14 2021-01-27T09:46:50.935 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2021-01-27T09:46:52.936 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:46:53.097 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.097+0000 7f29ea0e2700 1 Processor -- start 2021-01-27T09:46:53.098 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.097+0000 7f29ea0e2700 1 -- start start 2021-01-27T09:46:53.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.097+0000 7f29ea0e2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f29e40672b0 0x7f29e414dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:53.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.097+0000 7f29ea0e2700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e41513e0 con 0x7f29e4147f10 2021-01-27T09:46:53.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.097+0000 7f29ea0e2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e4151680 con 0x7f29e4147b30 2021-01-27T09:46:53.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.097+0000 7f29ea0e2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e40be8a0 con 0x7f29e40672b0 2021-01-27T09:46:53.100 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.097+0000 7f29e98e1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f29e40672b0 0x7f29e414dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:53.100 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.097+0000 7f29e90e0700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f29e4147b30 0x7f29e4062810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47474/0 (socket says 172.21.15.146:47474) 2021-01-27T09:46:53.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.097+0000 7f29e88df700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f29e4147f10 0x7f29e4064d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:35506/0 (socket says 172.21.15.146:35506) 2021-01-27T09:46:53.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.097+0000 7f29e90e0700 1 -- 172.21.15.146:0/3864831077 learned_addr learned my addr 172.21.15.146:0/3864831077 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:46:53.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.101+0000 7f29e98e1700 1 -- 172.21.15.146:0/3864831077 >> v1:172.21.15.146:6789/0 conn(0x7f29e4147b30 legacy=0x7f29e4062810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:53.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.101+0000 7f29e98e1700 1 -- 172.21.15.146:0/3864831077 >> v1:172.21.15.78:6789/0 conn(0x7f29e4147f10 legacy=0x7f29e4064d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:53.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.101+0000 7f29e98e1700 1 -- 172.21.15.146:0/3864831077 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e4151920 con 0x7f29e40672b0 2021-01-27T09:46:53.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.101+0000 7f29e98e1700 1 --2- 172.21.15.146:0/3864831077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e40672b0 0x7f29e414dfa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f29dc009cc0 tx=0x7f29dc009220).ready entity=mon.1 client_cookie=709b6bfb1530634e server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:53.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.101+0000 7f29d3fff700 1 -- 172.21.15.146:0/3864831077 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc00bbf0 con 0x7f29e40672b0 2021-01-27T09:46:53.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.101+0000 7f29d3fff700 1 -- 172.21.15.146:0/3864831077 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29dc00bd50 con 0x7f29e40672b0 2021-01-27T09:46:53.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.101+0000 7f29d3fff700 1 -- 172.21.15.146:0/3864831077 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc011610 con 0x7f29e40672b0 2021-01-27T09:46:53.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.101+0000 7f29ea0e2700 1 -- 172.21.15.146:0/3864831077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e40672b0 msgr2=0x7f29e414dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:53.104 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.101+0000 7f29ea0e2700 1 --2- 172.21.15.146:0/3864831077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e40672b0 0x7f29e414dfa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f29dc009cc0 tx=0x7f29dc009220).stop 2021-01-27T09:46:53.104 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.101+0000 7f29ea0e2700 1 -- 172.21.15.146:0/3864831077 shutdown_connections 2021-01-27T09:46:53.104 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.101+0000 7f29ea0e2700 1 --2- 172.21.15.146:0/3864831077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e40672b0 0x7f29e414dfa0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:53.104 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.101+0000 7f29ea0e2700 1 -- 172.21.15.146:0/3864831077 >> 172.21.15.146:0/3864831077 conn(0x7f29e4067d30 msgr2=0x7f29e4068110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:46:53.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.101+0000 7f29ea0e2700 1 -- 172.21.15.146:0/3864831077 shutdown_connections 2021-01-27T09:46:53.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.101+0000 7f29ea0e2700 1 -- 172.21.15.146:0/3864831077 wait complete. 2021-01-27T09:46:53.106 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.105+0000 7f29ea0e2700 1 Processor -- start 2021-01-27T09:46:53.106 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.105+0000 7f29ea0e2700 1 -- start start 2021-01-27T09:46:53.108 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.105+0000 7f29ea0e2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29e40672b0 0x7f29e414a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:53.108 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.105+0000 7f29ea0e2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e4147b30 0x7f29e4149320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:53.108 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.105+0000 7f29ea0e2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e4147f10 0x7f29e4149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:53.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.105+0000 7f29ea0e2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e414a580 con 0x7f29e4147f10 2021-01-27T09:46:53.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.105+0000 7f29ea0e2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e40b1a90 con 0x7f29e4147b30 2021-01-27T09:46:53.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.105+0000 7f29ea0e2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e414a7d0 con 0x7f29e40672b0 2021-01-27T09:46:53.111 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.109+0000 7f29e88df700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e4147b30 0x7f29e4149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:53.112 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.109+0000 7f29e90e0700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29e40672b0 0x7f29e414a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:53.112 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.109+0000 7f29e88df700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e4147b30 0x7f29e4149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47908/0 (socket says 172.21.15.146:47908) 2021-01-27T09:46:53.112 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.109+0000 7f29e88df700 1 -- 172.21.15.146:0/3457253367 learned_addr learned my addr 172.21.15.146:0/3457253367 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:46:53.112 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.109+0000 7f29e98e1700 1 --2- 172.21.15.146:0/3457253367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e4147f10 0x7f29e4149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:53.112 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.109+0000 7f29e88df700 1 -- 172.21.15.146:0/3457253367 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29e40672b0 msgr2=0x7f29e414a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:53.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.109+0000 7f29e88df700 1 --2- 172.21.15.146:0/3457253367 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29e40672b0 0x7f29e414a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:53.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.109+0000 7f29e88df700 1 -- 172.21.15.146:0/3457253367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e4147f10 msgr2=0x7f29e4149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:53.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.109+0000 7f29e88df700 1 --2- 172.21.15.146:0/3457253367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e4147f10 0x7f29e4149810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:53.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.109+0000 7f29e88df700 1 -- 172.21.15.146:0/3457253367 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e40b1cf0 con 0x7f29e4147b30 2021-01-27T09:46:53.114 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.109+0000 7f29e88df700 1 --2- 172.21.15.146:0/3457253367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e4147b30 0x7f29e4149320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f29d400c740 tx=0x7f29d4007c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:53.114 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.109+0000 7f29d17fa700 1 -- 172.21.15.146:0/3457253367 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d40072e0 con 0x7f29e4147b30 2021-01-27T09:46:53.114 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.109+0000 7f29d17fa700 1 -- 172.21.15.146:0/3457253367 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d4007440 con 0x7f29e4147b30 2021-01-27T09:46:53.114 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.109+0000 7f29ea0e2700 1 -- 172.21.15.146:0/3457253367 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e40b1f90 con 0x7f29e4147b30 2021-01-27T09:46:53.114 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.109+0000 7f29d17fa700 1 -- 172.21.15.146:0/3457253367 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4005770 con 0x7f29e4147b30 2021-01-27T09:46:53.115 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.109+0000 7f29ea0e2700 1 -- 172.21.15.146:0/3457253367 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e414aeb0 con 0x7f29e4147b30 2021-01-27T09:46:53.115 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.109+0000 7f29ea0e2700 1 -- 172.21.15.146:0/3457253367 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e40b2170 con 0x7f29e4147b30 2021-01-27T09:46:53.116 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.113+0000 7f29d17fa700 1 -- 172.21.15.146:0/3457253367 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f29d401a060 con 0x7f29e4147b30 2021-01-27T09:46:53.116 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.113+0000 7f29d17fa700 1 --2- 172.21.15.146:0/3457253367 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f29c40561e0 0x7f29c40586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:53.116 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.113+0000 7f29d17fa700 1 -- 172.21.15.146:0/3457253367 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f29d406ed30 con 0x7f29e4147b30 2021-01-27T09:46:53.116 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.113+0000 7f29e90e0700 1 --2- 172.21.15.146:0/3457253367 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f29c40561e0 0x7f29c40586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:53.117 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.117+0000 7f29e90e0700 1 --2- 172.21.15.146:0/3457253367 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f29c40561e0 0x7f29c40586a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f29e0004610 tx=0x7f29e0007bb0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:53.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.117+0000 7f29d17fa700 1 -- 172.21.15.146:0/3457253367 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f29d40442d0 con 0x7f29e4147b30 2021-01-27T09:46:53.281 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.281+0000 7f29ea0e2700 1 -- 172.21.15.146:0/3457253367 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29e4044ee0 con 0x7f29e4147b30 2021-01-27T09:46:53.282 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.281+0000 7f29d17fa700 1 -- 172.21.15.146:0/3457253367 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3575 (secure 0 0 0) 0x7f29d4018030 con 0x7f29e4147b30 2021-01-27T09:46:53.282 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:46:53.282 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:46:16.665785+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6837/745099427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":745099427},{"type":"v1","addr":"172.21.15.146:6837","nonce":745099427}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:46:53.284 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.285+0000 7f29ea0e2700 1 -- 172.21.15.146:0/3457253367 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f29c40561e0 msgr2=0x7f29c40586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:53.284 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.285+0000 7f29ea0e2700 1 --2- 172.21.15.146:0/3457253367 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f29c40561e0 0x7f29c40586a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f29e0004610 tx=0x7f29e0007bb0).stop 2021-01-27T09:46:53.285 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.285+0000 7f29ea0e2700 1 -- 172.21.15.146:0/3457253367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e4147b30 msgr2=0x7f29e4149320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:53.285 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.285+0000 7f29ea0e2700 1 --2- 172.21.15.146:0/3457253367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e4147b30 0x7f29e4149320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f29d400c740 tx=0x7f29d4007c70).stop 2021-01-27T09:46:53.286 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.285+0000 7f29ea0e2700 1 -- 172.21.15.146:0/3457253367 shutdown_connections 2021-01-27T09:46:53.286 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.285+0000 7f29ea0e2700 1 --2- 172.21.15.146:0/3457253367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e4147f10 0x7f29e4149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:53.286 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.285+0000 7f29ea0e2700 1 --2- 172.21.15.146:0/3457253367 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f29c40561e0 0x7f29c40586a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:53.287 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.285+0000 7f29ea0e2700 1 --2- 172.21.15.146:0/3457253367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e4147b30 0x7f29e4149320 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:53.287 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.285+0000 7f29ea0e2700 1 --2- 172.21.15.146:0/3457253367 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29e40672b0 0x7f29e414a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:53.287 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.285+0000 7f29ea0e2700 1 -- 172.21.15.146:0/3457253367 >> 172.21.15.146:0/3457253367 conn(0x7f29e4067d30 msgr2=0x7f29e4066a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:46:53.287 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.285+0000 7f29ea0e2700 1 -- 172.21.15.146:0/3457253367 shutdown_connections 2021-01-27T09:46:53.288 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:53.285+0000 7f29ea0e2700 1 -- 172.21.15.146:0/3457253367 wait complete. 2021-01-27T09:46:53.288 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 14 2021-01-27T09:46:53.307 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2021-01-27T09:46:55.308 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:46:55.638 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.637+0000 7f5ae0c6a700 1 Processor -- start 2021-01-27T09:46:55.638 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.637+0000 7f5ae0c6a700 1 -- start start 2021-01-27T09:46:55.641 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.641+0000 7f5ae0c6a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5ad400a9b0 0x7f5ad4007850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:55.642 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.641+0000 7f5ae0c6a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5ad400ad90 0x7f5ad404ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:55.642 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.641+0000 7f5ae0c6a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ad4007d40 0x7f5ad404ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:55.642 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.641+0000 7f5ae0c6a700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad40e1930 con 0x7f5ad400a9b0 2021-01-27T09:46:55.642 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.641+0000 7f5ae0c6a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad404f3f0 con 0x7f5ad400ad90 2021-01-27T09:46:55.643 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.641+0000 7f5ae0c6a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad40e2840 con 0x7f5ad4007d40 2021-01-27T09:46:55.644 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.641+0000 7f5ad9d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5ad400ad90 0x7f5ad404ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:55.644 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.641+0000 7f5ad9d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5ad400ad90 0x7f5ad404ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47932/0 (socket says 172.21.15.146:47932) 2021-01-27T09:46:55.644 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.641+0000 7f5ad9d9b700 1 -- 172.21.15.146:0/4075319800 learned_addr learned my addr 172.21.15.146:0/4075319800 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:46:55.645 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.641+0000 7f5ada59c700 1 --2- 172.21.15.146:0/4075319800 >> v2:172.21.15.78:3300/0 conn(0x7f5ad400a9b0 0x7f5ad4007850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:55.646 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.641+0000 7f5ada59c700 1 -- 172.21.15.146:0/4075319800 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ad4007d40 msgr2=0x7f5ad404ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:46:55.646 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.641+0000 7f5ada59c700 1 --2- 172.21.15.146:0/4075319800 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ad4007d40 0x7f5ad404ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:46:55.647 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.641+0000 7f5ada59c700 1 -- 172.21.15.146:0/4075319800 >> v2:172.21.15.146:3300/0 conn(0x7f5ad400ad90 msgr2=0x7f5ad404ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:46:55.647 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.641+0000 7f5ada59c700 1 --2- 172.21.15.146:0/4075319800 >> v2:172.21.15.146:3300/0 conn(0x7f5ad400ad90 0x7f5ad404ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:55.647 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.641+0000 7f5ada59c700 1 -- 172.21.15.146:0/4075319800 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad40e1b20 con 0x7f5ad400a9b0 2021-01-27T09:46:55.648 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.645+0000 7f5ada59c700 1 --2- 172.21.15.146:0/4075319800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad400a9b0 0x7f5ad4007850 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f5ad404fc50 tx=0x7f5ad0006e20).ready entity=mon.0 client_cookie=40371f87c512bc22 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:55.648 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.649+0000 7f5ad959a700 1 -- 172.21.15.146:0/4075319800 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad00097a0 con 0x7f5ad400a9b0 2021-01-27T09:46:55.649 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.649+0000 7f5ad959a700 1 -- 172.21.15.146:0/4075319800 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad0009900 con 0x7f5ad400a9b0 2021-01-27T09:46:55.649 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.649+0000 7f5ad959a700 1 -- 172.21.15.146:0/4075319800 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0009c80 con 0x7f5ad400a9b0 2021-01-27T09:46:55.650 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.649+0000 7f5ae0c6a700 1 -- 172.21.15.146:0/4075319800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad400a9b0 msgr2=0x7f5ad4007850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:55.650 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.649+0000 7f5ae0c6a700 1 --2- 172.21.15.146:0/4075319800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad400a9b0 0x7f5ad4007850 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f5ad404fc50 tx=0x7f5ad0006e20).stop 2021-01-27T09:46:55.651 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.649+0000 7f5ae0c6a700 1 -- 172.21.15.146:0/4075319800 shutdown_connections 2021-01-27T09:46:55.651 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.649+0000 7f5ae0c6a700 1 --2- 172.21.15.146:0/4075319800 >> v2:172.21.15.146:3300/0 conn(0x7f5ad400ad90 0x7f5ad404ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:55.652 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.649+0000 7f5ae0c6a700 1 --2- 172.21.15.146:0/4075319800 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ad4007d40 0x7f5ad404ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:46:55.652 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.649+0000 7f5ae0c6a700 1 --2- 172.21.15.146:0/4075319800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad400a9b0 0x7f5ad4007850 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:55.652 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.649+0000 7f5ae0c6a700 1 -- 172.21.15.146:0/4075319800 >> 172.21.15.146:0/4075319800 conn(0x7f5ad40512d0 msgr2=0x7f5ad404d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:46:55.665 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.665+0000 7f5ae0c6a700 1 -- 172.21.15.146:0/4075319800 shutdown_connections 2021-01-27T09:46:55.666 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.665+0000 7f5ae0c6a700 1 -- 172.21.15.146:0/4075319800 wait complete. 2021-01-27T09:46:55.672 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.665+0000 7f5ae0c6a700 1 Processor -- start 2021-01-27T09:46:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.669+0000 7f5ae0c6a700 1 -- start start 2021-01-27T09:46:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.669+0000 7f5ae0c6a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ad4007d40 0x7f5ad40e4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.669+0000 7f5ae0c6a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad400a9b0 0x7f5ad4049c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.669+0000 7f5ae0c6a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ad400ad90 0x7f5ad40f17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.669+0000 7f5ae0c6a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad404a320 con 0x7f5ad400a9b0 2021-01-27T09:46:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.669+0000 7f5ae0c6a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad404a5c0 con 0x7f5ad4007d40 2021-01-27T09:46:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.669+0000 7f5ae0c6a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad404a860 con 0x7f5ad400ad90 2021-01-27T09:46:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.669+0000 7f5ad9d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad400a9b0 0x7f5ad4049c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.669+0000 7f5ad9d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad400a9b0 0x7f5ad4049c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:50808/0 (socket says 172.21.15.146:50808) 2021-01-27T09:46:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.669+0000 7f5ad9d9b700 1 -- 172.21.15.146:0/1195449126 learned_addr learned my addr 172.21.15.146:0/1195449126 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:46:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.669+0000 7f5adad9d700 1 --2- 172.21.15.146:0/1195449126 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ad400ad90 0x7f5ad40f17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.669+0000 7f5ada59c700 1 --2- 172.21.15.146:0/1195449126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ad4007d40 0x7f5ad40e4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.669+0000 7f5ad9d9b700 1 -- 172.21.15.146:0/1195449126 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ad400ad90 msgr2=0x7f5ad40f17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.669+0000 7f5ad9d9b700 1 --2- 172.21.15.146:0/1195449126 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ad400ad90 0x7f5ad40f17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:55.676 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.669+0000 7f5ad9d9b700 1 -- 172.21.15.146:0/1195449126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ad4007d40 msgr2=0x7f5ad40e4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:55.676 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.669+0000 7f5ad9d9b700 1 --2- 172.21.15.146:0/1195449126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ad4007d40 0x7f5ad40e4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:55.676 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.669+0000 7f5ad9d9b700 1 -- 172.21.15.146:0/1195449126 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad40f0e00 con 0x7f5ad400a9b0 2021-01-27T09:46:55.676 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.669+0000 7f5ada59c700 1 --2- 172.21.15.146:0/1195449126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ad4007d40 0x7f5ad40e4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:46:55.676 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.673+0000 7f5ad9d9b700 1 --2- 172.21.15.146:0/1195449126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad400a9b0 0x7f5ad4049c90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f5acc00d8b0 tx=0x7f5acc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:55.679 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.677+0000 7f5aca7fc700 1 -- 172.21.15.146:0/1195449126 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0125f0 con 0x7f5ad400a9b0 2021-01-27T09:46:55.679 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.677+0000 7f5ae0c6a700 1 -- 172.21.15.146:0/1195449126 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad40f10a0 con 0x7f5ad400a9b0 2021-01-27T09:46:55.679 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.677+0000 7f5ae0c6a700 1 -- 172.21.15.146:0/1195449126 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad4048560 con 0x7f5ad400a9b0 2021-01-27T09:46:55.680 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.677+0000 7f5aca7fc700 1 -- 172.21.15.146:0/1195449126 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc012750 con 0x7f5ad400a9b0 2021-01-27T09:46:55.680 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.681+0000 7f5aca7fc700 1 -- 172.21.15.146:0/1195449126 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc012ad0 con 0x7f5ad400a9b0 2021-01-27T09:46:55.682 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.681+0000 7f5aca7fc700 1 -- 172.21.15.146:0/1195449126 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f5acc013480 con 0x7f5ad400a9b0 2021-01-27T09:46:55.685 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.685+0000 7f5aca7fc700 1 --2- 172.21.15.146:0/1195449126 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f5ab8056230 0x7f5ab80586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:55.685 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.685+0000 7f5aca7fc700 1 -- 172.21.15.146:0/1195449126 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f5acc06f330 con 0x7f5ad400a9b0 2021-01-27T09:46:55.686 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.681+0000 7f5ae0c6a700 1 -- 172.21.15.146:0/1195449126 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5abc004fa0 con 0x7f5ad400a9b0 2021-01-27T09:46:55.687 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.685+0000 7f5ada59c700 1 --2- 172.21.15.146:0/1195449126 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f5ab8056230 0x7f5ab80586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:55.687 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.685+0000 7f5ada59c700 1 --2- 172.21.15.146:0/1195449126 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f5ab8056230 0x7f5ab80586f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f5ad0007fd0 tx=0x7f5ad0016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:55.696 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.693+0000 7f5aca7fc700 1 -- 172.21.15.146:0/1195449126 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f5acc044a00 con 0x7f5ad400a9b0 2021-01-27T09:46:55.979 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.977+0000 7f5ae0c6a700 1 -- 172.21.15.146:0/1195449126 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5abc0057d0 con 0x7f5ad400a9b0 2021-01-27T09:46:55.980 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.981+0000 7f5aca7fc700 1 -- 172.21.15.146:0/1195449126 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3575 (secure 0 0 0) 0x7f5acc048020 con 0x7f5ad400a9b0 2021-01-27T09:46:55.981 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:46:55.981 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:46:16.665785+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6837/745099427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":745099427},{"type":"v1","addr":"172.21.15.146:6837","nonce":745099427}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:46:55.983 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.981+0000 7f5ae0c6a700 1 -- 172.21.15.146:0/1195449126 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f5ab8056230 msgr2=0x7f5ab80586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:55.984 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.981+0000 7f5ae0c6a700 1 --2- 172.21.15.146:0/1195449126 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f5ab8056230 0x7f5ab80586f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f5ad0007fd0 tx=0x7f5ad0016000).stop 2021-01-27T09:46:55.984 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.981+0000 7f5ae0c6a700 1 -- 172.21.15.146:0/1195449126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad400a9b0 msgr2=0x7f5ad4049c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:55.984 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.981+0000 7f5ae0c6a700 1 --2- 172.21.15.146:0/1195449126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad400a9b0 0x7f5ad4049c90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f5acc00d8b0 tx=0x7f5acc008040).stop 2021-01-27T09:46:55.984 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.981+0000 7f5ae0c6a700 1 -- 172.21.15.146:0/1195449126 shutdown_connections 2021-01-27T09:46:55.984 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.981+0000 7f5ae0c6a700 1 --2- 172.21.15.146:0/1195449126 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ad400ad90 0x7f5ad40f17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:55.985 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.981+0000 7f5ae0c6a700 1 --2- 172.21.15.146:0/1195449126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad400a9b0 0x7f5ad4049c90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:55.985 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.981+0000 7f5ae0c6a700 1 --2- 172.21.15.146:0/1195449126 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f5ab8056230 0x7f5ab80586f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:55.985 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.981+0000 7f5ae0c6a700 1 --2- 172.21.15.146:0/1195449126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ad4007d40 0x7f5ad40e4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:55.985 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.981+0000 7f5ae0c6a700 1 -- 172.21.15.146:0/1195449126 >> 172.21.15.146:0/1195449126 conn(0x7f5ad40512d0 msgr2=0x7f5ad40dddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:46:55.986 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.981+0000 7f5ae0c6a700 1 -- 172.21.15.146:0/1195449126 shutdown_connections 2021-01-27T09:46:55.986 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:55.981+0000 7f5ae0c6a700 1 -- 172.21.15.146:0/1195449126 wait complete. 2021-01-27T09:46:55.987 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 14 2021-01-27T09:46:56.004 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2021-01-27T09:46:58.005 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:46:58.161 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.161+0000 7f65620b5700 1 Processor -- start 2021-01-27T09:46:58.162 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.161+0000 7f65620b5700 1 -- start start 2021-01-27T09:46:58.164 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.161+0000 7f65620b5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f655c0ba990 0x7f655c14f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:58.164 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65620b5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f655c0bad70 0x7f655c14fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:58.164 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65620b5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f655c0be4f0 0x7f655c062810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:58.165 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65620b5700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655c0add90 con 0x7f655c0bad70 2021-01-27T09:46:58.165 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65620b5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655c14bac0 con 0x7f655c0be4f0 2021-01-27T09:46:58.165 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65620b5700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655c069990 con 0x7f655c0ba990 2021-01-27T09:46:58.166 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65618b4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f655c0be4f0 0x7f655c062810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:58.167 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65610b3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f655c0ba990 0x7f655c14f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:58.167 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65608b2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f655c0bad70 0x7f655c14fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:58.167 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65610b3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f655c0ba990 0x7f655c14f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:37446/0 (socket says 172.21.15.146:37446) 2021-01-27T09:46:58.167 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65610b3700 1 -- 172.21.15.146:0/2930122003 learned_addr learned my addr 172.21.15.146:0/2930122003 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:46:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65618b4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f655c0be4f0 0x7f655c062810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47964/0 (socket says 172.21.15.146:47964) 2021-01-27T09:46:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65618b4700 1 -- 172.21.15.146:0/2930122003 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f655c0ba990 msgr2=0x7f655c14f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:46:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65618b4700 1 --2- 172.21.15.146:0/2930122003 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f655c0ba990 0x7f655c14f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65618b4700 1 -- 172.21.15.146:0/2930122003 >> v2:172.21.15.78:3300/0 conn(0x7f655c0bad70 msgr2=0x7f655c14fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:46:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65618b4700 1 --2- 172.21.15.146:0/2930122003 >> v2:172.21.15.78:3300/0 conn(0x7f655c0bad70 0x7f655c14fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:58.169 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65618b4700 1 -- 172.21.15.146:0/2930122003 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c0615e0 con 0x7f655c0be4f0 2021-01-27T09:46:58.169 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65618b4700 1 --2- 172.21.15.146:0/2930122003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f655c0be4f0 0x7f655c062810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f655c0ae220 tx=0x7f6554009220).ready entity=mon.1 client_cookie=359bbe45b1638c86 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:58.169 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f654bfff700 1 -- 172.21.15.146:0/2930122003 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655400b930 con 0x7f655c0be4f0 2021-01-27T09:46:58.169 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f654bfff700 1 -- 172.21.15.146:0/2930122003 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655400ba90 con 0x7f655c0be4f0 2021-01-27T09:46:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f654bfff700 1 -- 172.21.15.146:0/2930122003 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655400be30 con 0x7f655c0be4f0 2021-01-27T09:46:58.171 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65620b5700 1 -- 172.21.15.146:0/2930122003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f655c0be4f0 msgr2=0x7f655c062810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:58.171 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65620b5700 1 --2- 172.21.15.146:0/2930122003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f655c0be4f0 0x7f655c062810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f655c0ae220 tx=0x7f6554009220).stop 2021-01-27T09:46:58.171 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65620b5700 1 -- 172.21.15.146:0/2930122003 shutdown_connections 2021-01-27T09:46:58.171 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65620b5700 1 --2- 172.21.15.146:0/2930122003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f655c0be4f0 0x7f655c062810 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:58.172 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65620b5700 1 --2- 172.21.15.146:0/2930122003 >> v2:172.21.15.78:3300/0 conn(0x7f655c0bad70 0x7f655c14fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:58.172 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65620b5700 1 --2- 172.21.15.146:0/2930122003 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f655c0ba990 0x7f655c14f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:58.172 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.165+0000 7f65620b5700 1 -- 172.21.15.146:0/2930122003 >> 172.21.15.146:0/2930122003 conn(0x7f655c069110 msgr2=0x7f655c0bdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:46:58.172 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.169+0000 7f65620b5700 1 -- 172.21.15.146:0/2930122003 shutdown_connections 2021-01-27T09:46:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.169+0000 7f65620b5700 1 -- 172.21.15.146:0/2930122003 wait complete. 2021-01-27T09:46:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.169+0000 7f65620b5700 1 Processor -- start 2021-01-27T09:46:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.169+0000 7f65620b5700 1 -- start start 2021-01-27T09:46:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.173+0000 7f65620b5700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f655c0ba990 0x7f655c0bd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.173+0000 7f65620b5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f655c0bad70 0x7f655c15d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.173+0000 7f65620b5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f655c0be4f0 0x7f655c0bc940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.173+0000 7f65620b5700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655c0bbbf0 con 0x7f655c0ba990 2021-01-27T09:46:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.173+0000 7f65620b5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655c0bbe90 con 0x7f655c0bad70 2021-01-27T09:46:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.173+0000 7f65620b5700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655c0bc130 con 0x7f655c0be4f0 2021-01-27T09:46:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.173+0000 7f65610b3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f655c0ba990 0x7f655c0bd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.173+0000 7f65608b2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f655c0bad70 0x7f655c15d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.173+0000 7f65618b4700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f655c0be4f0 0x7f655c0bc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.173+0000 7f65610b3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f655c0ba990 0x7f655c0bd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:50840/0 (socket says 172.21.15.146:50840) 2021-01-27T09:46:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.173+0000 7f65610b3700 1 -- 172.21.15.146:0/1270275019 learned_addr learned my addr 172.21.15.146:0/1270275019 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:46:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.173+0000 7f65610b3700 1 -- 172.21.15.146:0/1270275019 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f655c0be4f0 msgr2=0x7f655c0bc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.173+0000 7f65610b3700 1 --2- 172.21.15.146:0/1270275019 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f655c0be4f0 0x7f655c0bc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.173+0000 7f65610b3700 1 -- 172.21.15.146:0/1270275019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f655c0bad70 msgr2=0x7f655c15d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.173+0000 7f65610b3700 1 --2- 172.21.15.146:0/1270275019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f655c0bad70 0x7f655c15d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.173+0000 7f65610b3700 1 -- 172.21.15.146:0/1270275019 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c15d1b0 con 0x7f655c0ba990 2021-01-27T09:46:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.173+0000 7f65608b2700 1 --2- 172.21.15.146:0/1270275019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f655c0bad70 0x7f655c15d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:46:58.179 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.173+0000 7f65610b3700 1 --2- 172.21.15.146:0/1270275019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f655c0ba990 0x7f655c0bd940 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f655800f8b0 tx=0x7f6558008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:58.180 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.173+0000 7f65497fa700 1 -- 172.21.15.146:0/1270275019 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6558014670 con 0x7f655c0ba990 2021-01-27T09:46:58.180 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.173+0000 7f65497fa700 1 -- 172.21.15.146:0/1270275019 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65580147d0 con 0x7f655c0ba990 2021-01-27T09:46:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.173+0000 7f65497fa700 1 -- 172.21.15.146:0/1270275019 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6558014b50 con 0x7f655c0ba990 2021-01-27T09:46:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.173+0000 7f65620b5700 1 -- 172.21.15.146:0/1270275019 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655c15cea0 con 0x7f655c0ba990 2021-01-27T09:46:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.177+0000 7f65620b5700 1 -- 172.21.15.146:0/1270275019 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655c067790 con 0x7f655c0ba990 2021-01-27T09:46:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.177+0000 7f65620b5700 1 -- 172.21.15.146:0/1270275019 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655c148350 con 0x7f655c0ba990 2021-01-27T09:46:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.177+0000 7f65497fa700 1 -- 172.21.15.146:0/1270275019 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f65580133c0 con 0x7f655c0ba990 2021-01-27T09:46:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.177+0000 7f65497fa700 1 --2- 172.21.15.146:0/1270275019 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f653c0561b0 0x7f653c058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:46:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.177+0000 7f65497fa700 1 -- 172.21.15.146:0/1270275019 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6825+0+0 (secure 0 0 0) 0x7f655806f980 con 0x7f655c0ba990 2021-01-27T09:46:58.183 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.181+0000 7f65608b2700 1 --2- 172.21.15.146:0/1270275019 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f653c0561b0 0x7f653c058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:46:58.183 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.181+0000 7f65608b2700 1 --2- 172.21.15.146:0/1270275019 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f653c0561b0 0x7f653c058670 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f655c14cb00 tx=0x7f654c006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:46:58.190 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.189+0000 7f65497fa700 1 -- 172.21.15.146:0/1270275019 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f6558044f90 con 0x7f655c0ba990 2021-01-27T09:46:58.505 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.505+0000 7f65620b5700 1 -- 172.21.15.146:0/1270275019 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f655c044680 con 0x7f655c0ba990 2021-01-27T09:46:58.506 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.505+0000 7f65497fa700 1 -- 172.21.15.146:0/1270275019 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3575 (secure 0 0 0) 0x7f6558018020 con 0x7f655c0ba990 2021-01-27T09:46:58.507 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:46:58.507 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:46:16.665785+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6837/745099427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":745099427},{"type":"v1","addr":"172.21.15.146:6837","nonce":745099427}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:46:58.509 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.509+0000 7f65620b5700 1 -- 172.21.15.146:0/1270275019 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f653c0561b0 msgr2=0x7f653c058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:58.509 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.509+0000 7f65620b5700 1 --2- 172.21.15.146:0/1270275019 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f653c0561b0 0x7f653c058670 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f655c14cb00 tx=0x7f654c006e20).stop 2021-01-27T09:46:58.509 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.509+0000 7f65620b5700 1 -- 172.21.15.146:0/1270275019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f655c0ba990 msgr2=0x7f655c0bd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:46:58.509 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.509+0000 7f65620b5700 1 --2- 172.21.15.146:0/1270275019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f655c0ba990 0x7f655c0bd940 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f655800f8b0 tx=0x7f6558008040).stop 2021-01-27T09:46:58.510 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.509+0000 7f65620b5700 1 -- 172.21.15.146:0/1270275019 shutdown_connections 2021-01-27T09:46:58.510 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.509+0000 7f65620b5700 1 --2- 172.21.15.146:0/1270275019 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f655c0be4f0 0x7f655c0bc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:58.511 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.509+0000 7f65620b5700 1 --2- 172.21.15.146:0/1270275019 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f653c0561b0 0x7f653c058670 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:58.511 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.509+0000 7f65620b5700 1 --2- 172.21.15.146:0/1270275019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f655c0bad70 0x7f655c15d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:58.511 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.509+0000 7f65620b5700 1 --2- 172.21.15.146:0/1270275019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f655c0ba990 0x7f655c0bd940 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:46:58.511 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.509+0000 7f65620b5700 1 -- 172.21.15.146:0/1270275019 >> 172.21.15.146:0/1270275019 conn(0x7f655c069110 msgr2=0x7f655c066f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:46:58.511 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.509+0000 7f65620b5700 1 -- 172.21.15.146:0/1270275019 shutdown_connections 2021-01-27T09:46:58.512 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:46:58.509+0000 7f65620b5700 1 -- 172.21.15.146:0/1270275019 wait complete. 2021-01-27T09:46:58.512 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 14 2021-01-27T09:46:58.533 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2021-01-27T09:47:00.534 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:47:00.853 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.853+0000 7f15f54a0700 1 Processor -- start 2021-01-27T09:47:00.853 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.853+0000 7f15f54a0700 1 -- start start 2021-01-27T09:47:00.854 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.853+0000 7f15f54a0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f15e804f990 0x7f15e804b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:00.855 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.853+0000 7f15f54a0700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e8035550 con 0x7f15e8033ae0 2021-01-27T09:47:00.855 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.853+0000 7f15f54a0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e80357f0 con 0x7f15e804fd70 2021-01-27T09:47:00.855 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.853+0000 7f15f54a0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e80d9840 con 0x7f15e804f990 2021-01-27T09:47:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.853+0000 7f15ef7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f15e804fd70 0x7f15e804a450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47600/0 (socket says 172.21.15.146:47600) 2021-01-27T09:47:00.857 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.853+0000 7f15ef7fe700 1 -- 172.21.15.146:0/3689249231 learned_addr learned my addr 172.21.15.146:0/3689249231 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:47:00.857 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.853+0000 7f15effff700 1 --2- 172.21.15.146:0/3689249231 >> v2:172.21.15.146:3300/0 conn(0x7f15e804f990 0x7f15e804b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:00.857 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.857+0000 7f15eeffd700 1 -- 172.21.15.146:0/3689249231 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854011769 0 0) 0x7f15e80357f0 con 0x7f15e804fd70 2021-01-27T09:47:00.858 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.857+0000 7f15eeffd700 1 -- 172.21.15.146:0/3689249231 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15d4003270 con 0x7f15e804fd70 2021-01-27T09:47:00.859 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.857+0000 7f15effff700 1 -- 172.21.15.146:0/3689249231 >> v1:172.21.15.146:6789/0 conn(0x7f15e804fd70 legacy=0x7f15e804a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:00.860 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.857+0000 7f15effff700 1 -- 172.21.15.146:0/3689249231 >> v1:172.21.15.78:6789/0 conn(0x7f15e8033ae0 legacy=0x7f15e8049020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:00.860 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.857+0000 7f15effff700 1 -- 172.21.15.146:0/3689249231 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e80d9ae0 con 0x7f15e804f990 2021-01-27T09:47:00.860 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.857+0000 7f15effff700 1 --2- 172.21.15.146:0/3689249231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e804f990 0x7f15e804b700 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f15e40073c0 tx=0x7f15e4006eb0).ready entity=mon.1 client_cookie=36e7be02f539317c server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:47:00.861 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.857+0000 7f15eeffd700 1 -- 172.21.15.146:0/3689249231 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e400a170 con 0x7f15e804f990 2021-01-27T09:47:00.861 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.857+0000 7f15eeffd700 1 -- 172.21.15.146:0/3689249231 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e400a2d0 con 0x7f15e804f990 2021-01-27T09:47:00.861 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.857+0000 7f15f54a0700 1 -- 172.21.15.146:0/3689249231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e804f990 msgr2=0x7f15e804b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:00.862 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.857+0000 7f15f54a0700 1 --2- 172.21.15.146:0/3689249231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e804f990 0x7f15e804b700 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f15e40073c0 tx=0x7f15e4006eb0).stop 2021-01-27T09:47:00.863 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.857+0000 7f15f54a0700 1 -- 172.21.15.146:0/3689249231 shutdown_connections 2021-01-27T09:47:00.863 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.857+0000 7f15f54a0700 1 --2- 172.21.15.146:0/3689249231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e804f990 0x7f15e804b700 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:00.863 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.857+0000 7f15f54a0700 1 -- 172.21.15.146:0/3689249231 >> 172.21.15.146:0/3689249231 conn(0x7f15e8006e60 msgr2=0x7f15e8007240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:47:00.863 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.861+0000 7f15f54a0700 1 -- 172.21.15.146:0/3689249231 shutdown_connections 2021-01-27T09:47:00.864 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.861+0000 7f15f54a0700 1 -- 172.21.15.146:0/3689249231 wait complete. 2021-01-27T09:47:00.864 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.861+0000 7f15f54a0700 1 Processor -- start 2021-01-27T09:47:00.865 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.861+0000 7f15f54a0700 1 -- start start 2021-01-27T09:47:00.866 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.861+0000 7f15f54a0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e8033ae0 0x7f15e80f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:00.866 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.865+0000 7f15effff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e8033ae0 0x7f15e80f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:00.866 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.865+0000 7f15effff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e8033ae0 0x7f15e80f1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48030/0 (socket says 172.21.15.146:48030) 2021-01-27T09:47:00.867 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.865+0000 7f15f54a0700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15e804f990 0x7f15e802b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:00.867 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.865+0000 7f15f54a0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15e804fd70 0x7f15e80d8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:00.867 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.865+0000 7f15f54a0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e80f0ea0 con 0x7f15e804fd70 2021-01-27T09:47:00.868 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.865+0000 7f15f54a0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e802e610 con 0x7f15e8033ae0 2021-01-27T09:47:00.868 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.865+0000 7f15f54a0700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e802e8b0 con 0x7f15e804f990 2021-01-27T09:47:00.868 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.865+0000 7f15effff700 1 -- 172.21.15.146:0/1771915136 learned_addr learned my addr 172.21.15.146:0/1771915136 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:47:00.869 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.865+0000 7f15ef7fe700 1 --2- 172.21.15.146:0/1771915136 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15e804f990 0x7f15e802b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:00.870 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.865+0000 7f15f4c9f700 1 --2- 172.21.15.146:0/1771915136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15e804fd70 0x7f15e80d8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:00.870 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.865+0000 7f15effff700 1 -- 172.21.15.146:0/1771915136 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15e804f990 msgr2=0x7f15e802b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:00.871 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.865+0000 7f15effff700 1 --2- 172.21.15.146:0/1771915136 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15e804f990 0x7f15e802b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:00.871 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.865+0000 7f15effff700 1 -- 172.21.15.146:0/1771915136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15e804fd70 msgr2=0x7f15e80d8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:00.871 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.865+0000 7f15effff700 1 --2- 172.21.15.146:0/1771915136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15e804fd70 0x7f15e80d8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:00.871 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.865+0000 7f15effff700 1 -- 172.21.15.146:0/1771915136 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e80f1090 con 0x7f15e8033ae0 2021-01-27T09:47:00.872 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.865+0000 7f15effff700 1 --2- 172.21.15.146:0/1771915136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e8033ae0 0x7f15e80f1a70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f15e4006c00 tx=0x7f15e4017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:47:00.873 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.869+0000 7f15dbfff700 1 -- 172.21.15.146:0/1771915136 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e4007080 con 0x7f15e8033ae0 2021-01-27T09:47:00.873 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.869+0000 7f15dbfff700 1 -- 172.21.15.146:0/1771915136 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e4012690 con 0x7f15e8033ae0 2021-01-27T09:47:00.873 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.873+0000 7f15dbfff700 1 -- 172.21.15.146:0/1771915136 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e4012a30 con 0x7f15e8033ae0 2021-01-27T09:47:00.875 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.873+0000 7f15f54a0700 1 -- 172.21.15.146:0/1771915136 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e80f1330 con 0x7f15e8033ae0 2021-01-27T09:47:00.879 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.877+0000 7f15f54a0700 1 -- 172.21.15.146:0/1771915136 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e802e2d0 con 0x7f15e8033ae0 2021-01-27T09:47:00.879 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.877+0000 7f15dbfff700 1 -- 172.21.15.146:0/1771915136 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f15e4026460 con 0x7f15e8033ae0 2021-01-27T09:47:00.884 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.885+0000 7f15dbfff700 1 --2- 172.21.15.146:0/1771915136 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f15d0056230 0x7f15d00586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:00.885 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.885+0000 7f15dbfff700 1 -- 172.21.15.146:0/1771915136 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6911+0+0 (secure 0 0 0) 0x7f15e4074170 con 0x7f15e8033ae0 2021-01-27T09:47:00.885 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.885+0000 7f15f54a0700 1 -- 172.21.15.146:0/1771915136 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e80051a0 con 0x7f15e8033ae0 2021-01-27T09:47:00.886 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.885+0000 7f15ef7fe700 1 --2- 172.21.15.146:0/1771915136 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f15d0056230 0x7f15d00586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:00.896 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.893+0000 7f15ef7fe700 1 --2- 172.21.15.146:0/1771915136 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f15d0056230 0x7f15d00586f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f15e804c3a0 tx=0x7f15dc009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:47:00.898 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:00.897+0000 7f15dbfff700 1 -- 172.21.15.146:0/1771915136 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f15e4075060 con 0x7f15e8033ae0 2021-01-27T09:47:01.468 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.465+0000 7f15f54a0700 1 -- 172.21.15.146:0/1771915136 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15e80084b0 con 0x7f15e8033ae0 2021-01-27T09:47:01.475 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.473+0000 7f15dbfff700 1 -- 172.21.15.146:0/1771915136 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3228 (secure 0 0 0) 0x7f15e4045d60 con 0x7f15e8033ae0 2021-01-27T09:47:01.484 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:47:01.484 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:47:00.595551+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":2,"incarnation":15,"state":"up:reconnect","state_seq":41,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:47:01.487 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.485+0000 7f15f54a0700 1 -- 172.21.15.146:0/1771915136 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f15d0056230 msgr2=0x7f15d00586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:01.488 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.485+0000 7f15f54a0700 1 --2- 172.21.15.146:0/1771915136 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f15d0056230 0x7f15d00586f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f15e804c3a0 tx=0x7f15dc009040).stop 2021-01-27T09:47:01.488 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.485+0000 7f15f54a0700 1 -- 172.21.15.146:0/1771915136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e8033ae0 msgr2=0x7f15e80f1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:01.488 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.485+0000 7f15f54a0700 1 --2- 172.21.15.146:0/1771915136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e8033ae0 0x7f15e80f1a70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f15e4006c00 tx=0x7f15e4017000).stop 2021-01-27T09:47:01.489 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.489+0000 7f15f54a0700 1 -- 172.21.15.146:0/1771915136 shutdown_connections 2021-01-27T09:47:01.489 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.489+0000 7f15f54a0700 1 --2- 172.21.15.146:0/1771915136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15e804fd70 0x7f15e80d8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:01.490 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.489+0000 7f15f54a0700 1 --2- 172.21.15.146:0/1771915136 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15e804f990 0x7f15e802b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:01.490 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.489+0000 7f15f54a0700 1 --2- 172.21.15.146:0/1771915136 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f15d0056230 0x7f15d00586f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:01.490 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.489+0000 7f15f54a0700 1 --2- 172.21.15.146:0/1771915136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e8033ae0 0x7f15e80f1a70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:01.490 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.489+0000 7f15f54a0700 1 -- 172.21.15.146:0/1771915136 >> 172.21.15.146:0/1771915136 conn(0x7f15e8006e60 msgr2=0x7f15e80d17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:47:01.490 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.489+0000 7f15f54a0700 1 -- 172.21.15.146:0/1771915136 shutdown_connections 2021-01-27T09:47:01.491 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.489+0000 7f15f54a0700 1 -- 172.21.15.146:0/1771915136 wait complete. 2021-01-27T09:47:01.502 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 17 2021-01-27T09:47:01.546 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e down, removed from mdsmap 2021-01-27T09:47:01.547 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2021-01-27T09:47:01.547 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:47:01.768 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.769+0000 7f2f99207700 1 Processor -- start 2021-01-27T09:47:01.769 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.769+0000 7f2f99207700 1 -- start start 2021-01-27T09:47:01.770 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.769+0000 7f2f99207700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f94147b30 0x7f2f940672b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:01.771 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.769+0000 7f2f99207700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2f94147f10 0x7f2f94062810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:01.772 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.769+0000 7f2f99207700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2f94064d20 0x7f2f94065190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:01.772 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.769+0000 7f2f99207700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f940be8a0 con 0x7f2f94064d20 2021-01-27T09:47:01.772 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.769+0000 7f2f99207700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f940677a0 con 0x7f2f94147f10 2021-01-27T09:47:01.772 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.769+0000 7f2f99207700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f941513e0 con 0x7f2f94147b30 2021-01-27T09:47:01.772 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.769+0000 7f2f937fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2f94147f10 0x7f2f94062810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:01.773 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.769+0000 7f2f93fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f94147b30 0x7f2f940672b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:01.773 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.769+0000 7f2f937fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2f94147f10 0x7f2f94062810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48044/0 (socket says 172.21.15.146:48044) 2021-01-27T09:47:01.773 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.769+0000 7f2f93fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f94147b30 0x7f2f940672b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:37528/0 (socket says 172.21.15.146:37528) 2021-01-27T09:47:01.773 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.769+0000 7f2f937fe700 1 -- 172.21.15.146:0/2120940577 learned_addr learned my addr 172.21.15.146:0/2120940577 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:47:01.774 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.769+0000 7f2f98a06700 1 --2- 172.21.15.146:0/2120940577 >> v2:172.21.15.78:3300/0 conn(0x7f2f94064d20 0x7f2f94065190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:01.774 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.773+0000 7f2f93fff700 1 -- 172.21.15.146:0/2120940577 >> v2:172.21.15.146:3300/0 conn(0x7f2f94147f10 msgr2=0x7f2f94062810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:47:01.775 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.773+0000 7f2f93fff700 1 --2- 172.21.15.146:0/2120940577 >> v2:172.21.15.146:3300/0 conn(0x7f2f94147f10 0x7f2f94062810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:01.775 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.773+0000 7f2f93fff700 1 -- 172.21.15.146:0/2120940577 >> v2:172.21.15.78:3300/0 conn(0x7f2f94064d20 msgr2=0x7f2f94065190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:47:01.775 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.773+0000 7f2f93fff700 1 --2- 172.21.15.146:0/2120940577 >> v2:172.21.15.78:3300/0 conn(0x7f2f94064d20 0x7f2f94065190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:01.775 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.773+0000 7f2f93fff700 1 -- 172.21.15.146:0/2120940577 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f94151680 con 0x7f2f94147b30 2021-01-27T09:47:01.776 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.773+0000 7f2f93fff700 1 --2- 172.21.15.146:0/2120940577 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f94147b30 0x7f2f940672b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f2f94063cf0 tx=0x7f2f84006e20).ready entity=mon.2 client_cookie=61a9f3f932fa9d66 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:47:01.776 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.773+0000 7f2f92ffd700 1 -- 172.21.15.146:0/2120940577 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f84009560 con 0x7f2f94147b30 2021-01-27T09:47:01.776 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.773+0000 7f2f92ffd700 1 -- 172.21.15.146:0/2120940577 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f840096c0 con 0x7f2f94147b30 2021-01-27T09:47:01.776 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.773+0000 7f2f92ffd700 1 -- 172.21.15.146:0/2120940577 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f84009a40 con 0x7f2f94147b30 2021-01-27T09:47:01.779 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.777+0000 7f2f99207700 1 -- 172.21.15.146:0/2120940577 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f94147b30 msgr2=0x7f2f940672b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:01.779 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.777+0000 7f2f99207700 1 --2- 172.21.15.146:0/2120940577 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f94147b30 0x7f2f940672b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f2f94063cf0 tx=0x7f2f84006e20).stop 2021-01-27T09:47:01.779 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.777+0000 7f2f99207700 1 -- 172.21.15.146:0/2120940577 shutdown_connections 2021-01-27T09:47:01.780 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.777+0000 7f2f99207700 1 --2- 172.21.15.146:0/2120940577 >> v2:172.21.15.146:3300/0 conn(0x7f2f94147f10 0x7f2f94062810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:01.780 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.777+0000 7f2f99207700 1 --2- 172.21.15.146:0/2120940577 >> v2:172.21.15.78:3300/0 conn(0x7f2f94064d20 0x7f2f94065190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:01.780 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.777+0000 7f2f99207700 1 --2- 172.21.15.146:0/2120940577 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f94147b30 0x7f2f940672b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:01.780 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.777+0000 7f2f99207700 1 -- 172.21.15.146:0/2120940577 >> 172.21.15.146:0/2120940577 conn(0x7f2f94067d30 msgr2=0x7f2f94068110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:47:01.781 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.777+0000 7f2f99207700 1 -- 172.21.15.146:0/2120940577 shutdown_connections 2021-01-27T09:47:01.781 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.781+0000 7f2f99207700 1 -- 172.21.15.146:0/2120940577 wait complete. 2021-01-27T09:47:01.783 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.781+0000 7f2f99207700 1 Processor -- start 2021-01-27T09:47:01.783 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.781+0000 7f2f99207700 1 -- start start 2021-01-27T09:47:01.785 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.785+0000 7f2f99207700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f94064d20 0x7f2f94161640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:01.786 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.785+0000 7f2f99207700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f94147b30 0x7f2f940bff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:01.786 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.785+0000 7f2f99207700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f94147f10 0x7f2f9414baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:01.786 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.785+0000 7f2f93fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f94064d20 0x7f2f94161640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:01.787 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.785+0000 7f2f93fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f94064d20 0x7f2f94161640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:50922/0 (socket says 172.21.15.146:50922) 2021-01-27T09:47:01.787 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.785+0000 7f2f937fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f94147b30 0x7f2f940bff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:01.787 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.785+0000 7f2f93fff700 1 -- 172.21.15.146:0/3809182269 learned_addr learned my addr 172.21.15.146:0/3809182269 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:47:01.788 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.785+0000 7f2f99207700 1 -- 172.21.15.146:0/3809182269 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f94161b30 con 0x7f2f94064d20 2021-01-27T09:47:01.788 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.785+0000 7f2f99207700 1 -- 172.21.15.146:0/3809182269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f940b19b0 con 0x7f2f94147f10 2021-01-27T09:47:01.788 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.785+0000 7f2f99207700 1 -- 172.21.15.146:0/3809182269 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f940b1c50 con 0x7f2f94147b30 2021-01-27T09:47:01.788 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.785+0000 7f2f98a06700 1 --2- 172.21.15.146:0/3809182269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f94147f10 0x7f2f9414baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:01.789 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.785+0000 7f2f98a06700 1 -- 172.21.15.146:0/3809182269 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f94147b30 msgr2=0x7f2f940bff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:01.790 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.785+0000 7f2f98a06700 1 --2- 172.21.15.146:0/3809182269 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f94147b30 0x7f2f940bff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:01.790 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.785+0000 7f2f98a06700 1 -- 172.21.15.146:0/3809182269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f94064d20 msgr2=0x7f2f94161640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:01.790 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.785+0000 7f2f98a06700 1 --2- 172.21.15.146:0/3809182269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f94064d20 0x7f2f94161640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:01.790 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.785+0000 7f2f98a06700 1 -- 172.21.15.146:0/3809182269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9415da30 con 0x7f2f94147f10 2021-01-27T09:47:01.790 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.785+0000 7f2f98a06700 1 --2- 172.21.15.146:0/3809182269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f94147f10 0x7f2f9414baa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f2f8c00ebd0 tx=0x7f2f8c009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:47:01.791 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.785+0000 7f2f7bfff700 1 -- 172.21.15.146:0/3809182269 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c00c920 con 0x7f2f94147f10 2021-01-27T09:47:01.791 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.785+0000 7f2f7bfff700 1 -- 172.21.15.146:0/3809182269 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8c00ca80 con 0x7f2f94147f10 2021-01-27T09:47:01.791 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.789+0000 7f2f7bfff700 1 -- 172.21.15.146:0/3809182269 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c00ce20 con 0x7f2f94147f10 2021-01-27T09:47:01.791 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.789+0000 7f2f99207700 1 -- 172.21.15.146:0/3809182269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f9415dcd0 con 0x7f2f94147f10 2021-01-27T09:47:01.792 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.793+0000 7f2f7bfff700 1 -- 172.21.15.146:0/3809182269 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f2f8c012600 con 0x7f2f94147f10 2021-01-27T09:47:01.794 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.793+0000 7f2f7bfff700 1 --2- 172.21.15.146:0/3809182269 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2f740561e0 0x7f2f740586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:01.795 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.793+0000 7f2f99207700 1 -- 172.21.15.146:0/3809182269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9414b340 con 0x7f2f94147f10 2021-01-27T09:47:01.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.793+0000 7f2f7bfff700 1 -- 172.21.15.146:0/3809182269 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6911+0+0 (secure 0 0 0) 0x7f2f8c06efc0 con 0x7f2f94147f10 2021-01-27T09:47:01.797 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.793+0000 7f2f93fff700 1 --2- 172.21.15.146:0/3809182269 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2f740561e0 0x7f2f740586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:01.797 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.797+0000 7f2f99207700 1 -- 172.21.15.146:0/3809182269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f94044ee0 con 0x7f2f94147f10 2021-01-27T09:47:01.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.797+0000 7f2f93fff700 1 --2- 172.21.15.146:0/3809182269 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2f740561e0 0x7f2f740586a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f2f84009fd0 tx=0x7f2f84016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:47:01.804 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:01.801+0000 7f2f7bfff700 1 -- 172.21.15.146:0/3809182269 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f2f8c016020 con 0x7f2f94147f10 2021-01-27T09:47:02.028 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:02.029+0000 7f2f99207700 1 -- 172.21.15.146:0/3809182269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f940bddd0 con 0x7f2f94147f10 2021-01-27T09:47:02.029 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:02.029+0000 7f2f7bfff700 1 -- 172.21.15.146:0/3809182269 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3228 (secure 0 0 0) 0x7f2f8c074060 con 0x7f2f94147f10 2021-01-27T09:47:02.030 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:47:02.030 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:47:00.595551+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":2,"incarnation":15,"state":"up:reconnect","state_seq":41,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:47:02.032 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:02.029+0000 7f2f99207700 1 -- 172.21.15.146:0/3809182269 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2f740561e0 msgr2=0x7f2f740586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:02.032 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:02.029+0000 7f2f99207700 1 --2- 172.21.15.146:0/3809182269 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2f740561e0 0x7f2f740586a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f2f84009fd0 tx=0x7f2f84016000).stop 2021-01-27T09:47:02.032 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:02.029+0000 7f2f99207700 1 -- 172.21.15.146:0/3809182269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f94147f10 msgr2=0x7f2f9414baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:02.032 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:02.029+0000 7f2f99207700 1 --2- 172.21.15.146:0/3809182269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f94147f10 0x7f2f9414baa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f2f8c00ebd0 tx=0x7f2f8c009220).stop 2021-01-27T09:47:02.032 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:02.029+0000 7f2f99207700 1 -- 172.21.15.146:0/3809182269 shutdown_connections 2021-01-27T09:47:02.033 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:02.029+0000 7f2f99207700 1 --2- 172.21.15.146:0/3809182269 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2f740561e0 0x7f2f740586a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:02.033 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:02.029+0000 7f2f99207700 1 --2- 172.21.15.146:0/3809182269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f94147f10 0x7f2f9414baa0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:02.033 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:02.029+0000 7f2f99207700 1 --2- 172.21.15.146:0/3809182269 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2f94147b30 0x7f2f940bff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:02.033 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:02.029+0000 7f2f99207700 1 --2- 172.21.15.146:0/3809182269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f94064d20 0x7f2f94161640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:02.034 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:02.029+0000 7f2f99207700 1 -- 172.21.15.146:0/3809182269 >> 172.21.15.146:0/3809182269 conn(0x7f2f94067d30 msgr2=0x7f2f940627b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:47:02.034 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:02.033+0000 7f2f99207700 1 -- 172.21.15.146:0/3809182269 shutdown_connections 2021-01-27T09:47:02.034 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:02.033+0000 7f2f99207700 1 -- 172.21.15.146:0/3809182269 wait complete. 2021-01-27T09:47:02.035 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 17 2021-01-27T09:47:02.064 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-01-27T09:44:29.315988+0000", "damaged": [], "data_pools": [ 4, 5 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_4238": { "addr": "172.21.15.146:6835/1106324127", "addrs": { "addrvec": [ { "addr": "172.21.15.146:6833", "nonce": 1106324127, "type": "v2" }, { "addr": "172.21.15.146:6835", "nonce": 1106324127, "type": "v1" } ] }, "export_targets": [], "features": 4540138297136906239, "flags": 0, "gid": 4238, "incarnation": 15, "join_fscid": -1, "name": "a", "rank": 2, "state": "up:reconnect", "state_seq": 41 }, "gid_4275": { "addr": "172.21.15.78:6837/1117292103", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6836", "nonce": 1117292103, "type": "v2" }, { "addr": "172.21.15.78:6837", "nonce": 1117292103, "type": "v1" } ] }, "export_targets": [ 1 ], "features": 4540138297136906239, "flags": 0, "gid": 4275, "incarnation": 4, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:active", "state_seq": 2 }, "gid_4287": { "addr": "172.21.15.146:6834/2738812606", "addrs": { "addrvec": [ { "addr": "172.21.15.146:6832", "nonce": 2738812606, "type": "v2" }, { "addr": "172.21.15.146:6834", "nonce": 2738812606, "type": "v1" } ] }, "export_targets": [], "features": 4540138297136906239, "flags": 0, "gid": 4287, "incarnation": 10, "join_fscid": -1, "name": "c", "rank": 1, "state": "up:active", "state_seq": 8 } }, "last_failure": 0, "last_failure_osd_epoch": 27, "max_file_size": 1099511627776, "max_mds": 3, "metadata_pool": 3, "modified": "2021-01-27T09:47:00.595551+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4275, "mds_1": 4287, "mds_2": 4238 } } } ], "standbys": [ { "addr": "172.21.15.78:6835/2572346312", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6834", "nonce": 2572346312, "type": "v2" }, { "addr": "172.21.15.78:6835", "nonce": 2572346312, "type": "v1" } ] }, "epoch": 3, "export_targets": [], "features": 4540138297136906239, "flags": 0, "gid": 4223, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.78:6839/148943173", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6838", "nonce": 148943173, "type": "v2" }, { "addr": "172.21.15.78:6839", "nonce": 148943173, "type": "v1" } ] }, "epoch": 3, "export_targets": [], "features": 4540138297136906239, "flags": 0, "gid": 4232, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2021-01-27T09:47:04.065 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:47:04.225 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.225+0000 7f146aafa700 1 Processor -- start 2021-01-27T09:47:04.225 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.225+0000 7f146aafa700 1 -- start start 2021-01-27T09:47:04.226 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.225+0000 7f146aafa700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f14640be650 0x7f1464066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:04.226 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.225+0000 7f146aafa700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f14640bec50 0x7f1464152df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:04.226 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.225+0000 7f146aafa700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1464156750 con 0x7f14640be270 2021-01-27T09:47:04.227 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.225+0000 7f146aafa700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1464155f80 con 0x7f14640be650 2021-01-27T09:47:04.227 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.225+0000 7f146aafa700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1464156210 con 0x7f14640bec50 2021-01-27T09:47:04.228 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.225+0000 7f1468896700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f14640be270 0x7f1464155860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47634/0 (socket says 172.21.15.146:47634) 2021-01-27T09:47:04.228 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.225+0000 7f1468896700 1 -- 172.21.15.146:0/1932035371 learned_addr learned my addr 172.21.15.146:0/1932035371 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:47:04.229 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.225+0000 7f1463fff700 1 --2- 172.21.15.146:0/1932035371 >> v2:172.21.15.146:3300/0 conn(0x7f14640be650 0x7f1464066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:04.229 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.225+0000 7f1469097700 1 --2- 172.21.15.146:0/1932035371 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f14640bec50 0x7f1464152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:04.229 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.225+0000 7f14637fe700 1 -- 172.21.15.146:0/1932035371 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936992081 0 0) 0x7f1464156750 con 0x7f14640be270 2021-01-27T09:47:04.229 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.225+0000 7f14637fe700 1 -- 172.21.15.146:0/1932035371 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1448003270 con 0x7f14640be270 2021-01-27T09:47:04.229 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.225+0000 7f1463fff700 1 -- 172.21.15.146:0/1932035371 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f14640bec50 msgr2=0x7f1464152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:47:04.230 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.225+0000 7f14637fe700 1 -- 172.21.15.146:0/1932035371 <== mon.1 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2036771725 0 0) 0x7f1448003270 con 0x7f14640be270 2021-01-27T09:47:04.230 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.225+0000 7f1463fff700 1 --2- 172.21.15.146:0/1932035371 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f14640bec50 0x7f1464152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:04.230 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.225+0000 7f1463fff700 1 -- 172.21.15.146:0/1932035371 >> v1:172.21.15.146:6789/0 conn(0x7f14640be270 legacy=0x7f1464155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:04.230 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.229+0000 7f1463fff700 1 -- 172.21.15.146:0/1932035371 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14641564b0 con 0x7f14640be650 2021-01-27T09:47:04.231 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.229+0000 7f1463fff700 1 --2- 172.21.15.146:0/1932035371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14640be650 0x7f1464066520 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f145000b9c0 tx=0x7f1450006e20).ready entity=mon.1 client_cookie=9e8aa1d244e3ec84 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:47:04.231 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.229+0000 7f14637fe700 1 -- 172.21.15.146:0/1932035371 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1458001520 con 0x7f14640be650 2021-01-27T09:47:04.232 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.229+0000 7f14637fe700 1 -- 172.21.15.146:0/1932035371 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1450011400 con 0x7f14640be650 2021-01-27T09:47:04.232 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.229+0000 7f14637fe700 1 -- 172.21.15.146:0/1932035371 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1450011780 con 0x7f14640be650 2021-01-27T09:47:04.232 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.229+0000 7f146aafa700 1 -- 172.21.15.146:0/1932035371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14640be650 msgr2=0x7f1464066520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:04.232 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.229+0000 7f146aafa700 1 --2- 172.21.15.146:0/1932035371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14640be650 0x7f1464066520 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f145000b9c0 tx=0x7f1450006e20).stop 2021-01-27T09:47:04.233 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.229+0000 7f146aafa700 1 -- 172.21.15.146:0/1932035371 shutdown_connections 2021-01-27T09:47:04.233 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.229+0000 7f146aafa700 1 --2- 172.21.15.146:0/1932035371 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f14640bec50 0x7f1464152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:04.233 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.229+0000 7f146aafa700 1 --2- 172.21.15.146:0/1932035371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14640be650 0x7f1464066520 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:04.233 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.229+0000 7f146aafa700 1 -- 172.21.15.146:0/1932035371 >> 172.21.15.146:0/1932035371 conn(0x7f1464069110 msgr2=0x7f1464067e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:47:04.233 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.229+0000 7f146aafa700 1 -- 172.21.15.146:0/1932035371 shutdown_connections 2021-01-27T09:47:04.234 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.229+0000 7f146aafa700 1 -- 172.21.15.146:0/1932035371 wait complete. 2021-01-27T09:47:04.237 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.233+0000 7f146aafa700 1 Processor -- start 2021-01-27T09:47:04.237 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.233+0000 7f146aafa700 1 -- start start 2021-01-27T09:47:04.237 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.233+0000 7f146aafa700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14640be270 0x7f1464149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:04.237 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.233+0000 7f146aafa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14640bec50 0x7f1464165840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:04.238 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.233+0000 7f146aafa700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1464161750 0x7f1464157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:04.238 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.233+0000 7f146aafa700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14641587d0 con 0x7f14640be270 2021-01-27T09:47:04.238 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.233+0000 7f146aafa700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1464164ea0 con 0x7f14640bec50 2021-01-27T09:47:04.238 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.233+0000 7f146aafa700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1464161bc0 con 0x7f1464161750 2021-01-27T09:47:04.239 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.233+0000 7f1463fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14640bec50 0x7f1464165840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:04.239 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.233+0000 7f1468896700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14640be270 0x7f1464149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:04.239 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.233+0000 7f1469097700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1464161750 0x7f1464157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:04.239 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.233+0000 7f1463fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14640bec50 0x7f1464165840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48072/0 (socket says 172.21.15.146:48072) 2021-01-27T09:47:04.240 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.233+0000 7f1463fff700 1 -- 172.21.15.146:0/3189968663 learned_addr learned my addr 172.21.15.146:0/3189968663 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:47:04.240 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.233+0000 7f1468896700 1 --2- 172.21.15.146:0/3189968663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14640be270 0x7f1464149330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:50942/0 (socket says 172.21.15.146:50942) 2021-01-27T09:47:04.240 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.237+0000 7f1463fff700 1 -- 172.21.15.146:0/3189968663 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1464161750 msgr2=0x7f1464157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:04.240 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.237+0000 7f1463fff700 1 --2- 172.21.15.146:0/3189968663 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1464161750 0x7f1464157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:04.240 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.237+0000 7f1463fff700 1 -- 172.21.15.146:0/3189968663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14640be270 msgr2=0x7f1464149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:04.241 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.237+0000 7f1463fff700 1 --2- 172.21.15.146:0/3189968663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14640be270 0x7f1464149330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:04.241 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.237+0000 7f1463fff700 1 -- 172.21.15.146:0/3189968663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1464158290 con 0x7f14640bec50 2021-01-27T09:47:04.241 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.237+0000 7f1469097700 1 --2- 172.21.15.146:0/3189968663 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1464161750 0x7f1464157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:47:04.241 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.237+0000 7f1463fff700 1 --2- 172.21.15.146:0/3189968663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14640bec50 0x7f1464165840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f1464061fd0 tx=0x7f1450016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:47:04.242 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.237+0000 7f1460ff9700 1 -- 172.21.15.146:0/3189968663 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1450000c90 con 0x7f14640bec50 2021-01-27T09:47:04.242 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.237+0000 7f1460ff9700 1 -- 172.21.15.146:0/3189968663 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1450010aa0 con 0x7f14640bec50 2021-01-27T09:47:04.243 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.237+0000 7f146aafa700 1 -- 172.21.15.146:0/3189968663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1464158530 con 0x7f14640bec50 2021-01-27T09:47:04.243 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.237+0000 7f1460ff9700 1 -- 172.21.15.146:0/3189968663 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1450010e40 con 0x7f14640bec50 2021-01-27T09:47:04.243 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.237+0000 7f146aafa700 1 -- 172.21.15.146:0/3189968663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14641653a0 con 0x7f14640bec50 2021-01-27T09:47:04.243 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.237+0000 7f146aafa700 1 -- 172.21.15.146:0/3189968663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14640b7bb0 con 0x7f14640bec50 2021-01-27T09:47:04.244 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.241+0000 7f1460ff9700 1 -- 172.21.15.146:0/3189968663 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f145000f070 con 0x7f14640bec50 2021-01-27T09:47:04.244 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.241+0000 7f1460ff9700 1 --2- 172.21.15.146:0/3189968663 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f14440561e0 0x7f14440586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:04.244 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.241+0000 7f1460ff9700 1 -- 172.21.15.146:0/3189968663 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6911+0+0 (secure 0 0 0) 0x7f1450070a20 con 0x7f14640bec50 2021-01-27T09:47:04.245 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.241+0000 7f1468896700 1 --2- 172.21.15.146:0/3189968663 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f14440561e0 0x7f14440586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:04.245 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.245+0000 7f1468896700 1 --2- 172.21.15.146:0/3189968663 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f14440561e0 0x7f14440586a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f14580011e0 tx=0x7f14580012c0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:47:04.248 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.249+0000 7f1460ff9700 1 -- 172.21.15.146:0/3189968663 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f14640b7bb0 con 0x7f14640bec50 2021-01-27T09:47:04.421 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.421+0000 7f146aafa700 1 -- 172.21.15.146:0/3189968663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14640b7bb0 con 0x7f14640bec50 2021-01-27T09:47:04.422 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.421+0000 7f1460ff9700 1 -- 172.21.15.146:0/3189968663 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3225 (secure 0 0 0) 0x7f14640b7bb0 con 0x7f14640bec50 2021-01-27T09:47:04.422 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:47:04.423 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:47:03.624556+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":2,"incarnation":15,"state":"up:rejoin","state_seq":42,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:47:04.426 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.425+0000 7f146aafa700 1 -- 172.21.15.146:0/3189968663 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f14440561e0 msgr2=0x7f14440586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:04.426 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.425+0000 7f146aafa700 1 --2- 172.21.15.146:0/3189968663 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f14440561e0 0x7f14440586a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f14580011e0 tx=0x7f14580012c0).stop 2021-01-27T09:47:04.427 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.425+0000 7f146aafa700 1 -- 172.21.15.146:0/3189968663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14640bec50 msgr2=0x7f1464165840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:04.427 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.425+0000 7f146aafa700 1 --2- 172.21.15.146:0/3189968663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14640bec50 0x7f1464165840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f1464061fd0 tx=0x7f1450016000).stop 2021-01-27T09:47:04.427 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.425+0000 7f146aafa700 1 -- 172.21.15.146:0/3189968663 shutdown_connections 2021-01-27T09:47:04.427 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.425+0000 7f146aafa700 1 --2- 172.21.15.146:0/3189968663 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1464161750 0x7f1464157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:04.428 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.425+0000 7f146aafa700 1 --2- 172.21.15.146:0/3189968663 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f14440561e0 0x7f14440586a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:04.428 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.425+0000 7f146aafa700 1 --2- 172.21.15.146:0/3189968663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14640bec50 0x7f1464165840 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:04.428 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.425+0000 7f146aafa700 1 --2- 172.21.15.146:0/3189968663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14640be270 0x7f1464149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:04.428 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.425+0000 7f146aafa700 1 -- 172.21.15.146:0/3189968663 >> 172.21.15.146:0/3189968663 conn(0x7f1464069110 msgr2=0x7f14640b9960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:47:04.429 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.425+0000 7f146aafa700 1 -- 172.21.15.146:0/3189968663 shutdown_connections 2021-01-27T09:47:04.429 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:04.425+0000 7f146aafa700 1 -- 172.21.15.146:0/3189968663 wait complete. 2021-01-27T09:47:04.429 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 18 2021-01-27T09:47:04.453 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2021-01-27T09:47:06.454 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:47:06.607 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.605+0000 7fdcd2064700 1 Processor -- start 2021-01-27T09:47:06.607 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.605+0000 7fdcd2064700 1 -- start start 2021-01-27T09:47:06.609 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.609+0000 7fdcd2064700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdccc062c80 0x7fdccc063060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:06.609 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.609+0000 7fdcd2064700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdccc066db0 0x7fdccc14e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:06.610 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.609+0000 7fdccbfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdccc066db0 0x7fdccc14e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:06.610 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.609+0000 7fdcd2064700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdccc065cf0 con 0x7fdccc0b8e60 2021-01-27T09:47:06.611 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.609+0000 7fdcd2064700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdccc14ee10 con 0x7fdccc066db0 2021-01-27T09:47:06.611 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.609+0000 7fdcd2064700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc0b9600 con 0x7fdccc062c80 2021-01-27T09:47:06.611 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.609+0000 7fdccbfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdccc066db0 0x7fdccc14e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48076/0 (socket says 172.21.15.146:48076) 2021-01-27T09:47:06.611 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.609+0000 7fdccbfff700 1 -- 172.21.15.146:0/1314988181 learned_addr learned my addr 172.21.15.146:0/1314988181 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:47:06.611 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.609+0000 7fdccb7fe700 1 --2- 172.21.15.146:0/1314988181 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdccc062c80 0x7fdccc063060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:06.612 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.609+0000 7fdccbfff700 1 -- 172.21.15.146:0/1314988181 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdccc062c80 msgr2=0x7fdccc063060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:47:06.612 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.609+0000 7fdccbfff700 1 --2- 172.21.15.146:0/1314988181 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdccc062c80 0x7fdccc063060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:06.612 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.609+0000 7fdccbfff700 1 -- 172.21.15.146:0/1314988181 >> v1:172.21.15.146:6789/0 conn(0x7fdccc0b8e60 legacy=0x7fdccc066690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:47:06.612 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.609+0000 7fdccbfff700 1 -- 172.21.15.146:0/1314988181 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc0638b0 con 0x7fdccc066db0 2021-01-27T09:47:06.612 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.609+0000 7fdccb7fe700 1 --2- 172.21.15.146:0/1314988181 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdccc062c80 0x7fdccc063060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:47:06.613 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.609+0000 7fdccbfff700 1 --2- 172.21.15.146:0/1314988181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdccc066db0 0x7fdccc14e920 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fdcc4009d90 tx=0x7fdcc40092d0).ready entity=mon.1 client_cookie=93184eb97552108c server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:47:06.614 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.609+0000 7fdcca7fc700 1 -- 172.21.15.146:0/1314988181 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc400bc80 con 0x7fdccc066db0 2021-01-27T09:47:06.614 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.609+0000 7fdcca7fc700 1 -- 172.21.15.146:0/1314988181 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc400bde0 con 0x7fdccc066db0 2021-01-27T09:47:06.614 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.609+0000 7fdcca7fc700 1 -- 172.21.15.146:0/1314988181 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4011610 con 0x7fdccc066db0 2021-01-27T09:47:06.614 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.613+0000 7fdcd2064700 1 -- 172.21.15.146:0/1314988181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdccc066db0 msgr2=0x7fdccc14e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:06.614 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.613+0000 7fdcd2064700 1 --2- 172.21.15.146:0/1314988181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdccc066db0 0x7fdccc14e920 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fdcc4009d90 tx=0x7fdcc40092d0).stop 2021-01-27T09:47:06.615 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.613+0000 7fdcd2064700 1 -- 172.21.15.146:0/1314988181 shutdown_connections 2021-01-27T09:47:06.615 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.613+0000 7fdcd2064700 1 --2- 172.21.15.146:0/1314988181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdccc066db0 0x7fdccc14e920 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:06.615 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.613+0000 7fdcd2064700 1 --2- 172.21.15.146:0/1314988181 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdccc062c80 0x7fdccc063060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:06.615 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.613+0000 7fdcd2064700 1 -- 172.21.15.146:0/1314988181 >> 172.21.15.146:0/1314988181 conn(0x7fdccc067e60 msgr2=0x7fdccc064240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:47:06.616 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.613+0000 7fdcd2064700 1 -- 172.21.15.146:0/1314988181 shutdown_connections 2021-01-27T09:47:06.616 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.613+0000 7fdcd2064700 1 -- 172.21.15.146:0/1314988181 wait complete. 2021-01-27T09:47:06.618 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.613+0000 7fdcd2064700 1 Processor -- start 2021-01-27T09:47:06.618 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.613+0000 7fdcd2064700 1 -- start start 2021-01-27T09:47:06.618 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.613+0000 7fdcd2064700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdccc062c80 0x7fdccc0a2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:06.618 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.613+0000 7fdcd2064700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdccc066db0 0x7fdccc14c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:06.619 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.613+0000 7fdcd2064700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdccc0b8e60 0x7fdccc15dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:06.619 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.613+0000 7fdcd2064700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc153e50 con 0x7fdccc066db0 2021-01-27T09:47:06.619 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.613+0000 7fdcd2064700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc14cd30 con 0x7fdccc062c80 2021-01-27T09:47:06.619 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.613+0000 7fdcd2064700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc0a3120 con 0x7fdccc0b8e60 2021-01-27T09:47:06.619 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.617+0000 7fdccb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdccc062c80 0x7fdccc0a2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:06.620 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.617+0000 7fdccb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdccc062c80 0x7fdccc0a2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48082/0 (socket says 172.21.15.146:48082) 2021-01-27T09:47:06.620 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.617+0000 7fdccb7fe700 1 -- 172.21.15.146:0/1831987900 learned_addr learned my addr 172.21.15.146:0/1831987900 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:47:06.620 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.617+0000 7fdccbfff700 1 --2- 172.21.15.146:0/1831987900 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdccc0b8e60 0x7fdccc15dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:06.620 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.617+0000 7fdccaffd700 1 --2- 172.21.15.146:0/1831987900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdccc066db0 0x7fdccc14c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:06.620 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.617+0000 7fdccb7fe700 1 -- 172.21.15.146:0/1831987900 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdccc0b8e60 msgr2=0x7fdccc15dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:06.621 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.617+0000 7fdccb7fe700 1 --2- 172.21.15.146:0/1831987900 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdccc0b8e60 0x7fdccc15dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:06.621 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.617+0000 7fdccb7fe700 1 -- 172.21.15.146:0/1831987900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdccc066db0 msgr2=0x7fdccc14c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:06.621 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.617+0000 7fdccb7fe700 1 --2- 172.21.15.146:0/1831987900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdccc066db0 0x7fdccc14c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:06.621 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.617+0000 7fdccb7fe700 1 -- 172.21.15.146:0/1831987900 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc14cfc0 con 0x7fdccc062c80 2021-01-27T09:47:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.617+0000 7fdccb7fe700 1 --2- 172.21.15.146:0/1831987900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdccc062c80 0x7fdccc0a2ad0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fdcbc00cb50 tx=0x7fdcbc008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:47:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.617+0000 7fdcb37fe700 1 -- 172.21.15.146:0/1831987900 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc015070 con 0x7fdccc062c80 2021-01-27T09:47:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.617+0000 7fdcb37fe700 1 -- 172.21.15.146:0/1831987900 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc00ce60 con 0x7fdccc062c80 2021-01-27T09:47:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.617+0000 7fdcd2064700 1 -- 172.21.15.146:0/1831987900 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdccc14d260 con 0x7fdccc062c80 2021-01-27T09:47:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.617+0000 7fdcb37fe700 1 -- 172.21.15.146:0/1831987900 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc007950 con 0x7fdccc062c80 2021-01-27T09:47:06.623 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.617+0000 7fdcd2064700 1 -- 172.21.15.146:0/1831987900 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdccc154080 con 0x7fdccc062c80 2021-01-27T09:47:06.623 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.617+0000 7fdcd2064700 1 -- 172.21.15.146:0/1831987900 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdccc15dfb0 con 0x7fdccc062c80 2021-01-27T09:47:06.624 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.617+0000 7fdcb37fe700 1 -- 172.21.15.146:0/1831987900 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fdcbc007d40 con 0x7fdccc062c80 2021-01-27T09:47:06.624 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.621+0000 7fdcb37fe700 1 --2- 172.21.15.146:0/1831987900 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fdcac0561b0 0x7fdcac058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:06.624 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.621+0000 7fdcb37fe700 1 -- 172.21.15.146:0/1831987900 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6911+0+0 (secure 0 0 0) 0x7fdcbc06f2a0 con 0x7fdccc062c80 2021-01-27T09:47:06.624 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.621+0000 7fdccaffd700 1 --2- 172.21.15.146:0/1831987900 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fdcac0561b0 0x7fdcac058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:06.625 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.621+0000 7fdccaffd700 1 --2- 172.21.15.146:0/1831987900 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fdcac0561b0 0x7fdcac058670 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fdccc152cc0 tx=0x7fdcc0007ba0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:47:06.626 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.625+0000 7fdcb37fe700 1 -- 172.21.15.146:0/1831987900 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fdcbc044900 con 0x7fdccc062c80 2021-01-27T09:47:06.800 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.801+0000 7fdcd2064700 1 -- 172.21.15.146:0/1831987900 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdccc0b6000 con 0x7fdccc062c80 2021-01-27T09:47:06.801 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.801+0000 7fdcb37fe700 1 -- 172.21.15.146:0/1831987900 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3225 (secure 0 0 0) 0x7fdcbc047f20 con 0x7fdccc062c80 2021-01-27T09:47:06.801 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:47:06.802 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:47:04.638114+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":2,"incarnation":15,"state":"up:active","state_seq":43,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:47:06.804 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.801+0000 7fdcd2064700 1 -- 172.21.15.146:0/1831987900 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fdcac0561b0 msgr2=0x7fdcac058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:06.804 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.801+0000 7fdcd2064700 1 --2- 172.21.15.146:0/1831987900 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fdcac0561b0 0x7fdcac058670 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fdccc152cc0 tx=0x7fdcc0007ba0).stop 2021-01-27T09:47:06.804 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.801+0000 7fdcd2064700 1 -- 172.21.15.146:0/1831987900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdccc062c80 msgr2=0x7fdccc0a2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:06.804 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.801+0000 7fdcd2064700 1 --2- 172.21.15.146:0/1831987900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdccc062c80 0x7fdccc0a2ad0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fdcbc00cb50 tx=0x7fdcbc008040).stop 2021-01-27T09:47:06.805 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.801+0000 7fdcd2064700 1 -- 172.21.15.146:0/1831987900 shutdown_connections 2021-01-27T09:47:06.805 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.801+0000 7fdcd2064700 1 --2- 172.21.15.146:0/1831987900 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdccc0b8e60 0x7fdccc15dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:06.805 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.801+0000 7fdcd2064700 1 --2- 172.21.15.146:0/1831987900 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdccc066db0 0x7fdccc14c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:06.805 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.801+0000 7fdcd2064700 1 --2- 172.21.15.146:0/1831987900 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fdcac0561b0 0x7fdcac058670 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:06.806 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.801+0000 7fdcd2064700 1 --2- 172.21.15.146:0/1831987900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdccc062c80 0x7fdccc0a2ad0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:06.806 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.801+0000 7fdcd2064700 1 -- 172.21.15.146:0/1831987900 >> 172.21.15.146:0/1831987900 conn(0x7fdccc067e60 msgr2=0x7fdccc14f330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:47:06.806 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.801+0000 7fdcd2064700 1 -- 172.21.15.146:0/1831987900 shutdown_connections 2021-01-27T09:47:06.806 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:06.801+0000 7fdcd2064700 1 -- 172.21.15.146:0/1831987900 wait complete. 2021-01-27T09:47:06.807 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 19 2021-01-27T09:47:06.829 INFO:tasks.mds_thrash.fs.[cephfs]:mds.a has gained rank=2, replacing gid=4241 2021-01-27T09:47:06.829 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 4 secs before reviving mds.e 2021-01-27T09:47:10.135 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:47:10.139 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:47:10.830 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.e 2021-01-27T09:47:10.833 INFO:tasks.ceph.mds.e:Restarting daemon 2021-01-27T09:47:10.834 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2021-01-27T09:47:10.839 INFO:tasks.ceph.mds.e:Started 2021-01-27T09:47:10.839 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:47:11.262 INFO:tasks.ceph.mds.e.smithi146.stdout:starting mds.e at 2021-01-27T09:47:11.348 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.305+0000 7f7a0f59e700 1 Processor -- start 2021-01-27T09:47:11.348 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.305+0000 7f7a0f59e700 1 -- start start 2021-01-27T09:47:11.348 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.313+0000 7f7a0f59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7a10069110 0x7f7a100bece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:11.349 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.313+0000 7f7a0f59e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a100ae7f0 con 0x7f7a100652e0 2021-01-27T09:47:11.349 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.313+0000 7f7a0f59e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a100aea90 con 0x7f7a10064f00 2021-01-27T09:47:11.349 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.313+0000 7f7a0f59e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a100be110 con 0x7f7a10069110 2021-01-27T09:47:11.349 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.313+0000 7f7a0dd9b700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7a100652e0 0x7f7a101630e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:35736/0 (socket says 172.21.15.146:35736) 2021-01-27T09:47:11.350 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.313+0000 7f7a0dd9b700 1 -- 172.21.15.146:0/1101141248 learned_addr learned my addr 172.21.15.146:0/1101141248 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:47:11.350 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.313+0000 7f7a0ed9d700 1 --2- 172.21.15.146:0/1101141248 >> v2:172.21.15.146:3300/0 conn(0x7f7a10069110 0x7f7a100bece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:11.351 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.313+0000 7f7a0ed9d700 1 -- 172.21.15.146:0/1101141248 >> v1:172.21.15.146:6789/0 conn(0x7f7a10064f00 legacy=0x7f7a10080380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:11.351 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.345+0000 7f7a0ed9d700 1 -- 172.21.15.146:0/1101141248 >> v1:172.21.15.78:6789/0 conn(0x7f7a100652e0 legacy=0x7f7a101630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:11.351 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.349+0000 7f7a0ed9d700 1 -- 172.21.15.146:0/1101141248 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a100be300 con 0x7f7a10069110 2021-01-27T09:47:11.351 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.349+0000 7f7a0ed9d700 1 --2- 172.21.15.146:0/1101141248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a10069110 0x7f7a100bece0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f7a08009c40 tx=0x7f7a08009220).ready entity=mon.1 client_cookie=6734027d7250a2f server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:47:11.352 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.313+0000 7f7a0d59a700 1 -- 172.21.15.146:0/1101141248 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464801812 0 0) 0x7f7a100ae7f0 con 0x7f7a100652e0 2021-01-27T09:47:11.352 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.349+0000 7f7a0d59a700 1 -- 172.21.15.146:0/1101141248 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0800b960 con 0x7f7a10069110 2021-01-27T09:47:11.352 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.349+0000 7f7a0d59a700 1 -- 172.21.15.146:0/1101141248 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0800bac0 con 0x7f7a10069110 2021-01-27T09:47:11.356 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.353+0000 7f7a0f59e700 1 -- 172.21.15.146:0/1101141248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a10069110 msgr2=0x7f7a100bece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:11.356 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.353+0000 7f7a0f59e700 1 --2- 172.21.15.146:0/1101141248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a10069110 0x7f7a100bece0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f7a08009c40 tx=0x7f7a08009220).stop 2021-01-27T09:47:11.357 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.357+0000 7f7a0f59e700 1 -- 172.21.15.146:0/1101141248 shutdown_connections 2021-01-27T09:47:11.357 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.357+0000 7f7a0f59e700 1 --2- 172.21.15.146:0/1101141248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a10069110 0x7f7a100bece0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:11.357 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.357+0000 7f7a0f59e700 1 -- 172.21.15.146:0/1101141248 >> 172.21.15.146:0/1101141248 conn(0x7f7a10060a30 msgr2=0x7f7a10065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:47:11.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.369+0000 7f7a0f59e700 1 -- 172.21.15.146:0/1101141248 shutdown_connections 2021-01-27T09:47:11.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.369+0000 7f7a0f59e700 1 -- 172.21.15.146:0/1101141248 wait complete. 2021-01-27T09:47:11.374 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.373+0000 7f7a0f59e700 1 Processor -- start 2021-01-27T09:47:11.375 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.373+0000 7f7a0f59e700 1 -- start start 2021-01-27T09:47:11.376 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.377+0000 7f7a0f59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a10064f00 0x7f7a1017b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:11.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.377+0000 7f7a0f59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a100652e0 0x7f7a10161440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:11.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.377+0000 7f7a0f59e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a10069110 0x7f7a10161930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:11.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.377+0000 7f7a0f59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1017bc00 con 0x7f7a100652e0 2021-01-27T09:47:11.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.377+0000 7f7a0f59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a10080650 con 0x7f7a10064f00 2021-01-27T09:47:11.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.377+0000 7f7a0e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a10064f00 0x7f7a1017b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:11.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.377+0000 7f7a0ed9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a10069110 0x7f7a10161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:11.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.377+0000 7f7a0e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a10064f00 0x7f7a1017b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48136/0 (socket says 172.21.15.146:48136) 2021-01-27T09:47:11.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.377+0000 7f7a0e59c700 1 -- 172.21.15.146:0/2026470922 learned_addr learned my addr 172.21.15.146:0/2026470922 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:47:11.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.377+0000 7f7a0f59e700 1 -- 172.21.15.146:0/2026470922 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1015b3e0 con 0x7f7a10069110 2021-01-27T09:47:11.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.377+0000 7f7a0e59c700 1 -- 172.21.15.146:0/2026470922 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a10069110 msgr2=0x7f7a10161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.377+0000 7f7a0e59c700 1 --2- 172.21.15.146:0/2026470922 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a10069110 0x7f7a10161930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.377+0000 7f7a0e59c700 1 -- 172.21.15.146:0/2026470922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a100652e0 msgr2=0x7f7a10161440 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-01-27T09:47:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.377+0000 7f7a0e59c700 1 --2- 172.21.15.146:0/2026470922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a100652e0 0x7f7a10161440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:47:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.377+0000 7f7a0e59c700 1 -- 172.21.15.146:0/2026470922 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1015f820 con 0x7f7a10064f00 2021-01-27T09:47:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.377+0000 7f7a0e59c700 1 --2- 172.21.15.146:0/2026470922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a10064f00 0x7f7a1017b710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f7a0000c730 tx=0x7f7a00007c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:47:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.381+0000 7f79fe7fc700 1 -- 172.21.15.146:0/2026470922 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a00007020 con 0x7f7a10064f00 2021-01-27T09:47:11.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.381+0000 7f79fe7fc700 1 -- 172.21.15.146:0/2026470922 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a00007180 con 0x7f7a10064f00 2021-01-27T09:47:11.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.381+0000 7f7a0f59e700 1 -- 172.21.15.146:0/2026470922 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1015fac0 con 0x7f7a10064f00 2021-01-27T09:47:11.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.381+0000 7f79fe7fc700 1 -- 172.21.15.146:0/2026470922 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a00006520 con 0x7f7a10064f00 2021-01-27T09:47:11.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.381+0000 7f7a0f59e700 1 -- 172.21.15.146:0/2026470922 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a10160000 con 0x7f7a10064f00 2021-01-27T09:47:11.391 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.389+0000 7f79fe7fc700 1 -- 172.21.15.146:0/2026470922 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f7a00018020 con 0x7f7a10064f00 2021-01-27T09:47:11.400 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.401+0000 7f7a0f59e700 1 -- 172.21.15.146:0/2026470922 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a10044680 con 0x7f7a10064f00 2021-01-27T09:47:11.410 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.409+0000 7f79fe7fc700 1 --2- 172.21.15.146:0/2026470922 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f79f4056200 0x7f79f40586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:47:11.411 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.409+0000 7f79fe7fc700 1 -- 172.21.15.146:0/2026470922 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6911+0+0 (secure 0 0 0) 0x7f7a0006f000 con 0x7f7a10064f00 2021-01-27T09:47:11.411 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.409+0000 7f7a0dd9b700 1 --2- 172.21.15.146:0/2026470922 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f79f4056200 0x7f79f40586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:47:11.411 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.409+0000 7f79fe7fc700 1 -- 172.21.15.146:0/2026470922 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f7a00073580 con 0x7f7a10064f00 2021-01-27T09:47:11.420 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.413+0000 7f7a0dd9b700 1 --2- 172.21.15.146:0/2026470922 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f79f4056200 0x7f79f40586c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f7a040055d0 tx=0x7f7a040076d0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:47:11.982 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.981+0000 7f7a0f59e700 1 -- 172.21.15.146:0/2026470922 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a10063890 con 0x7f7a10064f00 2021-01-27T09:47:11.984 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.985+0000 7f79fe7fc700 1 -- 172.21.15.146:0/2026470922 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3581 (secure 0 0 0) 0x7f7a000445d0 con 0x7f7a10064f00 2021-01-27T09:47:11.996 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:47:11.997 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4971,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:47:04.638114+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":2,"incarnation":15,"state":"up:active","state_seq":43,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:47:12.000 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:11.997+0000 7f7a0f59e700 1 -- 172.21.15.146:0/2026470922 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f79f4056200 msgr2=0x7f79f40586c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:12.000 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:12.001+0000 7f7a0f59e700 1 --2- 172.21.15.146:0/2026470922 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f79f4056200 0x7f79f40586c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f7a040055d0 tx=0x7f7a040076d0).stop 2021-01-27T09:47:12.000 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:12.001+0000 7f7a0f59e700 1 -- 172.21.15.146:0/2026470922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a10064f00 msgr2=0x7f7a1017b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:47:12.001 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:12.001+0000 7f7a0f59e700 1 --2- 172.21.15.146:0/2026470922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a10064f00 0x7f7a1017b710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f7a0000c730 tx=0x7f7a00007c80).stop 2021-01-27T09:47:12.001 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:12.001+0000 7f7a0f59e700 1 -- 172.21.15.146:0/2026470922 shutdown_connections 2021-01-27T09:47:12.002 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:12.001+0000 7f7a0f59e700 1 --2- 172.21.15.146:0/2026470922 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a10069110 0x7f7a10161930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:12.002 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:12.001+0000 7f7a0f59e700 1 --2- 172.21.15.146:0/2026470922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a100652e0 0x7f7a10161440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:47:12.002 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:12.001+0000 7f7a0f59e700 1 --2- 172.21.15.146:0/2026470922 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f79f4056200 0x7f79f40586c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:12.001+0000 7f7a0f59e700 1 --2- 172.21.15.146:0/2026470922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a10064f00 0x7f7a1017b710 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:47:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:12.001+0000 7f7a0f59e700 1 -- 172.21.15.146:0/2026470922 >> 172.21.15.146:0/2026470922 conn(0x7f7a10060a30 msgr2=0x7f7a100668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:47:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:12.001+0000 7f7a0f59e700 1 -- 172.21.15.146:0/2026470922 shutdown_connections 2021-01-27T09:47:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:47:12.001+0000 7f7a0f59e700 1 -- 172.21.15.146:0/2026470922 wait complete. 2021-01-27T09:47:12.015 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 20 2021-01-27T09:47:12.063 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e reported in up:standby state 2021-01-27T09:47:12.064 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 107 secs before thrashing 2021-01-27T09:47:15.677 INFO:tasks.workunit.client.0.smithi146.stdout:fs setup took 57 secs 2021-01-27T09:47:17.340 INFO:tasks.workunit.client.0.smithi146.stdout:Syncing()...1 sec 2021-01-27T09:47:17.342 INFO:tasks.workunit.client.0.smithi146.stdout:Starting Actual Benchmark At: Wed Jan 27 09:47:17 2021 2021-01-27T09:47:17.343 INFO:tasks.workunit.client.0.smithi146.stdout: 2021-01-27T09:47:40.199 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:47:40.201 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:48:12.782 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:48:12.786 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:48:43.356 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:48:43.359 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:48:59.065 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:48:59.337 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.321+0000 7ff2780e8700 1 Processor -- start 2021-01-27T09:48:59.338 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.337+0000 7ff2780e8700 1 -- start start 2021-01-27T09:48:59.347 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.341+0000 7ff2780e8700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff2700692b0 0x7ff2700acf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:48:59.348 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.341+0000 7ff2780e8700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff270060e20 0x7ff270147840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:48:59.348 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.341+0000 7ff2780e8700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2700676a0 con 0x7ff270066950 2021-01-27T09:48:59.348 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.341+0000 7ff2780e8700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2700ae210 con 0x7ff270060e20 2021-01-27T09:48:59.348 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.341+0000 7ff2780e8700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2700ae790 con 0x7ff2700692b0 2021-01-27T09:48:59.349 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.341+0000 7ff275683700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff270066950 0x7ff270060700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:38600/0 (socket says 172.21.15.146:38600) 2021-01-27T09:48:59.349 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.341+0000 7ff275683700 1 -- 172.21.15.146:0/2388382361 learned_addr learned my addr 172.21.15.146:0/2388382361 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:48:59.349 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.341+0000 7ff275e84700 1 --2- 172.21.15.146:0/2388382361 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff2700692b0 0x7ff2700acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:48:59.349 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.341+0000 7ff274e82700 1 -- 172.21.15.146:0/2388382361 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674360234 0 0) 0x7ff2700676a0 con 0x7ff270066950 2021-01-27T09:48:59.349 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.341+0000 7ff274e82700 1 -- 172.21.15.146:0/2388382361 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff258003270 con 0x7ff270066950 2021-01-27T09:48:59.350 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.341+0000 7ff275e84700 1 -- 172.21.15.146:0/2388382361 >> v2:172.21.15.78:3300/0 conn(0x7ff270060e20 msgr2=0x7ff270147840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:48:59.350 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.341+0000 7ff275e84700 1 --2- 172.21.15.146:0/2388382361 >> v2:172.21.15.78:3300/0 conn(0x7ff270060e20 0x7ff270147840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:48:59.350 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.341+0000 7ff275e84700 1 -- 172.21.15.146:0/2388382361 >> v1:172.21.15.78:6789/0 conn(0x7ff270066950 legacy=0x7ff270060700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:48:59.351 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.341+0000 7ff275e84700 1 -- 172.21.15.146:0/2388382361 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff270067940 con 0x7ff2700692b0 2021-01-27T09:48:59.351 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.341+0000 7ff275e84700 1 --2- 172.21.15.146:0/2388382361 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff2700692b0 0x7ff2700acf10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7ff268009cc0 tx=0x7ff268009220).ready entity=mon.2 client_cookie=6855c8958e722efb server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:48:59.351 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.341+0000 7ff274e82700 1 -- 172.21.15.146:0/2388382361 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26800baa0 con 0x7ff2700692b0 2021-01-27T09:48:59.351 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.341+0000 7ff274e82700 1 -- 172.21.15.146:0/2388382361 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26800bc00 con 0x7ff2700692b0 2021-01-27T09:48:59.351 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.341+0000 7ff274e82700 1 -- 172.21.15.146:0/2388382361 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff268011400 con 0x7ff2700692b0 2021-01-27T09:48:59.352 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.345+0000 7ff2780e8700 1 -- 172.21.15.146:0/2388382361 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff2700692b0 msgr2=0x7ff2700acf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:48:59.352 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.345+0000 7ff2780e8700 1 --2- 172.21.15.146:0/2388382361 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff2700692b0 0x7ff2700acf10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7ff268009cc0 tx=0x7ff268009220).stop 2021-01-27T09:48:59.352 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.349+0000 7ff2780e8700 1 -- 172.21.15.146:0/2388382361 shutdown_connections 2021-01-27T09:48:59.352 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.349+0000 7ff2780e8700 1 --2- 172.21.15.146:0/2388382361 >> v2:172.21.15.78:3300/0 conn(0x7ff270060e20 0x7ff270147840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:48:59.352 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.349+0000 7ff2780e8700 1 --2- 172.21.15.146:0/2388382361 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff2700692b0 0x7ff2700acf10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:48:59.353 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.349+0000 7ff2780e8700 1 -- 172.21.15.146:0/2388382361 >> 172.21.15.146:0/2388382361 conn(0x7ff270065f60 msgr2=0x7ff270067ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:48:59.353 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.349+0000 7ff2780e8700 1 -- 172.21.15.146:0/2388382361 shutdown_connections 2021-01-27T09:48:59.358 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.349+0000 7ff2780e8700 1 -- 172.21.15.146:0/2388382361 wait complete. 2021-01-27T09:48:59.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.361+0000 7ff2780e8700 1 Processor -- start 2021-01-27T09:48:59.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.361+0000 7ff2780e8700 1 -- start start 2021-01-27T09:48:59.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.361+0000 7ff2780e8700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff270060e20 0x7ff27014ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:48:59.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.365+0000 7ff2780e8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff270066950 0x7ff2701486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:48:59.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.365+0000 7ff275e84700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff270060e20 0x7ff27014ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:48:59.373 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.365+0000 7ff275e84700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff270060e20 0x7ff27014ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:40484/0 (socket says 172.21.15.146:40484) 2021-01-27T09:48:59.373 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.365+0000 7ff275e84700 1 -- 172.21.15.146:0/56375490 learned_addr learned my addr 172.21.15.146:0/56375490 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:48:59.373 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.365+0000 7ff2780e8700 1 --2- 172.21.15.146:0/56375490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2700692b0 0x7ff270160fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:48:59.373 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.365+0000 7ff276685700 1 --2- 172.21.15.146:0/56375490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2700692b0 0x7ff270160fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:48:59.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.365+0000 7ff275683700 1 --2- 172.21.15.146:0/56375490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff270066950 0x7ff2701486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:48:59.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.365+0000 7ff2780e8700 1 -- 172.21.15.146:0/56375490 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff270148be0 con 0x7ff2700692b0 2021-01-27T09:48:59.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.365+0000 7ff2780e8700 1 -- 172.21.15.146:0/56375490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27014b3d0 con 0x7ff270066950 2021-01-27T09:48:59.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.365+0000 7ff2780e8700 1 -- 172.21.15.146:0/56375490 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff270150170 con 0x7ff270060e20 2021-01-27T09:48:59.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.365+0000 7ff276685700 1 -- 172.21.15.146:0/56375490 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff270060e20 msgr2=0x7ff27014ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:48:59.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.365+0000 7ff276685700 1 --2- 172.21.15.146:0/56375490 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff270060e20 0x7ff27014ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:48:59.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.365+0000 7ff276685700 1 -- 172.21.15.146:0/56375490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff270066950 msgr2=0x7ff2701486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:48:59.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.365+0000 7ff276685700 1 --2- 172.21.15.146:0/56375490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff270066950 0x7ff2701486f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:48:59.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.365+0000 7ff276685700 1 -- 172.21.15.146:0/56375490 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff270150410 con 0x7ff2700692b0 2021-01-27T09:48:59.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.365+0000 7ff276685700 1 --2- 172.21.15.146:0/56375490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2700692b0 0x7ff270160fb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7ff2700bf2f0 tx=0x7ff26c006c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:48:59.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.365+0000 7ff25dffb700 1 -- 172.21.15.146:0/56375490 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c002320 con 0x7ff2700692b0 2021-01-27T09:48:59.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.365+0000 7ff25dffb700 1 -- 172.21.15.146:0/56375490 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26c002480 con 0x7ff2700692b0 2021-01-27T09:48:59.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.365+0000 7ff25dffb700 1 -- 172.21.15.146:0/56375490 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c002820 con 0x7ff2700692b0 2021-01-27T09:48:59.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.365+0000 7ff2780e8700 1 -- 172.21.15.146:0/56375490 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2701506b0 con 0x7ff2700692b0 2021-01-27T09:48:59.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.369+0000 7ff2780e8700 1 -- 172.21.15.146:0/56375490 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2701614a0 con 0x7ff2700692b0 2021-01-27T09:48:59.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.369+0000 7ff2780e8700 1 -- 172.21.15.146:0/56375490 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff270150840 con 0x7ff2700692b0 2021-01-27T09:48:59.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.369+0000 7ff25dffb700 1 -- 172.21.15.146:0/56375490 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7ff26c00f030 con 0x7ff2700692b0 2021-01-27T09:48:59.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.369+0000 7ff25dffb700 1 --2- 172.21.15.146:0/56375490 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff250056200 0x7ff2500586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:48:59.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.369+0000 7ff25dffb700 1 -- 172.21.15.146:0/56375490 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6911+0+0 (secure 0 0 0) 0x7ff26c06f080 con 0x7ff2700692b0 2021-01-27T09:48:59.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.373+0000 7ff275e84700 1 --2- 172.21.15.146:0/56375490 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff250056200 0x7ff2500586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:48:59.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.373+0000 7ff275e84700 1 --2- 172.21.15.146:0/56375490 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff250056200 0x7ff2500586c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7ff26800b860 tx=0x7ff268017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:48:59.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.381+0000 7ff25dffb700 1 -- 172.21.15.146:0/56375490 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7ff26c09a2d0 con 0x7ff2700692b0 2021-01-27T09:48:59.719 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.721+0000 7ff2780e8700 1 -- 172.21.15.146:0/56375490 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff270069980 con 0x7ff2700692b0 2021-01-27T09:48:59.721 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.721+0000 7ff25dffb700 1 -- 172.21.15.146:0/56375490 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3583 (secure 0 0 0) 0x7ff26c044650 con 0x7ff2700692b0 2021-01-27T09:48:59.722 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:48:59.722 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4971,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:47:16.693281+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":2,"incarnation":15,"state":"up:active","state_seq":43,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:48:59.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.725+0000 7ff2780e8700 1 -- 172.21.15.146:0/56375490 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff250056200 msgr2=0x7ff2500586c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:48:59.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.725+0000 7ff2780e8700 1 --2- 172.21.15.146:0/56375490 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff250056200 0x7ff2500586c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7ff26800b860 tx=0x7ff268017000).stop 2021-01-27T09:48:59.726 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.725+0000 7ff2780e8700 1 -- 172.21.15.146:0/56375490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2700692b0 msgr2=0x7ff270160fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:48:59.726 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.725+0000 7ff2780e8700 1 --2- 172.21.15.146:0/56375490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2700692b0 0x7ff270160fb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7ff2700bf2f0 tx=0x7ff26c006c50).stop 2021-01-27T09:48:59.726 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.725+0000 7ff2780e8700 1 -- 172.21.15.146:0/56375490 shutdown_connections 2021-01-27T09:48:59.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.725+0000 7ff2780e8700 1 --2- 172.21.15.146:0/56375490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2700692b0 0x7ff270160fb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:48:59.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.725+0000 7ff2780e8700 1 --2- 172.21.15.146:0/56375490 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff250056200 0x7ff2500586c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:48:59.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.725+0000 7ff2780e8700 1 --2- 172.21.15.146:0/56375490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff270066950 0x7ff2701486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:48:59.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.725+0000 7ff2780e8700 1 --2- 172.21.15.146:0/56375490 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff270060e20 0x7ff27014ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:48:59.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.725+0000 7ff2780e8700 1 -- 172.21.15.146:0/56375490 >> 172.21.15.146:0/56375490 conn(0x7ff270065f60 msgr2=0x7ff2700627f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:48:59.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.729+0000 7ff2780e8700 1 -- 172.21.15.146:0/56375490 shutdown_connections 2021-01-27T09:48:59.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:48:59.729+0000 7ff2780e8700 1 -- 172.21.15.146:0/56375490 wait complete. 2021-01-27T09:48:59.738 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 21 2021-01-27T09:48:59.763 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.a (rank=2) 2021-01-27T09:48:59.763 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-01-27T09:48:59.763 INFO:teuthology.orchestra.run:waiting for 300 2021-01-27T09:48:59.801 INFO:tasks.ceph.mds.a:Stopped 2021-01-27T09:48:59.801 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:49:00.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.017+0000 7fb94b59e700 1 Processor -- start 2021-01-27T09:49:00.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.017+0000 7fb94b59e700 1 -- start start 2021-01-27T09:49:00.019 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.021+0000 7fb94b59e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb94c064f00 0x7fb94c0be110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:00.019 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.021+0000 7fb94b59e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb94c0652e0 0x7fb94c14c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:00.019 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.021+0000 7fb94b59e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb94c0b0e70 con 0x7fb94c067500 2021-01-27T09:49:00.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.021+0000 7fb94b59e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb94c0b0690 con 0x7fb94c0652e0 2021-01-27T09:49:00.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.021+0000 7fb94b59e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c0b0930 con 0x7fb94c064f00 2021-01-27T09:49:00.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.021+0000 7fb949d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb94c0652e0 0x7fb94c14c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:00.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.021+0000 7fb949d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb94c0652e0 0x7fb94c14c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:53898/0 (socket says 172.21.15.146:53898) 2021-01-27T09:49:00.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.021+0000 7fb949d9b700 1 -- 172.21.15.146:0/2757639352 learned_addr learned my addr 172.21.15.146:0/2757639352 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:49:00.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.021+0000 7fb949d9b700 1 -- 172.21.15.146:0/2757639352 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb94c064f00 msgr2=0x7fb94c0be110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-01-27T09:49:00.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.021+0000 7fb949d9b700 1 --2- 172.21.15.146:0/2757639352 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb94c064f00 0x7fb94c0be110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:00.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.021+0000 7fb949d9b700 1 -- 172.21.15.146:0/2757639352 >> v1:172.21.15.146:6789/0 conn(0x7fb94c067500 legacy=0x7fb94c145370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:49:00.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.021+0000 7fb949d9b700 1 -- 172.21.15.146:0/2757639352 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c0b0bd0 con 0x7fb94c0652e0 2021-01-27T09:49:00.023 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.021+0000 7fb949d9b700 1 --2- 172.21.15.146:0/2757639352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb94c0652e0 0x7fb94c14c4e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fb94000ba20 tx=0x7fb940006ee0).ready entity=mon.0 client_cookie=d1e4dce6493535eb server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:00.023 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.021+0000 7fb94959a700 1 -- 172.21.15.146:0/2757639352 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb940009890 con 0x7fb94c0652e0 2021-01-27T09:49:00.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.021+0000 7fb94959a700 1 -- 172.21.15.146:0/2757639352 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9400099f0 con 0x7fb94c0652e0 2021-01-27T09:49:00.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.021+0000 7fb94959a700 1 -- 172.21.15.146:0/2757639352 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb940009d70 con 0x7fb94c0652e0 2021-01-27T09:49:00.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.021+0000 7fb94b59e700 1 -- 172.21.15.146:0/2757639352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb94c0652e0 msgr2=0x7fb94c14c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:00.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.021+0000 7fb94b59e700 1 --2- 172.21.15.146:0/2757639352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb94c0652e0 0x7fb94c14c4e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fb94000ba20 tx=0x7fb940006ee0).stop 2021-01-27T09:49:00.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.025+0000 7fb94b59e700 1 -- 172.21.15.146:0/2757639352 shutdown_connections 2021-01-27T09:49:00.026 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.025+0000 7fb94b59e700 1 --2- 172.21.15.146:0/2757639352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb94c0652e0 0x7fb94c14c4e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:00.026 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.025+0000 7fb94b59e700 1 --2- 172.21.15.146:0/2757639352 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb94c064f00 0x7fb94c0be110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:00.027 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.025+0000 7fb94b59e700 1 -- 172.21.15.146:0/2757639352 >> 172.21.15.146:0/2757639352 conn(0x7fb94c060a30 msgr2=0x7fb94c065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:00.027 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.029+0000 7fb94b59e700 1 -- 172.21.15.146:0/2757639352 shutdown_connections 2021-01-27T09:49:00.032 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.033+0000 7fb94b59e700 1 -- 172.21.15.146:0/2757639352 wait complete. 2021-01-27T09:49:00.034 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.033+0000 7fb94b59e700 1 Processor -- start 2021-01-27T09:49:00.034 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.033+0000 7fb94b59e700 1 -- start start 2021-01-27T09:49:00.036 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.037+0000 7fb94b59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb94c064f00 0x7fb94c14d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:00.038 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.037+0000 7fb94b59e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb94c0652e0 0x7fb94c0bad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:00.038 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.037+0000 7fb94b59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb94c067500 0x7fb94c136840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:00.038 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.037+0000 7fb94a59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb94c064f00 0x7fb94c14d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:00.039 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.037+0000 7fb94a59c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb94c064f00 0x7fb94c14d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:53904/0 (socket says 172.21.15.146:53904) 2021-01-27T09:49:00.039 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.037+0000 7fb94a59c700 1 -- 172.21.15.146:0/3193712204 learned_addr learned my addr 172.21.15.146:0/3193712204 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:49:00.039 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.037+0000 7fb94b59e700 1 -- 172.21.15.146:0/3193712204 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c0bc390 con 0x7fb94c064f00 2021-01-27T09:49:00.039 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.037+0000 7fb94b59e700 1 -- 172.21.15.146:0/3193712204 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c147000 con 0x7fb94c067500 2021-01-27T09:49:00.039 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.037+0000 7fb94b59e700 1 -- 172.21.15.146:0/3193712204 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c0bdb10 con 0x7fb94c0652e0 2021-01-27T09:49:00.040 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.041+0000 7fb949d9b700 1 --2- 172.21.15.146:0/3193712204 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb94c0652e0 0x7fb94c0bad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:00.040 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.041+0000 7fb94ad9d700 1 --2- 172.21.15.146:0/3193712204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb94c067500 0x7fb94c136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:00.041 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.041+0000 7fb94ad9d700 1 -- 172.21.15.146:0/3193712204 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb94c0652e0 msgr2=0x7fb94c0bad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:00.041 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.041+0000 7fb94ad9d700 1 --2- 172.21.15.146:0/3193712204 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb94c0652e0 0x7fb94c0bad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:00.041 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.041+0000 7fb94ad9d700 1 -- 172.21.15.146:0/3193712204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb94c064f00 msgr2=0x7fb94c14d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:00.041 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.041+0000 7fb94ad9d700 1 --2- 172.21.15.146:0/3193712204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb94c064f00 0x7fb94c14d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:00.042 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.041+0000 7fb94ad9d700 1 -- 172.21.15.146:0/3193712204 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c146ac0 con 0x7fb94c067500 2021-01-27T09:49:00.042 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.041+0000 7fb94a59c700 1 --2- 172.21.15.146:0/3193712204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb94c064f00 0x7fb94c14d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:49:00.043 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.041+0000 7fb94ad9d700 1 --2- 172.21.15.146:0/3193712204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb94c067500 0x7fb94c136840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fb93c0096e0 tx=0x7fb93c006c60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:00.044 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.045+0000 7fb93a7fc700 1 -- 172.21.15.146:0/3193712204 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c012410 con 0x7fb94c067500 2021-01-27T09:49:00.044 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.045+0000 7fb93a7fc700 1 -- 172.21.15.146:0/3193712204 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93c012570 con 0x7fb94c067500 2021-01-27T09:49:00.044 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.045+0000 7fb94b59e700 1 -- 172.21.15.146:0/3193712204 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb94c146d60 con 0x7fb94c067500 2021-01-27T09:49:00.045 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.045+0000 7fb93a7fc700 1 -- 172.21.15.146:0/3193712204 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c012910 con 0x7fb94c067500 2021-01-27T09:49:00.045 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.045+0000 7fb94b59e700 1 -- 172.21.15.146:0/3193712204 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94c147c60 con 0x7fb94c067500 2021-01-27T09:49:00.045 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.045+0000 7fb94b59e700 1 -- 172.21.15.146:0/3193712204 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94c044680 con 0x7fb94c067500 2021-01-27T09:49:00.046 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.049+0000 7fb93a7fc700 1 -- 172.21.15.146:0/3193712204 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fb93c00f030 con 0x7fb94c067500 2021-01-27T09:49:00.047 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.049+0000 7fb93a7fc700 1 --2- 172.21.15.146:0/3193712204 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fb928056230 0x7fb9280586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:00.047 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.049+0000 7fb93a7fc700 1 -- 172.21.15.146:0/3193712204 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6911+0+0 (secure 0 0 0) 0x7fb93c06f0a0 con 0x7fb94c067500 2021-01-27T09:49:00.054 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.057+0000 7fb94a59c700 1 --2- 172.21.15.146:0/3193712204 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fb928056230 0x7fb9280586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:00.055 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.057+0000 7fb93a7fc700 1 -- 172.21.15.146:0/3193712204 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fb93c044700 con 0x7fb94c067500 2021-01-27T09:49:00.055 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.057+0000 7fb94a59c700 1 --2- 172.21.15.146:0/3193712204 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fb928056230 0x7fb9280586f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fb944001410 tx=0x7fb944009220).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:00.417 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.417+0000 7fb94b59e700 1 -- 172.21.15.146:0/3193712204 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb94c0bb200 con 0x7fb94c067500 2021-01-27T09:49:00.418 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.417+0000 7fb93a7fc700 1 -- 172.21.15.146:0/3193712204 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3583 (secure 0 0 0) 0x7fb93c047d20 con 0x7fb94c067500 2021-01-27T09:49:00.418 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:49:00.419 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4971,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:47:16.693281+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":2,"incarnation":15,"state":"up:active","state_seq":43,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:49:00.421 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.421+0000 7fb94b59e700 1 -- 172.21.15.146:0/3193712204 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fb928056230 msgr2=0x7fb9280586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:00.421 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.421+0000 7fb94b59e700 1 --2- 172.21.15.146:0/3193712204 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fb928056230 0x7fb9280586f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fb944001410 tx=0x7fb944009220).stop 2021-01-27T09:49:00.421 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.421+0000 7fb94b59e700 1 -- 172.21.15.146:0/3193712204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb94c067500 msgr2=0x7fb94c136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:00.422 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.421+0000 7fb94b59e700 1 --2- 172.21.15.146:0/3193712204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb94c067500 0x7fb94c136840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fb93c0096e0 tx=0x7fb93c006c60).stop 2021-01-27T09:49:00.422 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.421+0000 7fb94b59e700 1 -- 172.21.15.146:0/3193712204 shutdown_connections 2021-01-27T09:49:00.422 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.421+0000 7fb94b59e700 1 --2- 172.21.15.146:0/3193712204 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fb928056230 0x7fb9280586f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:00.422 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.421+0000 7fb94b59e700 1 --2- 172.21.15.146:0/3193712204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb94c067500 0x7fb94c136840 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:00.422 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.421+0000 7fb94b59e700 1 --2- 172.21.15.146:0/3193712204 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb94c0652e0 0x7fb94c0bad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:00.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.421+0000 7fb94b59e700 1 --2- 172.21.15.146:0/3193712204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb94c064f00 0x7fb94c14d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:00.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.421+0000 7fb94b59e700 1 -- 172.21.15.146:0/3193712204 >> 172.21.15.146:0/3193712204 conn(0x7fb94c060a30 msgr2=0x7fb94c0627d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:00.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.421+0000 7fb94b59e700 1 -- 172.21.15.146:0/3193712204 shutdown_connections 2021-01-27T09:49:00.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:00.421+0000 7fb94b59e700 1 -- 172.21.15.146:0/3193712204 wait complete. 2021-01-27T09:49:00.424 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 21 2021-01-27T09:49:00.460 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-01-27T09:49:02.461 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:49:02.690 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.689+0000 7fa0ba939700 1 Processor -- start 2021-01-27T09:49:02.691 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.689+0000 7fa0ba939700 1 -- start start 2021-01-27T09:49:02.695 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.693+0000 7fa0ba939700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa0b40bd500 0x7fa0b40bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:02.695 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.693+0000 7fa0b9136700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa0b40bd8e0 0x7fa0b40671b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:38716/0 (socket says 172.21.15.146:38716) 2021-01-27T09:49:02.696 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.693+0000 7fa0ba939700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b4066d80 con 0x7fa0b40bd8e0 2021-01-27T09:49:02.696 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.693+0000 7fa0ba939700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b40678d0 con 0x7fa0b414a7f0 2021-01-27T09:49:02.697 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.693+0000 7fa0ba939700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b4069530 con 0x7fa0b40bd500 2021-01-27T09:49:02.697 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.693+0000 7fa0ba138700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa0b414a7f0 0x7fa0b414ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50684/0 (socket says 172.21.15.146:50684) 2021-01-27T09:49:02.697 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.693+0000 7fa0ba138700 1 -- 172.21.15.146:0/4075668132 learned_addr learned my addr 172.21.15.146:0/4075668132 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:49:02.698 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.693+0000 7fa0b8935700 1 -- 172.21.15.146:0/4075668132 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755348915 0 0) 0x7fa0ac001490 con 0x7fa0b414a7f0 2021-01-27T09:49:02.698 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.693+0000 7fa0b8935700 1 -- 172.21.15.146:0/4075668132 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa09c003270 con 0x7fa0b414a7f0 2021-01-27T09:49:02.698 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b8935700 1 -- 172.21.15.146:0/4075668132 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375033977 0 0) 0x7fa0b4066d80 con 0x7fa0b40bd8e0 2021-01-27T09:49:02.699 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b8935700 1 -- 172.21.15.146:0/4075668132 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0ac001490 con 0x7fa0b40bd8e0 2021-01-27T09:49:02.702 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b8935700 1 -- 172.21.15.146:0/4075668132 <== mon.1 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2594261964 0 0) 0x7fa09c003270 con 0x7fa0b414a7f0 2021-01-27T09:49:02.702 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b8935700 1 -- 172.21.15.146:0/4075668132 >> v2:172.21.15.146:3300/0 conn(0x7fa0b40bd500 msgr2=0x7fa0b40bcbc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:49:02.702 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b9937700 1 --2- 172.21.15.146:0/4075668132 >> v2:172.21.15.146:3300/0 conn(0x7fa0b40bd500 0x7fa0b40bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:02.703 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b8935700 1 --2- 172.21.15.146:0/4075668132 >> v2:172.21.15.146:3300/0 conn(0x7fa0b40bd500 0x7fa0b40bcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:02.703 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b8935700 1 -- 172.21.15.146:0/4075668132 >> v1:172.21.15.78:6789/0 conn(0x7fa0b40bd8e0 legacy=0x7fa0b40671b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:02.703 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b8935700 1 -- 172.21.15.146:0/4075668132 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b40ae600 con 0x7fa0b414a7f0 2021-01-27T09:49:02.703 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b8935700 1 -- 172.21.15.146:0/4075668132 <== mon.1 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3890990827 0 0) 0x7fa0ac001a30 con 0x7fa0b414a7f0 2021-01-27T09:49:02.704 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b8935700 1 -- 172.21.15.146:0/4075668132 >> v1:172.21.15.146:6789/0 conn(0x7fa0b414a7f0 legacy=0x7fa0b414ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:02.704 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b8935700 1 --2- 172.21.15.146:0/4075668132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa09c003940 0x7fa09c003d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:02.704 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b8935700 1 --2- 172.21.15.146:0/4075668132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa09c004510 0x7fa09c004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:02.704 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b8935700 1 --2- 172.21.15.146:0/4075668132 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa09c004e80 0x7fa09c013f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:02.705 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b8935700 1 -- 172.21.15.146:0/4075668132 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b4069530 con 0x7fa09c003940 2021-01-27T09:49:02.705 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b8935700 1 -- 172.21.15.146:0/4075668132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c014460 con 0x7fa09c004510 2021-01-27T09:49:02.705 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b8935700 1 -- 172.21.15.146:0/4075668132 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c0145a0 con 0x7fa09c004e80 2021-01-27T09:49:02.705 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b9136700 1 --2- 172.21.15.146:0/4075668132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa09c004510 0x7fa09c004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:02.706 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b9136700 1 -- 172.21.15.146:0/4075668132 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa09c004e80 msgr2=0x7fa09c013f70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-01-27T09:49:02.706 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b9136700 1 --2- 172.21.15.146:0/4075668132 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa09c004e80 0x7fa09c013f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:02.706 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b9136700 1 -- 172.21.15.146:0/4075668132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa09c003940 msgr2=0x7fa09c003d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:49:02.707 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b9136700 1 --2- 172.21.15.146:0/4075668132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa09c003940 0x7fa09c003d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:02.707 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b9136700 1 -- 172.21.15.146:0/4075668132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c003270 con 0x7fa09c004510 2021-01-27T09:49:02.707 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0ba138700 1 -- 172.21.15.146:0/4075668132 reap_dead start 2021-01-27T09:49:02.707 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b9136700 1 --2- 172.21.15.146:0/4075668132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa09c004510 0x7fa09c004990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fa0a4001b10 tx=0x7fa0a4007c20).ready entity=mon.1 client_cookie=6c368bc0b1499e63 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:02.708 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b8935700 1 -- 172.21.15.146:0/4075668132 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a40072e0 con 0x7fa09c004510 2021-01-27T09:49:02.708 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b8935700 1 -- 172.21.15.146:0/4075668132 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a401d730 con 0x7fa09c004510 2021-01-27T09:49:02.708 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.697+0000 7fa0b8935700 1 -- 172.21.15.146:0/4075668132 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a4007440 con 0x7fa09c004510 2021-01-27T09:49:02.708 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.701+0000 7fa0ba939700 1 -- 172.21.15.146:0/4075668132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa09c004510 msgr2=0x7fa09c004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:02.708 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.701+0000 7fa0ba939700 1 --2- 172.21.15.146:0/4075668132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa09c004510 0x7fa09c004990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fa0a4001b10 tx=0x7fa0a4007c20).stop 2021-01-27T09:49:02.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.701+0000 7fa0ba939700 1 -- 172.21.15.146:0/4075668132 shutdown_connections 2021-01-27T09:49:02.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.701+0000 7fa0ba939700 1 --2- 172.21.15.146:0/4075668132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa09c004510 0x7fa09c004990 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:02.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.701+0000 7fa0ba939700 1 -- 172.21.15.146:0/4075668132 >> 172.21.15.146:0/4075668132 conn(0x7fa0b4060a30 msgr2=0x7fa0b4065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:02.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.701+0000 7fa0ba939700 1 -- 172.21.15.146:0/4075668132 shutdown_connections 2021-01-27T09:49:02.712 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.705+0000 7fa0ba939700 1 -- 172.21.15.146:0/4075668132 wait complete. 2021-01-27T09:49:02.712 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.705+0000 7fa0ba939700 1 Processor -- start 2021-01-27T09:49:02.712 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.705+0000 7fa0ba939700 1 -- start start 2021-01-27T09:49:02.712 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0ba939700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa09c004510 0x7fa0b4140030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:02.713 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0ba939700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0b41462f0 0x7fa0b414dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:02.713 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0ba939700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0b41452b0 0x7fa0b415aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:02.713 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0ba939700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b41406c0 con 0x7fa0b41462f0 2021-01-27T09:49:02.713 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0ba939700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b4140960 con 0x7fa09c004510 2021-01-27T09:49:02.714 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0ba939700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b4140c00 con 0x7fa0b41452b0 2021-01-27T09:49:02.714 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0b9136700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0b41462f0 0x7fa0b414dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:02.714 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0ba138700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0b41452b0 0x7fa0b415aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:02.714 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0b9136700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0b41462f0 0x7fa0b414dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:53994/0 (socket says 172.21.15.146:53994) 2021-01-27T09:49:02.715 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0b9136700 1 -- 172.21.15.146:0/1660162160 learned_addr learned my addr 172.21.15.146:0/1660162160 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:49:02.715 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0b9937700 1 --2- 172.21.15.146:0/1660162160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa09c004510 0x7fa0b4140030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:02.715 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0ba138700 1 -- 172.21.15.146:0/1660162160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa09c004510 msgr2=0x7fa0b4140030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:02.715 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0ba138700 1 --2- 172.21.15.146:0/1660162160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa09c004510 0x7fa0b4140030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:02.716 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0ba138700 1 -- 172.21.15.146:0/1660162160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0b41462f0 msgr2=0x7fa0b414dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:02.716 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0ba138700 1 --2- 172.21.15.146:0/1660162160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0b41462f0 0x7fa0b414dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:02.716 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0ba138700 1 -- 172.21.15.146:0/1660162160 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b4140ea0 con 0x7fa0b41452b0 2021-01-27T09:49:02.716 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0b9136700 1 --2- 172.21.15.146:0/1660162160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0b41462f0 0x7fa0b414dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:49:02.717 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0ba138700 1 --2- 172.21.15.146:0/1660162160 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0b41452b0 0x7fa0b415aba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fa0b40666e0 tx=0x7fa0b40ae790).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:02.717 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0a1ffb700 1 -- 172.21.15.146:0/1660162160 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac00ab30 con 0x7fa0b41452b0 2021-01-27T09:49:02.717 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0a1ffb700 1 -- 172.21.15.146:0/1660162160 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ac00ac90 con 0x7fa0b41452b0 2021-01-27T09:49:02.717 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0a1ffb700 1 -- 172.21.15.146:0/1660162160 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac0048b0 con 0x7fa0b41452b0 2021-01-27T09:49:02.718 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0ba939700 1 -- 172.21.15.146:0/1660162160 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b415a460 con 0x7fa0b41452b0 2021-01-27T09:49:02.718 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0ba939700 1 -- 172.21.15.146:0/1660162160 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b414e280 con 0x7fa0b41452b0 2021-01-27T09:49:02.718 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.709+0000 7fa0b9937700 1 --2- 172.21.15.146:0/1660162160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa09c004510 0x7fa0b4140030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:49:02.718 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.713+0000 7fa0ba939700 1 -- 172.21.15.146:0/1660162160 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b4044680 con 0x7fa0b41452b0 2021-01-27T09:49:02.719 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.713+0000 7fa0a1ffb700 1 -- 172.21.15.146:0/1660162160 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fa0ac010070 con 0x7fa0b41452b0 2021-01-27T09:49:02.720 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.713+0000 7fa0a1ffb700 1 --2- 172.21.15.146:0/1660162160 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa09c057830 0x7fa09c059cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:02.720 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.713+0000 7fa0a1ffb700 1 -- 172.21.15.146:0/1660162160 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6911+0+0 (secure 0 0 0) 0x7fa0ac06f260 con 0x7fa0b41452b0 2021-01-27T09:49:02.720 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.713+0000 7fa0b9937700 1 --2- 172.21.15.146:0/1660162160 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa09c057830 0x7fa09c059cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:02.720 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.717+0000 7fa0b9937700 1 --2- 172.21.15.146:0/1660162160 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa09c057830 0x7fa09c059cf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fa0b4045d00 tx=0x7fa0b0008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:02.724 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:02.725+0000 7fa0a1ffb700 1 -- 172.21.15.146:0/1660162160 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fa0ac044830 con 0x7fa0b41452b0 2021-01-27T09:49:03.014 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:03.017+0000 7fa0ba939700 1 -- 172.21.15.146:0/1660162160 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0b40678d0 con 0x7fa0b41452b0 2021-01-27T09:49:03.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:03.017+0000 7fa0a1ffb700 1 -- 172.21.15.146:0/1660162160 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3583 (secure 0 0 0) 0x7fa0b40678d0 con 0x7fa0b41452b0 2021-01-27T09:49:03.016 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:49:03.016 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4971,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:47:16.693281+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":2,"incarnation":15,"state":"up:active","state_seq":43,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:49:03.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:03.021+0000 7fa0ba939700 1 -- 172.21.15.146:0/1660162160 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa09c057830 msgr2=0x7fa09c059cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:03.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:03.021+0000 7fa0ba939700 1 --2- 172.21.15.146:0/1660162160 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa09c057830 0x7fa09c059cf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fa0b4045d00 tx=0x7fa0b0008040).stop 2021-01-27T09:49:03.019 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:03.021+0000 7fa0ba939700 1 -- 172.21.15.146:0/1660162160 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0b41452b0 msgr2=0x7fa0b415aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:03.019 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:03.021+0000 7fa0ba939700 1 --2- 172.21.15.146:0/1660162160 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0b41452b0 0x7fa0b415aba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fa0b40666e0 tx=0x7fa0b40ae790).stop 2021-01-27T09:49:03.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:03.021+0000 7fa0ba939700 1 -- 172.21.15.146:0/1660162160 shutdown_connections 2021-01-27T09:49:03.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:03.021+0000 7fa0ba939700 1 --2- 172.21.15.146:0/1660162160 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0b41452b0 0x7fa0b415aba0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:03.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:03.021+0000 7fa0ba939700 1 --2- 172.21.15.146:0/1660162160 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0b41462f0 0x7fa0b414dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:03.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:03.021+0000 7fa0ba939700 1 --2- 172.21.15.146:0/1660162160 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa09c057830 0x7fa09c059cf0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:03.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:03.021+0000 7fa0ba939700 1 --2- 172.21.15.146:0/1660162160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa09c004510 0x7fa0b4140030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:03.021 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:03.021+0000 7fa0ba939700 1 -- 172.21.15.146:0/1660162160 >> 172.21.15.146:0/1660162160 conn(0x7fa0b4060a30 msgr2=0x7fa0b414b430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:03.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:03.021+0000 7fa0ba939700 1 -- 172.21.15.146:0/1660162160 shutdown_connections 2021-01-27T09:49:03.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:03.021+0000 7fa0ba939700 1 -- 172.21.15.146:0/1660162160 wait complete. 2021-01-27T09:49:03.022 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 21 2021-01-27T09:49:03.048 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-01-27T09:49:05.050 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:49:05.279 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.281+0000 7ff068885700 1 Processor -- start 2021-01-27T09:49:05.279 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.281+0000 7ff068885700 1 -- start start 2021-01-27T09:49:05.280 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.281+0000 7ff068885700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff0640616c0 0x7ff064061aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:05.280 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.281+0000 7ff068885700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff0640609e0 0x7ff064064240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:05.282 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.281+0000 7ff068885700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0640b6910 con 0x7ff06414f0f0 2021-01-27T09:49:05.282 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.281+0000 7ff068885700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0640b6bb0 con 0x7ff0640609e0 2021-01-27T09:49:05.283 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.281+0000 7ff068885700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0640b6e50 con 0x7ff0640616c0 2021-01-27T09:49:05.283 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.281+0000 7ff062ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff0640609e0 0x7ff064064240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:05.283 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.281+0000 7ff062ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff0640609e0 0x7ff064064240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51190/0 (socket says 172.21.15.146:51190) 2021-01-27T09:49:05.283 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.281+0000 7ff062ffd700 1 -- 172.21.15.146:0/332559616 learned_addr learned my addr 172.21.15.146:0/332559616 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:49:05.284 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.281+0000 7ff062ffd700 1 -- 172.21.15.146:0/332559616 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff0640616c0 msgr2=0x7ff064061aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:49:05.284 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.281+0000 7ff062ffd700 1 --2- 172.21.15.146:0/332559616 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff0640616c0 0x7ff064061aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:05.284 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.281+0000 7ff062ffd700 1 -- 172.21.15.146:0/332559616 >> v1:172.21.15.146:6789/0 conn(0x7ff06414f0f0 legacy=0x7ff064145560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:05.284 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.281+0000 7ff062ffd700 1 -- 172.21.15.146:0/332559616 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff064064ef0 con 0x7ff0640609e0 2021-01-27T09:49:05.284 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.285+0000 7ff062ffd700 1 --2- 172.21.15.146:0/332559616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0640609e0 0x7ff064064240 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7ff05800ba70 tx=0x7ff058006e80).ready entity=mon.1 client_cookie=93f94d22d88b9872 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:05.288 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.289+0000 7ff0627fc700 1 -- 172.21.15.146:0/332559616 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff058009940 con 0x7ff0640609e0 2021-01-27T09:49:05.289 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.289+0000 7ff0627fc700 1 -- 172.21.15.146:0/332559616 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff058009aa0 con 0x7ff0640609e0 2021-01-27T09:49:05.289 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.289+0000 7ff0627fc700 1 -- 172.21.15.146:0/332559616 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff058009e20 con 0x7ff0640609e0 2021-01-27T09:49:05.290 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.289+0000 7ff068885700 1 -- 172.21.15.146:0/332559616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0640609e0 msgr2=0x7ff064064240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:05.291 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.289+0000 7ff068885700 1 --2- 172.21.15.146:0/332559616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0640609e0 0x7ff064064240 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7ff05800ba70 tx=0x7ff058006e80).stop 2021-01-27T09:49:05.292 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.293+0000 7ff068885700 1 -- 172.21.15.146:0/332559616 shutdown_connections 2021-01-27T09:49:05.293 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.293+0000 7ff068885700 1 --2- 172.21.15.146:0/332559616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0640609e0 0x7ff064064240 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:05.293 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.293+0000 7ff068885700 1 --2- 172.21.15.146:0/332559616 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff0640616c0 0x7ff064061aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:05.293 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.293+0000 7ff068885700 1 -- 172.21.15.146:0/332559616 >> 172.21.15.146:0/332559616 conn(0x7ff0640670b0 msgr2=0x7ff0640674c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:05.295 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.297+0000 7ff068885700 1 -- 172.21.15.146:0/332559616 shutdown_connections 2021-01-27T09:49:05.298 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.301+0000 7ff068885700 1 -- 172.21.15.146:0/332559616 wait complete. 2021-01-27T09:49:05.300 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.301+0000 7ff068885700 1 Processor -- start 2021-01-27T09:49:05.301 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.301+0000 7ff068885700 1 -- start start 2021-01-27T09:49:05.303 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.305+0000 7ff068885700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff0640609e0 0x7ff0640b7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:05.304 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.305+0000 7ff068885700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0640616c0 0x7ff0640bd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:05.304 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.305+0000 7ff068885700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff06414f0f0 0x7ff0640bd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:05.304 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.305+0000 7ff068885700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0640bcd90 con 0x7ff0640616c0 2021-01-27T09:49:05.305 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.305+0000 7ff068885700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0641461d0 con 0x7ff06414f0f0 2021-01-27T09:49:05.305 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.305+0000 7ff068885700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff064146470 con 0x7ff0640609e0 2021-01-27T09:49:05.306 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.305+0000 7ff0637fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff0640609e0 0x7ff0640b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:05.306 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.305+0000 7ff0637fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff0640609e0 0x7ff0640b7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:40678/0 (socket says 172.21.15.146:40678) 2021-01-27T09:49:05.306 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.305+0000 7ff062ffd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0640616c0 0x7ff0640bd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:05.307 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.305+0000 7ff0637fe700 1 -- 172.21.15.146:0/2760645826 learned_addr learned my addr 172.21.15.146:0/2760645826 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:49:05.307 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.305+0000 7ff063fff700 1 --2- 172.21.15.146:0/2760645826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff06414f0f0 0x7ff0640bd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:05.309 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.305+0000 7ff062ffd700 1 -- 172.21.15.146:0/2760645826 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff0640609e0 msgr2=0x7ff0640b7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:05.309 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.305+0000 7ff062ffd700 1 --2- 172.21.15.146:0/2760645826 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff0640609e0 0x7ff0640b7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:05.310 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.305+0000 7ff062ffd700 1 -- 172.21.15.146:0/2760645826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff06414f0f0 msgr2=0x7ff0640bd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:05.310 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.305+0000 7ff062ffd700 1 --2- 172.21.15.146:0/2760645826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff06414f0f0 0x7ff0640bd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:05.310 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.305+0000 7ff062ffd700 1 -- 172.21.15.146:0/2760645826 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff064146710 con 0x7ff0640616c0 2021-01-27T09:49:05.310 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.305+0000 7ff062ffd700 1 --2- 172.21.15.146:0/2760645826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0640616c0 0x7ff0640bd460 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7ff058013000 tx=0x7ff058016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:05.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.305+0000 7ff04b7fe700 1 -- 172.21.15.146:0/2760645826 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05801d9f0 con 0x7ff0640616c0 2021-01-27T09:49:05.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.305+0000 7ff04b7fe700 1 -- 172.21.15.146:0/2760645826 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05801db50 con 0x7ff0640616c0 2021-01-27T09:49:05.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.305+0000 7ff04b7fe700 1 -- 172.21.15.146:0/2760645826 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05801dd00 con 0x7ff0640616c0 2021-01-27T09:49:05.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.305+0000 7ff068885700 1 -- 172.21.15.146:0/2760645826 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0640bcfc0 con 0x7ff0640616c0 2021-01-27T09:49:05.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.305+0000 7ff068885700 1 -- 172.21.15.146:0/2760645826 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0640b7940 con 0x7ff0640616c0 2021-01-27T09:49:05.312 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.309+0000 7ff068885700 1 -- 172.21.15.146:0/2760645826 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0640b50b0 con 0x7ff0640616c0 2021-01-27T09:49:05.312 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.313+0000 7ff04b7fe700 1 -- 172.21.15.146:0/2760645826 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7ff05802d070 con 0x7ff0640616c0 2021-01-27T09:49:05.312 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.313+0000 7ff04b7fe700 1 --2- 172.21.15.146:0/2760645826 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff0440561b0 0x7ff044058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:05.313 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.313+0000 7ff04b7fe700 1 -- 172.21.15.146:0/2760645826 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6911+0+0 (secure 0 0 0) 0x7ff058074800 con 0x7ff0640616c0 2021-01-27T09:49:05.315 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.317+0000 7ff0637fe700 1 --2- 172.21.15.146:0/2760645826 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff0440561b0 0x7ff044058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:05.316 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.317+0000 7ff0637fe700 1 --2- 172.21.15.146:0/2760645826 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff0440561b0 0x7ff044058670 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7ff0640b8140 tx=0x7ff054006ef0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:05.318 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.321+0000 7ff04b7fe700 1 -- 172.21.15.146:0/2760645826 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7ff058049d50 con 0x7ff0640616c0 2021-01-27T09:49:05.690 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.689+0000 7ff068885700 1 -- 172.21.15.146:0/2760645826 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0640b52f0 con 0x7ff0640616c0 2021-01-27T09:49:05.691 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.693+0000 7ff04b7fe700 1 -- 172.21.15.146:0/2760645826 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3583 (secure 0 0 0) 0x7ff05802b070 con 0x7ff0640616c0 2021-01-27T09:49:05.692 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:49:05.692 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4971,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:47:16.693281+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":2,"incarnation":15,"state":"up:active","state_seq":43,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:49:05.696 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.697+0000 7ff068885700 1 -- 172.21.15.146:0/2760645826 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff0440561b0 msgr2=0x7ff044058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:05.697 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.697+0000 7ff068885700 1 --2- 172.21.15.146:0/2760645826 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff0440561b0 0x7ff044058670 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7ff0640b8140 tx=0x7ff054006ef0).stop 2021-01-27T09:49:05.697 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.697+0000 7ff068885700 1 -- 172.21.15.146:0/2760645826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0640616c0 msgr2=0x7ff0640bd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:05.697 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.697+0000 7ff068885700 1 --2- 172.21.15.146:0/2760645826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0640616c0 0x7ff0640bd460 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7ff058013000 tx=0x7ff058016000).stop 2021-01-27T09:49:05.697 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.697+0000 7ff068885700 1 -- 172.21.15.146:0/2760645826 shutdown_connections 2021-01-27T09:49:05.698 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.697+0000 7ff068885700 1 --2- 172.21.15.146:0/2760645826 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff0440561b0 0x7ff044058670 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:05.699 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.697+0000 7ff068885700 1 --2- 172.21.15.146:0/2760645826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff06414f0f0 0x7ff0640bd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:05.700 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.697+0000 7ff068885700 1 --2- 172.21.15.146:0/2760645826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0640616c0 0x7ff0640bd460 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:05.700 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.697+0000 7ff068885700 1 --2- 172.21.15.146:0/2760645826 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff0640609e0 0x7ff0640b7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:05.700 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.697+0000 7ff068885700 1 -- 172.21.15.146:0/2760645826 >> 172.21.15.146:0/2760645826 conn(0x7ff0640670b0 msgr2=0x7ff06414d400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:05.714 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.717+0000 7ff068885700 1 -- 172.21.15.146:0/2760645826 shutdown_connections 2021-01-27T09:49:05.715 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:05.717+0000 7ff068885700 1 -- 172.21.15.146:0/2760645826 wait complete. 2021-01-27T09:49:05.727 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 21 2021-01-27T09:49:05.761 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-01-27T09:49:07.761 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:49:08.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.021+0000 7fd041af2700 1 Processor -- start 2021-01-27T09:49:08.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.021+0000 7fd041af2700 1 -- start start 2021-01-27T09:49:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.025+0000 7fd041af2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd03c0bdd30 0x7fd03c065fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.025+0000 7fd041af2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd03c0be110 0x7fd03c0b9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.025+0000 7fd041af2700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd03c155830 0x7fd03c14f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.025+0000 7fd041af2700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03c0ba1b0 con 0x7fd03c155830 2021-01-27T09:49:08.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.025+0000 7fd041af2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03c081d20 con 0x7fd03c0bdd30 2021-01-27T09:49:08.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.025+0000 7fd041af2700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c081fc0 con 0x7fd03c0be110 2021-01-27T09:49:08.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.025+0000 7fd03affd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd03c0be110 0x7fd03c0b9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:08.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.025+0000 7fd03affd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd03c0be110 0x7fd03c0b9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:40734/0 (socket says 172.21.15.146:40734) 2021-01-27T09:49:08.026 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.025+0000 7fd03affd700 1 -- 172.21.15.146:0/3458100152 learned_addr learned my addr 172.21.15.146:0/3458100152 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:49:08.026 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.025+0000 7fd03b7fe700 1 --2- 172.21.15.146:0/3458100152 >> v2:172.21.15.146:3300/0 conn(0x7fd03c0bdd30 0x7fd03c065fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.025+0000 7fd03bfff700 1 --2- 172.21.15.146:0/3458100152 >> v2:172.21.15.78:3300/0 conn(0x7fd03c155830 0x7fd03c14f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.025+0000 7fd03b7fe700 1 -- 172.21.15.146:0/3458100152 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd03c0be110 msgr2=0x7fd03c0b9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:49:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.025+0000 7fd03b7fe700 1 --2- 172.21.15.146:0/3458100152 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd03c0be110 0x7fd03c0b9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.025+0000 7fd03b7fe700 1 -- 172.21.15.146:0/3458100152 >> v2:172.21.15.78:3300/0 conn(0x7fd03c155830 msgr2=0x7fd03c14f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:49:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.025+0000 7fd03b7fe700 1 --2- 172.21.15.146:0/3458100152 >> v2:172.21.15.78:3300/0 conn(0x7fd03c155830 0x7fd03c14f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.025+0000 7fd03b7fe700 1 -- 172.21.15.146:0/3458100152 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03c0ba3e0 con 0x7fd03c0bdd30 2021-01-27T09:49:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.025+0000 7fd03bfff700 1 --2- 172.21.15.146:0/3458100152 >> v2:172.21.15.78:3300/0 conn(0x7fd03c155830 0x7fd03c14f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:49:08.030 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.025+0000 7fd03b7fe700 1 --2- 172.21.15.146:0/3458100152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd03c0bdd30 0x7fd03c065fa0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fd03c060f80 tx=0x7fd02c006e20).ready entity=mon.1 client_cookie=1eafe609e18ffe05 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:08.030 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.025+0000 7fd03a7fc700 1 -- 172.21.15.146:0/3458100152 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02c00be80 con 0x7fd03c0bdd30 2021-01-27T09:49:08.030 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.029+0000 7fd03a7fc700 1 -- 172.21.15.146:0/3458100152 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02c009870 con 0x7fd03c0bdd30 2021-01-27T09:49:08.030 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.029+0000 7fd03a7fc700 1 -- 172.21.15.146:0/3458100152 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02c009bf0 con 0x7fd03c0bdd30 2021-01-27T09:49:08.031 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.029+0000 7fd041af2700 1 -- 172.21.15.146:0/3458100152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd03c0bdd30 msgr2=0x7fd03c065fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:08.031 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.029+0000 7fd041af2700 1 --2- 172.21.15.146:0/3458100152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd03c0bdd30 0x7fd03c065fa0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fd03c060f80 tx=0x7fd02c006e20).stop 2021-01-27T09:49:08.031 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.029+0000 7fd041af2700 1 -- 172.21.15.146:0/3458100152 shutdown_connections 2021-01-27T09:49:08.031 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.029+0000 7fd041af2700 1 --2- 172.21.15.146:0/3458100152 >> v2:172.21.15.78:3300/0 conn(0x7fd03c155830 0x7fd03c14f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:08.032 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.029+0000 7fd041af2700 1 --2- 172.21.15.146:0/3458100152 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd03c0be110 0x7fd03c0b9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:08.032 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.029+0000 7fd041af2700 1 --2- 172.21.15.146:0/3458100152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd03c0bdd30 0x7fd03c065fa0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:08.032 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.029+0000 7fd041af2700 1 -- 172.21.15.146:0/3458100152 >> 172.21.15.146:0/3458100152 conn(0x7fd03c069110 msgr2=0x7fd03c060860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.029+0000 7fd041af2700 1 -- 172.21.15.146:0/3458100152 shutdown_connections 2021-01-27T09:49:08.036 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.037+0000 7fd041af2700 1 -- 172.21.15.146:0/3458100152 wait complete. 2021-01-27T09:49:08.045 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.041+0000 7fd041af2700 1 Processor -- start 2021-01-27T09:49:08.045 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.041+0000 7fd041af2700 1 -- start start 2021-01-27T09:49:08.046 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.041+0000 7fd041af2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd03c0be110 0x7fd03c154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:08.047 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.041+0000 7fd041af2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd03c155830 0x7fd03c083ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:08.047 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.041+0000 7fd03b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd03c0be110 0x7fd03c154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:08.047 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.041+0000 7fd03affd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd03c155830 0x7fd03c083ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:08.047 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.041+0000 7fd041af2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd03c153850 0x7fd03c0844e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:08.048 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.041+0000 7fd03affd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd03c155830 0x7fd03c083ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:40742/0 (socket says 172.21.15.146:40742) 2021-01-27T09:49:08.048 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.041+0000 7fd03affd700 1 -- 172.21.15.146:0/2674510757 learned_addr learned my addr 172.21.15.146:0/2674510757 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:49:08.048 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.041+0000 7fd041af2700 1 -- 172.21.15.146:0/2674510757 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c144f70 con 0x7fd03c153850 2021-01-27T09:49:08.049 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.041+0000 7fd041af2700 1 -- 172.21.15.146:0/2674510757 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c0849d0 con 0x7fd03c0be110 2021-01-27T09:49:08.049 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.041+0000 7fd041af2700 1 -- 172.21.15.146:0/2674510757 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c154af0 con 0x7fd03c155830 2021-01-27T09:49:08.049 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.041+0000 7fd03bfff700 1 --2- 172.21.15.146:0/2674510757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd03c153850 0x7fd03c0844e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:08.050 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.041+0000 7fd03affd700 1 -- 172.21.15.146:0/2674510757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd03c0be110 msgr2=0x7fd03c154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:08.050 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.041+0000 7fd03affd700 1 --2- 172.21.15.146:0/2674510757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd03c0be110 0x7fd03c154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:08.050 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.041+0000 7fd03affd700 1 -- 172.21.15.146:0/2674510757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd03c153850 msgr2=0x7fd03c0844e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:08.050 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.041+0000 7fd03affd700 1 --2- 172.21.15.146:0/2674510757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd03c153850 0x7fd03c0844e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:08.051 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.041+0000 7fd03b7fe700 1 --2- 172.21.15.146:0/2674510757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd03c0be110 0x7fd03c154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:49:08.051 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.041+0000 7fd03affd700 1 -- 172.21.15.146:0/2674510757 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03c0823e0 con 0x7fd03c155830 2021-01-27T09:49:08.051 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.041+0000 7fd03affd700 1 --2- 172.21.15.146:0/2674510757 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd03c155830 0x7fd03c083ff0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fd03400ef20 tx=0x7fd0340092d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:08.051 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.045+0000 7fd0237fe700 1 -- 172.21.15.146:0/2674510757 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03400cbc0 con 0x7fd03c155830 2021-01-27T09:49:08.051 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.045+0000 7fd0237fe700 1 -- 172.21.15.146:0/2674510757 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03400cd20 con 0x7fd03c155830 2021-01-27T09:49:08.052 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.045+0000 7fd0237fe700 1 -- 172.21.15.146:0/2674510757 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034012640 con 0x7fd03c155830 2021-01-27T09:49:08.052 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.045+0000 7fd041af2700 1 -- 172.21.15.146:0/2674510757 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd03c158850 con 0x7fd03c155830 2021-01-27T09:49:08.052 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.045+0000 7fd041af2700 1 -- 172.21.15.146:0/2674510757 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd03c082640 con 0x7fd03c155830 2021-01-27T09:49:08.052 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.045+0000 7fd0217fa700 1 -- 172.21.15.146:0/2674510757 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd03c082800 con 0x7fd03c155830 2021-01-27T09:49:08.053 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.045+0000 7fd0237fe700 1 -- 172.21.15.146:0/2674510757 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fd034022070 con 0x7fd03c155830 2021-01-27T09:49:08.053 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.045+0000 7fd0237fe700 1 --2- 172.21.15.146:0/2674510757 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd01c056230 0x7fd01c0586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:08.053 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.045+0000 7fd0237fe700 1 -- 172.21.15.146:0/2674510757 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6911+0+0 (secure 0 0 0) 0x7fd03406fb70 con 0x7fd03c155830 2021-01-27T09:49:08.053 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.049+0000 7fd03b7fe700 1 --2- 172.21.15.146:0/2674510757 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd01c056230 0x7fd01c0586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:08.054 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.049+0000 7fd03b7fe700 1 --2- 172.21.15.146:0/2674510757 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd01c056230 0x7fd01c0586f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fd03c061170 tx=0x7fd02c016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:08.054 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.053+0000 7fd0237fe700 1 -- 172.21.15.146:0/2674510757 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fd034045250 con 0x7fd03c155830 2021-01-27T09:49:08.399 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.401+0000 7fd0217fa700 1 -- 172.21.15.146:0/2674510757 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd03c044ee0 con 0x7fd03c155830 2021-01-27T09:49:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.401+0000 7fd0237fe700 1 -- 172.21.15.146:0/2674510757 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3583 (secure 0 0 0) 0x7fd034048870 con 0x7fd03c155830 2021-01-27T09:49:08.401 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:49:08.402 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4971,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:47:16.693281+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":2,"incarnation":15,"state":"up:active","state_seq":43,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:49:08.414 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.413+0000 7fd0217fa700 1 -- 172.21.15.146:0/2674510757 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd01c056230 msgr2=0x7fd01c0586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:08.414 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.413+0000 7fd0217fa700 1 --2- 172.21.15.146:0/2674510757 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd01c056230 0x7fd01c0586f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fd03c061170 tx=0x7fd02c016000).stop 2021-01-27T09:49:08.414 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.413+0000 7fd0217fa700 1 -- 172.21.15.146:0/2674510757 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd03c155830 msgr2=0x7fd03c083ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:08.415 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.413+0000 7fd0217fa700 1 --2- 172.21.15.146:0/2674510757 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd03c155830 0x7fd03c083ff0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fd03400ef20 tx=0x7fd0340092d0).stop 2021-01-27T09:49:08.415 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.413+0000 7fd0217fa700 1 -- 172.21.15.146:0/2674510757 shutdown_connections 2021-01-27T09:49:08.416 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.413+0000 7fd0217fa700 1 --2- 172.21.15.146:0/2674510757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd03c153850 0x7fd03c0844e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:08.416 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.413+0000 7fd0217fa700 1 --2- 172.21.15.146:0/2674510757 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd03c155830 0x7fd03c083ff0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:08.417 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.413+0000 7fd0217fa700 1 --2- 172.21.15.146:0/2674510757 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fd01c056230 0x7fd01c0586f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:08.417 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.413+0000 7fd0217fa700 1 --2- 172.21.15.146:0/2674510757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd03c0be110 0x7fd03c154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:08.417 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.413+0000 7fd0217fa700 1 -- 172.21.15.146:0/2674510757 >> 172.21.15.146:0/2674510757 conn(0x7fd03c069110 msgr2=0x7fd03c0664f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:08.418 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.413+0000 7fd0217fa700 1 -- 172.21.15.146:0/2674510757 shutdown_connections 2021-01-27T09:49:08.418 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:08.413+0000 7fd0217fa700 1 -- 172.21.15.146:0/2674510757 wait complete. 2021-01-27T09:49:08.422 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 21 2021-01-27T09:49:08.448 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-01-27T09:49:10.450 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:49:10.694 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.697+0000 7f1159212700 1 Processor -- start 2021-01-27T09:49:10.695 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.697+0000 7f1159212700 1 -- start start 2021-01-27T09:49:10.699 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.697+0000 7f1159212700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1154069830 0x7f115414d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:10.699 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.697+0000 7f1153fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f115414ea60 0x7f11540b9730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50864/0 (socket says 172.21.15.146:50864) 2021-01-27T09:49:10.700 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.697+0000 7f1159212700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f115414c6f0 0x7f115414fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:10.700 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.697+0000 7f11537fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1154069830 0x7f115414d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:10.700 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.697+0000 7f11537fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1154069830 0x7f115414d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:54168/0 (socket says 172.21.15.146:54168) 2021-01-27T09:49:10.700 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.697+0000 7f1159212700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11540bb5d0 con 0x7f115414ea60 2021-01-27T09:49:10.701 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.697+0000 7f1159212700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11541496e0 con 0x7f1154069830 2021-01-27T09:49:10.701 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.697+0000 7f1159212700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f115414cb10 con 0x7f115414c6f0 2021-01-27T09:49:10.701 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.697+0000 7f1153fff700 1 -- 172.21.15.146:0/2456343049 learned_addr learned my addr 172.21.15.146:0/2456343049 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:49:10.701 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.701+0000 7f11537fe700 1 -- 172.21.15.146:0/2456343049 >> v2:172.21.15.146:3300/0 conn(0x7f115414c6f0 msgr2=0x7f115414fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:49:10.701 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.701+0000 7f11537fe700 1 --2- 172.21.15.146:0/2456343049 >> v2:172.21.15.146:3300/0 conn(0x7f115414c6f0 0x7f115414fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:10.702 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.701+0000 7f11537fe700 1 -- 172.21.15.146:0/2456343049 >> v1:172.21.15.146:6789/0 conn(0x7f115414ea60 legacy=0x7f11540b9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:49:10.702 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.701+0000 7f11537fe700 1 -- 172.21.15.146:0/2456343049 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11540bb800 con 0x7f1154069830 2021-01-27T09:49:10.702 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.701+0000 7f11537fe700 1 --2- 172.21.15.146:0/2456343049 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1154069830 0x7f115414d100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f11540651f0 tx=0x7f1148006e20).ready entity=mon.0 client_cookie=756a9e407fce80d4 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:10.703 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.701+0000 7f1152ffd700 1 -- 172.21.15.146:0/2456343049 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1148009830 con 0x7f1154069830 2021-01-27T09:49:10.703 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.701+0000 7f1152ffd700 1 -- 172.21.15.146:0/2456343049 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1148009990 con 0x7f1154069830 2021-01-27T09:49:10.703 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.701+0000 7f1152ffd700 1 -- 172.21.15.146:0/2456343049 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1148009d10 con 0x7f1154069830 2021-01-27T09:49:10.705 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.705+0000 7f1159212700 1 -- 172.21.15.146:0/2456343049 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1154069830 msgr2=0x7f115414d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:10.705 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.705+0000 7f1159212700 1 --2- 172.21.15.146:0/2456343049 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1154069830 0x7f115414d100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f11540651f0 tx=0x7f1148006e20).stop 2021-01-27T09:49:10.707 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.709+0000 7f1159212700 1 -- 172.21.15.146:0/2456343049 shutdown_connections 2021-01-27T09:49:10.708 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.709+0000 7f1159212700 1 --2- 172.21.15.146:0/2456343049 >> v2:172.21.15.146:3300/0 conn(0x7f115414c6f0 0x7f115414fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:10.708 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.709+0000 7f1159212700 1 --2- 172.21.15.146:0/2456343049 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1154069830 0x7f115414d100 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:10.708 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.709+0000 7f1159212700 1 -- 172.21.15.146:0/2456343049 >> 172.21.15.146:0/2456343049 conn(0x7f1154067e60 msgr2=0x7f1154069110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:10.708 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.709+0000 7f1159212700 1 -- 172.21.15.146:0/2456343049 shutdown_connections 2021-01-27T09:49:10.711 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.713+0000 7f1159212700 1 -- 172.21.15.146:0/2456343049 wait complete. 2021-01-27T09:49:10.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.729+0000 7f1159212700 1 Processor -- start 2021-01-27T09:49:10.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.729+0000 7f1159212700 1 -- start start 2021-01-27T09:49:10.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.729+0000 7f1159212700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1154069830 0x7f115415c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:10.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.729+0000 7f1159212700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f115414c6f0 0x7f1154148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:10.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.729+0000 7f1159212700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f115414ea60 0x7f1154148630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:10.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.729+0000 7f1159212700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115414b6a0 con 0x7f1154069830 2021-01-27T09:49:10.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.729+0000 7f1159212700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115414b900 con 0x7f115414ea60 2021-01-27T09:49:10.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.729+0000 7f1159212700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115414bba0 con 0x7f115414c6f0 2021-01-27T09:49:10.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.729+0000 7f1158a11700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f115414ea60 0x7f1154148630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:10.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.729+0000 7f1158a11700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f115414ea60 0x7f1154148630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51302/0 (socket says 172.21.15.146:51302) 2021-01-27T09:49:10.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.729+0000 7f1158a11700 1 -- 172.21.15.146:0/2763339318 learned_addr learned my addr 172.21.15.146:0/2763339318 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:49:10.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.729+0000 7f1153fff700 1 --2- 172.21.15.146:0/2763339318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1154069830 0x7f115415c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:10.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.733+0000 7f1158a11700 1 -- 172.21.15.146:0/2763339318 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f115414c6f0 msgr2=0x7f1154148140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-01-27T09:49:10.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.733+0000 7f1158a11700 1 --2- 172.21.15.146:0/2763339318 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f115414c6f0 0x7f1154148140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:10.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.733+0000 7f1158a11700 1 -- 172.21.15.146:0/2763339318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1154069830 msgr2=0x7f115415c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:10.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.733+0000 7f1158a11700 1 --2- 172.21.15.146:0/2763339318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1154069830 0x7f115415c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:10.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.733+0000 7f1158a11700 1 -- 172.21.15.146:0/2763339318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115414be40 con 0x7f115414ea60 2021-01-27T09:49:10.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.733+0000 7f1158a11700 1 --2- 172.21.15.146:0/2763339318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f115414ea60 0x7f1154148630 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f114c00bae0 tx=0x7f114c009250).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:10.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.733+0000 7f113bfff700 1 -- 172.21.15.146:0/2763339318 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c00c820 con 0x7f115414ea60 2021-01-27T09:49:10.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.733+0000 7f1159212700 1 -- 172.21.15.146:0/2763339318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f115414c0e0 con 0x7f115414ea60 2021-01-27T09:49:10.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.733+0000 7f1159212700 1 -- 172.21.15.146:0/2763339318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1154066db0 con 0x7f115414ea60 2021-01-27T09:49:10.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.737+0000 7f113bfff700 1 -- 172.21.15.146:0/2763339318 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114c00c980 con 0x7f115414ea60 2021-01-27T09:49:10.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.737+0000 7f1159212700 1 -- 172.21.15.146:0/2763339318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1154062930 con 0x7f115414ea60 2021-01-27T09:49:10.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.741+0000 7f113bfff700 1 -- 172.21.15.146:0/2763339318 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c00cb30 con 0x7f115414ea60 2021-01-27T09:49:10.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.741+0000 7f113bfff700 1 -- 172.21.15.146:0/2763339318 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f114c01c070 con 0x7f115414ea60 2021-01-27T09:49:10.740 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.741+0000 7f113bfff700 1 --2- 172.21.15.146:0/2763339318 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f11340562b0 0x7f1134058770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:10.746 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.741+0000 7f113bfff700 1 -- 172.21.15.146:0/2763339318 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6911+0+0 (secure 0 0 0) 0x7f114c06ee10 con 0x7f115414ea60 2021-01-27T09:49:10.746 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.745+0000 7f1153fff700 1 --2- 172.21.15.146:0/2763339318 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f11340562b0 0x7f1134058770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:10.747 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.749+0000 7f1153fff700 1 --2- 172.21.15.146:0/2763339318 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f11340562b0 0x7f1134058770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f1144007fd0 tx=0x7f1144007c50).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:10.772 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:10.773+0000 7f113bfff700 1 -- 172.21.15.146:0/2763339318 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f114c01a070 con 0x7f115414ea60 2021-01-27T09:49:11.202 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:11.205+0000 7f1159212700 1 -- 172.21.15.146:0/2763339318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f115405cfe0 con 0x7f115414ea60 2021-01-27T09:49:11.203 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:11.205+0000 7f113bfff700 1 -- 172.21.15.146:0/2763339318 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3583 (secure 0 0 0) 0x7f114c0443d0 con 0x7f115414ea60 2021-01-27T09:49:11.210 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:49:11.211 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4971,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:47:16.693281+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":2,"incarnation":15,"state":"up:active","state_seq":43,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:49:11.214 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:11.217+0000 7f1159212700 1 -- 172.21.15.146:0/2763339318 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f11340562b0 msgr2=0x7f1134058770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:11.214 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:11.217+0000 7f1159212700 1 --2- 172.21.15.146:0/2763339318 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f11340562b0 0x7f1134058770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f1144007fd0 tx=0x7f1144007c50).stop 2021-01-27T09:49:11.215 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:11.217+0000 7f1159212700 1 -- 172.21.15.146:0/2763339318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f115414ea60 msgr2=0x7f1154148630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:11.215 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:11.217+0000 7f1159212700 1 --2- 172.21.15.146:0/2763339318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f115414ea60 0x7f1154148630 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f114c00bae0 tx=0x7f114c009250).stop 2021-01-27T09:49:11.217 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:11.217+0000 7f1159212700 1 -- 172.21.15.146:0/2763339318 shutdown_connections 2021-01-27T09:49:11.217 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:11.217+0000 7f1159212700 1 --2- 172.21.15.146:0/2763339318 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f11340562b0 0x7f1134058770 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:11.217 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:11.217+0000 7f1159212700 1 --2- 172.21.15.146:0/2763339318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f115414ea60 0x7f1154148630 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:11.217 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:11.217+0000 7f1159212700 1 --2- 172.21.15.146:0/2763339318 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f115414c6f0 0x7f1154148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:11.217 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:11.217+0000 7f1159212700 1 --2- 172.21.15.146:0/2763339318 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1154069830 0x7f115415c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:11.218 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:11.217+0000 7f1159212700 1 -- 172.21.15.146:0/2763339318 >> 172.21.15.146:0/2763339318 conn(0x7f1154067e60 msgr2=0x7f1154067570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:11.227 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:11.229+0000 7f1159212700 1 -- 172.21.15.146:0/2763339318 shutdown_connections 2021-01-27T09:49:11.228 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:11.229+0000 7f1159212700 1 -- 172.21.15.146:0/2763339318 wait complete. 2021-01-27T09:49:11.242 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 21 2021-01-27T09:49:11.279 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-01-27T09:49:13.280 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:49:13.876 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.553+0000 7fb818846700 1 Processor -- start 2021-01-27T09:49:13.877 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.553+0000 7fb818846700 1 -- start start 2021-01-27T09:49:13.877 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.553+0000 7fb818846700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb8140b7750 0x7fb8140681e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:13.878 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.553+0000 7fb818846700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb8140beaa0 0x7fb81415aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:13.878 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.553+0000 7fb818846700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb814064360 con 0x7fb814067e00 2021-01-27T09:49:13.878 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.553+0000 7fb818846700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb814064600 con 0x7fb8140beaa0 2021-01-27T09:49:13.878 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.553+0000 7fb818846700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8140648a0 con 0x7fb8140b7750 2021-01-27T09:49:13.878 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.553+0000 7fb81259c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb814067e00 0x7fb8140b8de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50934/0 (socket says 172.21.15.146:50934) 2021-01-27T09:49:13.879 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.553+0000 7fb81259c700 1 -- 172.21.15.146:0/912314767 learned_addr learned my addr 172.21.15.146:0/912314767 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:49:13.879 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.553+0000 7fb812d9d700 1 --2- 172.21.15.146:0/912314767 >> v2:172.21.15.78:3300/0 conn(0x7fb8140beaa0 0x7fb81415aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:13.879 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.553+0000 7fb811d9b700 1 -- 172.21.15.146:0/912314767 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2480383620 0 0) 0x7fb814064360 con 0x7fb814067e00 2021-01-27T09:49:13.879 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.553+0000 7fb809d9b700 1 --2- 172.21.15.146:0/912314767 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb8140b7750 0x7fb8140681e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:13.883 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.885+0000 7fb811d9b700 1 -- 172.21.15.146:0/912314767 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb800003270 con 0x7fb814067e00 2021-01-27T09:49:13.888 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.889+0000 7fb811d9b700 1 -- 172.21.15.146:0/912314767 <== mon.1 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2010388015 0 0) 0x7fb800003270 con 0x7fb814067e00 2021-01-27T09:49:13.889 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.889+0000 7fb811d9b700 1 -- 172.21.15.146:0/912314767 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb8140b7750 msgr2=0x7fb8140681e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:49:13.889 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.889+0000 7fb811d9b700 1 --2- 172.21.15.146:0/912314767 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb8140b7750 0x7fb8140681e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:13.889 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.889+0000 7fb811d9b700 1 -- 172.21.15.146:0/912314767 >> v2:172.21.15.78:3300/0 conn(0x7fb8140beaa0 msgr2=0x7fb81415aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:49:13.889 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.889+0000 7fb811d9b700 1 --2- 172.21.15.146:0/912314767 >> v2:172.21.15.78:3300/0 conn(0x7fb8140beaa0 0x7fb81415aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:13.890 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.889+0000 7fb811d9b700 1 -- 172.21.15.146:0/912314767 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8140b9950 con 0x7fb814067e00 2021-01-27T09:49:13.890 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.889+0000 7fb811d9b700 1 -- 172.21.15.146:0/912314767 <== mon.1 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3890990827 0 0) 0x7fb804001520 con 0x7fb814067e00 2021-01-27T09:49:13.890 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.889+0000 7fb811d9b700 1 -- 172.21.15.146:0/912314767 >> v1:172.21.15.146:6789/0 conn(0x7fb814067e00 legacy=0x7fb8140b8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:13.890 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.889+0000 7fb811d9b700 1 --2- 172.21.15.146:0/912314767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8000037e0 0x7fb800003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:13.891 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.889+0000 7fb811d9b700 1 --2- 172.21.15.146:0/912314767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb800004510 0x7fb800004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:13.891 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.889+0000 7fb811d9b700 1 --2- 172.21.15.146:0/912314767 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb800004e80 0x7fb80000b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:13.891 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.889+0000 7fb811d9b700 1 -- 172.21.15.146:0/912314767 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb814064600 con 0x7fb8000037e0 2021-01-27T09:49:13.891 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.889+0000 7fb811d9b700 1 -- 172.21.15.146:0/912314767 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8140648a0 con 0x7fb800004510 2021-01-27T09:49:13.891 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.889+0000 7fb811d9b700 1 -- 172.21.15.146:0/912314767 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb800005300 con 0x7fb800004e80 2021-01-27T09:49:13.892 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.893+0000 7fb809d9b700 1 --2- 172.21.15.146:0/912314767 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb8140b7750 0x7fb8140681e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:49:13.892 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.893+0000 7fb809d9b700 1 --2- 172.21.15.146:0/912314767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb800004510 0x7fb800004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:13.893 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.893+0000 7fb809d9b700 1 -- 172.21.15.146:0/912314767 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb800004e80 msgr2=0x7fb80000b760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:49:13.893 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.893+0000 7fb809d9b700 1 --2- 172.21.15.146:0/912314767 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb800004e80 0x7fb80000b760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:13.893 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.893+0000 7fb809d9b700 1 -- 172.21.15.146:0/912314767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8000037e0 msgr2=0x7fb800003c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:49:13.894 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.893+0000 7fb809d9b700 1 --2- 172.21.15.146:0/912314767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8000037e0 0x7fb800003c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:13.894 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.893+0000 7fb809d9b700 1 -- 172.21.15.146:0/912314767 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8140b9950 con 0x7fb800004510 2021-01-27T09:49:13.898 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.893+0000 7fb809d9b700 1 --2- 172.21.15.146:0/912314767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb800004510 0x7fb800004990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fb7fc00c960 tx=0x7fb7fc008040).ready entity=mon.1 client_cookie=52e2dbfc8c27281b server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:13.900 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.901+0000 7fb811d9b700 1 -- 172.21.15.146:0/912314767 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc00a7d0 con 0x7fb800004510 2021-01-27T09:49:13.901 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.901+0000 7fb811d9b700 1 -- 172.21.15.146:0/912314767 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc00c030 con 0x7fb800004510 2021-01-27T09:49:13.901 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.901+0000 7fb811d9b700 1 -- 172.21.15.146:0/912314767 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc00ab40 con 0x7fb800004510 2021-01-27T09:49:13.906 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.905+0000 7fb818846700 1 -- 172.21.15.146:0/912314767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb800004510 msgr2=0x7fb800004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:13.906 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.905+0000 7fb818846700 1 --2- 172.21.15.146:0/912314767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb800004510 0x7fb800004990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fb7fc00c960 tx=0x7fb7fc008040).stop 2021-01-27T09:49:13.906 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.905+0000 7fb812d9d700 1 --2- 172.21.15.146:0/912314767 >> v2:172.21.15.78:3300/0 conn(0x7fb8140beaa0 0x7fb81415aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:49:13.906 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.905+0000 7fb812d9d700 1 -- 172.21.15.146:0/912314767 reap_dead start 2021-01-27T09:49:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.913+0000 7fb818846700 1 -- 172.21.15.146:0/912314767 shutdown_connections 2021-01-27T09:49:13.917 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.917+0000 7fb818846700 1 -- 172.21.15.146:0/912314767 >> 172.21.15.146:0/912314767 conn(0x7fb8140609f0 msgr2=0x7fb814069110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:13.919 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.921+0000 7fb818846700 1 -- 172.21.15.146:0/912314767 shutdown_connections 2021-01-27T09:49:13.919 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.921+0000 7fb818846700 1 -- 172.21.15.146:0/912314767 wait complete. 2021-01-27T09:49:13.922 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.925+0000 7fb818846700 1 Processor -- start 2021-01-27T09:49:13.924 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.925+0000 7fb818846700 1 -- start start 2021-01-27T09:49:13.925 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.925+0000 7fb818846700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb800004510 0x7fb81415dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:13.926 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.925+0000 7fb818846700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb8140bca20 0x7fb81416dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:13.926 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.929+0000 7fb818846700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8141537a0 0x7fb8140ad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:13.927 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.929+0000 7fb809d9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb8140bca20 0x7fb81416dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:13.927 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.929+0000 7fb809d9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb8140bca20 0x7fb81416dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:40860/0 (socket says 172.21.15.146:40860) 2021-01-27T09:49:13.927 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.929+0000 7fb809d9b700 1 -- 172.21.15.146:0/371695957 learned_addr learned my addr 172.21.15.146:0/371695957 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:49:13.927 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.929+0000 7fb812d9d700 1 --2- 172.21.15.146:0/371695957 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8141537a0 0x7fb8140ad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:13.928 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.929+0000 7fb81259c700 1 --2- 172.21.15.146:0/371695957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb800004510 0x7fb81415dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:13.928 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.929+0000 7fb818846700 1 -- 172.21.15.146:0/371695957 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8140af750 con 0x7fb800004510 2021-01-27T09:49:13.929 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.929+0000 7fb818846700 1 -- 172.21.15.146:0/371695957 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8140afec0 con 0x7fb8141537a0 2021-01-27T09:49:13.929 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.929+0000 7fb818846700 1 -- 172.21.15.146:0/371695957 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8140af980 con 0x7fb8140bca20 2021-01-27T09:49:13.929 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.929+0000 7fb809d9b700 1 -- 172.21.15.146:0/371695957 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8141537a0 msgr2=0x7fb8140ad7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:13.929 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.929+0000 7fb809d9b700 1 --2- 172.21.15.146:0/371695957 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8141537a0 0x7fb8140ad7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:13.929 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.929+0000 7fb809d9b700 1 -- 172.21.15.146:0/371695957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb800004510 msgr2=0x7fb81415dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:13.930 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.929+0000 7fb809d9b700 1 --2- 172.21.15.146:0/371695957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb800004510 0x7fb81415dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:13.930 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.929+0000 7fb809d9b700 1 -- 172.21.15.146:0/371695957 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8140afc20 con 0x7fb8140bca20 2021-01-27T09:49:13.930 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.929+0000 7fb81259c700 1 --2- 172.21.15.146:0/371695957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb800004510 0x7fb81415dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:49:13.930 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.929+0000 7fb812d9d700 1 --2- 172.21.15.146:0/371695957 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8141537a0 0x7fb8140ad7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:49:13.930 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.929+0000 7fb809d9b700 1 --2- 172.21.15.146:0/371695957 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb8140bca20 0x7fb81416dcd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fb800004410 tx=0x7fb7fc008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:13.938 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.929+0000 7fb80affd700 1 -- 172.21.15.146:0/371695957 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc01c5a0 con 0x7fb8140bca20 2021-01-27T09:49:13.938 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.929+0000 7fb80affd700 1 -- 172.21.15.146:0/371695957 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc01c700 con 0x7fb8140bca20 2021-01-27T09:49:13.938 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.929+0000 7fb80affd700 1 -- 172.21.15.146:0/371695957 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc01cac0 con 0x7fb8140bca20 2021-01-27T09:49:13.939 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.929+0000 7fb818846700 1 -- 172.21.15.146:0/371695957 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb81416d590 con 0x7fb8140bca20 2021-01-27T09:49:13.939 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.929+0000 7fb818846700 1 -- 172.21.15.146:0/371695957 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8140acf10 con 0x7fb8140bca20 2021-01-27T09:49:13.939 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.933+0000 7fb80affd700 1 -- 172.21.15.146:0/371695957 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fb7fc024030 con 0x7fb8140bca20 2021-01-27T09:49:13.939 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.933+0000 7fb80affd700 1 --2- 172.21.15.146:0/371695957 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fb7f8056260 0x7fb7f8058720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:13.939 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.933+0000 7fb81259c700 1 --2- 172.21.15.146:0/371695957 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fb7f8056260 0x7fb7f8058720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:13.940 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.933+0000 7fb80affd700 1 -- 172.21.15.146:0/371695957 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6911+0+0 (secure 0 0 0) 0x7fb7fc070a50 con 0x7fb8140bca20 2021-01-27T09:49:13.940 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.937+0000 7fb81259c700 1 --2- 172.21.15.146:0/371695957 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fb7f8056260 0x7fb7f8058720 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fb804001050 tx=0x7fb804000d90).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:13.948 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.949+0000 7fb818846700 1 -- 172.21.15.146:0/371695957 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7ec004fa0 con 0x7fb8140bca20 2021-01-27T09:49:13.957 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:13.957+0000 7fb80affd700 1 -- 172.21.15.146:0/371695957 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fb7fc046020 con 0x7fb8140bca20 2021-01-27T09:49:13.990 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:49:13.992 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:49:14.314 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:14.313+0000 7fb818846700 1 -- 172.21.15.146:0/371695957 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7ec0057d0 con 0x7fb8140bca20 2021-01-27T09:49:14.317 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:14.317+0000 7fb80affd700 1 -- 172.21.15.146:0/371695957 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3583 (secure 0 0 0) 0x7fb7fc022020 con 0x7fb8140bca20 2021-01-27T09:49:14.318 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:49:14.318 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4971,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:47:16.693281+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":2,"incarnation":15,"state":"up:active","state_seq":43,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:49:14.327 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:14.325+0000 7fb818846700 1 -- 172.21.15.146:0/371695957 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fb7f8056260 msgr2=0x7fb7f8058720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:14.328 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:14.325+0000 7fb818846700 1 --2- 172.21.15.146:0/371695957 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fb7f8056260 0x7fb7f8058720 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fb804001050 tx=0x7fb804000d90).stop 2021-01-27T09:49:14.328 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:14.325+0000 7fb818846700 1 -- 172.21.15.146:0/371695957 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb8140bca20 msgr2=0x7fb81416dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:14.328 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:14.325+0000 7fb818846700 1 --2- 172.21.15.146:0/371695957 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb8140bca20 0x7fb81416dcd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fb800004410 tx=0x7fb7fc008040).stop 2021-01-27T09:49:14.328 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:14.325+0000 7fb818846700 1 -- 172.21.15.146:0/371695957 shutdown_connections 2021-01-27T09:49:14.329 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:14.325+0000 7fb818846700 1 --2- 172.21.15.146:0/371695957 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fb7f8056260 0x7fb7f8058720 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:14.329 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:14.325+0000 7fb818846700 1 --2- 172.21.15.146:0/371695957 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8141537a0 0x7fb8140ad7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:14.329 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:14.325+0000 7fb818846700 1 --2- 172.21.15.146:0/371695957 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb8140bca20 0x7fb81416dcd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:14.329 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:14.325+0000 7fb818846700 1 --2- 172.21.15.146:0/371695957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb800004510 0x7fb81415dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:14.329 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:14.325+0000 7fb818846700 1 -- 172.21.15.146:0/371695957 >> 172.21.15.146:0/371695957 conn(0x7fb8140609f0 msgr2=0x7fb8140bab70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:14.330 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:14.329+0000 7fb818846700 1 -- 172.21.15.146:0/371695957 shutdown_connections 2021-01-27T09:49:14.330 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:14.329+0000 7fb818846700 1 -- 172.21.15.146:0/371695957 wait complete. 2021-01-27T09:49:14.330 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 21 2021-01-27T09:49:14.359 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-01-27T09:49:16.359 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:49:16.685 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.685+0000 7f76f6487700 1 Processor -- start 2021-01-27T09:49:16.685 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.685+0000 7f76f6487700 1 -- start start 2021-01-27T09:49:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.689+0000 7f76f6487700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76e80e1ac0 0x7f76e800c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.689+0000 7f76f6487700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f76e80e1ea0 0x7f76e804c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.689+0000 7f76f6487700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e800c9e0 con 0x7f76e804d360 2021-01-27T09:49:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.689+0000 7f76f6487700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e8046a70 con 0x7f76e80e1ea0 2021-01-27T09:49:16.690 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.689+0000 7f76f6487700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e8046d10 con 0x7f76e80e1ac0 2021-01-27T09:49:16.691 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.689+0000 7f76f5485700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76e80e1ac0 0x7f76e800c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:16.691 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.689+0000 7f76f5485700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76e80e1ac0 0x7f76e800c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:40920/0 (socket says 172.21.15.146:40920) 2021-01-27T09:49:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.689+0000 7f76f5485700 1 -- 172.21.15.146:0/1345664059 learned_addr learned my addr 172.21.15.146:0/1345664059 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:49:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.689+0000 7f76f5485700 1 -- 172.21.15.146:0/1345664059 >> v2:172.21.15.78:3300/0 conn(0x7f76e80e1ea0 msgr2=0x7f76e804c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:49:16.693 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.689+0000 7f76f5485700 1 --2- 172.21.15.146:0/1345664059 >> v2:172.21.15.78:3300/0 conn(0x7f76e80e1ea0 0x7f76e804c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:16.693 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.689+0000 7f76f5485700 1 -- 172.21.15.146:0/1345664059 >> v1:172.21.15.146:6789/0 conn(0x7f76e804d360 legacy=0x7f76e80de6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:49:16.693 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.689+0000 7f76f5485700 1 -- 172.21.15.146:0/1345664059 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e8046fb0 con 0x7f76e80e1ac0 2021-01-27T09:49:16.693 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.689+0000 7f76f5485700 1 --2- 172.21.15.146:0/1345664059 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76e80e1ac0 0x7f76e800c4f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f76ec00ba70 tx=0x7f76ec006e80).ready entity=mon.2 client_cookie=1eb3d72de7191e71 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:16.694 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.689+0000 7f76e7fff700 1 -- 172.21.15.146:0/1345664059 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec009900 con 0x7f76e80e1ac0 2021-01-27T09:49:16.694 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.689+0000 7f76e7fff700 1 -- 172.21.15.146:0/1345664059 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ec009a60 con 0x7f76e80e1ac0 2021-01-27T09:49:16.694 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.689+0000 7f76e7fff700 1 -- 172.21.15.146:0/1345664059 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec009de0 con 0x7f76e80e1ac0 2021-01-27T09:49:16.694 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.693+0000 7f76f6487700 1 -- 172.21.15.146:0/1345664059 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76e80e1ac0 msgr2=0x7f76e800c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.693+0000 7f76f6487700 1 --2- 172.21.15.146:0/1345664059 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76e80e1ac0 0x7f76e800c4f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f76ec00ba70 tx=0x7f76ec006e80).stop 2021-01-27T09:49:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.693+0000 7f76f6487700 1 -- 172.21.15.146:0/1345664059 shutdown_connections 2021-01-27T09:49:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.693+0000 7f76f6487700 1 --2- 172.21.15.146:0/1345664059 >> v2:172.21.15.78:3300/0 conn(0x7f76e80e1ea0 0x7f76e804c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.693+0000 7f76f6487700 1 --2- 172.21.15.146:0/1345664059 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76e80e1ac0 0x7f76e800c4f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.693+0000 7f76f6487700 1 -- 172.21.15.146:0/1345664059 >> 172.21.15.146:0/1345664059 conn(0x7f76e800e510 msgr2=0x7f76e8009900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:16.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.709+0000 7f76f6487700 1 -- 172.21.15.146:0/1345664059 shutdown_connections 2021-01-27T09:49:16.713 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.713+0000 7f76f6487700 1 -- 172.21.15.146:0/1345664059 wait complete. 2021-01-27T09:49:16.714 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.713+0000 7f76f6487700 1 Processor -- start 2021-01-27T09:49:16.714 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.713+0000 7f76f6487700 1 -- start start 2021-01-27T09:49:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76f6487700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76e804d360 0x7f76e80fd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76f6487700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76e80e1ac0 0x7f76e8049550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76f6487700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76e80e1ea0 0x7f76e804de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:16.716 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76f6487700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e80fca30 con 0x7f76e80e1ac0 2021-01-27T09:49:16.717 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76f6487700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e80e4ea0 con 0x7f76e80e1ea0 2021-01-27T09:49:16.717 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76f6487700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e80e5140 con 0x7f76e804d360 2021-01-27T09:49:16.718 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76f5485700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76e804d360 0x7f76e80fd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:16.718 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76f4c84700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76e80e1ac0 0x7f76e8049550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:16.718 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76f5485700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76e804d360 0x7f76e80fd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:40928/0 (socket says 172.21.15.146:40928) 2021-01-27T09:49:16.718 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76f4c84700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76e80e1ac0 0x7f76e8049550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:54318/0 (socket says 172.21.15.146:54318) 2021-01-27T09:49:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76f5485700 1 -- 172.21.15.146:0/2911473641 learned_addr learned my addr 172.21.15.146:0/2911473641 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:49:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76f5c86700 1 --2- 172.21.15.146:0/2911473641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76e80e1ea0 0x7f76e804de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:16.720 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76f5485700 1 -- 172.21.15.146:0/2911473641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76e80e1ea0 msgr2=0x7f76e804de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:16.720 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76f5485700 1 --2- 172.21.15.146:0/2911473641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76e80e1ea0 0x7f76e804de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:16.720 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76f5485700 1 -- 172.21.15.146:0/2911473641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76e80e1ac0 msgr2=0x7f76e8049550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:16.721 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76f5485700 1 --2- 172.21.15.146:0/2911473641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76e80e1ac0 0x7f76e8049550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:16.721 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76f5485700 1 -- 172.21.15.146:0/2911473641 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e80e53e0 con 0x7f76e804d360 2021-01-27T09:49:16.722 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76f4c84700 1 --2- 172.21.15.146:0/2911473641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76e80e1ac0 0x7f76e8049550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:49:16.722 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76f5485700 1 --2- 172.21.15.146:0/2911473641 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76e804d360 0x7f76e80fd3f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f76ec00b1d0 tx=0x7f76ec015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:16.723 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76e57fa700 1 -- 172.21.15.146:0/2911473641 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec005ae0 con 0x7f76e804d360 2021-01-27T09:49:16.723 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76e57fa700 1 -- 172.21.15.146:0/2911473641 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ec005c40 con 0x7f76e804d360 2021-01-27T09:49:16.723 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76f6487700 1 -- 172.21.15.146:0/2911473641 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e80fccb0 con 0x7f76e804d360 2021-01-27T09:49:16.724 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76e57fa700 1 -- 172.21.15.146:0/2911473641 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec01e460 con 0x7f76e804d360 2021-01-27T09:49:16.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.717+0000 7f76f6487700 1 -- 172.21.15.146:0/2911473641 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e80fd8e0 con 0x7f76e804d360 2021-01-27T09:49:16.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.725+0000 7f76f6487700 1 -- 172.21.15.146:0/2911473641 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e80051a0 con 0x7f76e804d360 2021-01-27T09:49:16.726 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.725+0000 7f76e57fa700 1 -- 172.21.15.146:0/2911473641 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f76ec01a040 con 0x7f76e804d360 2021-01-27T09:49:16.726 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.729+0000 7f76e57fa700 1 --2- 172.21.15.146:0/2911473641 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f76d0056210 0x7f76d00586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:16.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.729+0000 7f76e57fa700 1 -- 172.21.15.146:0/2911473641 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6911+0+0 (secure 0 0 0) 0x7f76ec070890 con 0x7f76e804d360 2021-01-27T09:49:16.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.729+0000 7f76f4c84700 1 --2- 172.21.15.146:0/2911473641 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f76d0056210 0x7f76d00586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:16.728 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.729+0000 7f76f4c84700 1 --2- 172.21.15.146:0/2911473641 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f76d0056210 0x7f76d00586d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f76e804e880 tx=0x7f76e0008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:16.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:16.741+0000 7f76e57fa700 1 -- 172.21.15.146:0/2911473641 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f76ec045fa0 con 0x7f76e804d360 2021-01-27T09:49:17.186 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:17.189+0000 7f76f6487700 1 -- 172.21.15.146:0/2911473641 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76e800ad10 con 0x7f76e804d360 2021-01-27T09:49:17.187 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:17.189+0000 7f76e57fa700 1 -- 172.21.15.146:0/2911473641 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3583 (secure 0 0 0) 0x7f76ec023020 con 0x7f76e804d360 2021-01-27T09:49:17.190 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:49:17.190 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4971,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":20}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:47:16.693281+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":2,"incarnation":15,"state":"up:active","state_seq":43,"addr":"172.21.15.146:6835/1106324127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1106324127},{"type":"v1","addr":"172.21.15.146:6835","nonce":1106324127}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:49:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:17.193+0000 7f76daffd700 1 -- 172.21.15.146:0/2911473641 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f76d0056210 msgr2=0x7f76d00586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:17.193+0000 7f76daffd700 1 --2- 172.21.15.146:0/2911473641 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f76d0056210 0x7f76d00586d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f76e804e880 tx=0x7f76e0008040).stop 2021-01-27T09:49:17.193 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:17.193+0000 7f76daffd700 1 -- 172.21.15.146:0/2911473641 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76e804d360 msgr2=0x7f76e80fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:17.193 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:17.193+0000 7f76daffd700 1 --2- 172.21.15.146:0/2911473641 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76e804d360 0x7f76e80fd3f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f76ec00b1d0 tx=0x7f76ec015000).stop 2021-01-27T09:49:17.196 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:17.197+0000 7f76daffd700 1 -- 172.21.15.146:0/2911473641 shutdown_connections 2021-01-27T09:49:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:17.197+0000 7f76daffd700 1 --2- 172.21.15.146:0/2911473641 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f76d0056210 0x7f76d00586d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:17.197+0000 7f76daffd700 1 --2- 172.21.15.146:0/2911473641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76e80e1ea0 0x7f76e804de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:17.197+0000 7f76daffd700 1 --2- 172.21.15.146:0/2911473641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76e80e1ac0 0x7f76e8049550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:17.197+0000 7f76daffd700 1 --2- 172.21.15.146:0/2911473641 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f76e804d360 0x7f76e80fd3f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:17.199 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:17.197+0000 7f76daffd700 1 -- 172.21.15.146:0/2911473641 >> 172.21.15.146:0/2911473641 conn(0x7f76e800e510 msgr2=0x7f76e804ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:17.200 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:17.197+0000 7f76daffd700 1 -- 172.21.15.146:0/2911473641 shutdown_connections 2021-01-27T09:49:17.200 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:17.197+0000 7f76daffd700 1 -- 172.21.15.146:0/2911473641 wait complete. 2021-01-27T09:49:17.201 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 21 2021-01-27T09:49:17.226 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2021-01-27T09:49:19.227 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:49:19.529 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.529+0000 7f9dba839700 1 Processor -- start 2021-01-27T09:49:19.529 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.529+0000 7f9dba839700 1 -- start start 2021-01-27T09:49:19.531 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.533+0000 7f9dba839700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9db414dc70 0x7f9db40bf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.533+0000 7f9db9837700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9db40bf050 0x7f9db414ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51086/0 (socket says 172.21.15.146:51086) 2021-01-27T09:49:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.533+0000 7f9dba038700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9db4151cc0 0x7f9db41585e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:39124/0 (socket says 172.21.15.146:39124) 2021-01-27T09:49:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.533+0000 7f9db9036700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9db414dc70 0x7f9db40bf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.533+0000 7f9db9036700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9db414dc70 0x7f9db40bf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51516/0 (socket says 172.21.15.146:51516) 2021-01-27T09:49:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.533+0000 7f9db9837700 1 -- 172.21.15.146:0/2450288255 learned_addr learned my addr 172.21.15.146:0/2450288255 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:49:19.534 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.533+0000 7f9dba839700 1 -- 172.21.15.146:0/2450288255 --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db4065e10 con 0x7f9db4151cc0 2021-01-27T09:49:19.534 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.533+0000 7f9dba839700 1 -- 172.21.15.146:0/2450288255 --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db4066580 con 0x7f9db40bf050 2021-01-27T09:49:19.534 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.533+0000 7f9dba839700 1 -- 172.21.15.146:0/2450288255 --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db40c4b50 con 0x7f9db414dc70 2021-01-27T09:49:19.537 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.537+0000 7f9db8835700 1 -- 172.21.15.146:0/2450288255 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831605189 0 0) 0x7f9db4066580 con 0x7f9db40bf050 2021-01-27T09:49:19.538 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.537+0000 7f9db8835700 1 -- 172.21.15.146:0/2450288255 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d9c003270 con 0x7f9db40bf050 2021-01-27T09:49:19.538 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.537+0000 7f9db8835700 1 -- 172.21.15.146:0/2450288255 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871476861 0 0) 0x7f9db4065e10 con 0x7f9db4151cc0 2021-01-27T09:49:19.538 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.537+0000 7f9db8835700 1 -- 172.21.15.146:0/2450288255 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9db4066580 con 0x7f9db4151cc0 2021-01-27T09:49:19.540 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.541+0000 7f9db8835700 1 -- 172.21.15.146:0/2450288255 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2249374280 0 0) 0x7f9db4066580 con 0x7f9db4151cc0 2021-01-27T09:49:19.540 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.541+0000 7f9db8835700 1 -- 172.21.15.146:0/2450288255 >> v2:172.21.15.146:3300/0 conn(0x7f9db414dc70 msgr2=0x7f9db40bf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:49:19.540 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.541+0000 7f9db8835700 1 --2- 172.21.15.146:0/2450288255 >> v2:172.21.15.146:3300/0 conn(0x7f9db414dc70 0x7f9db40bf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:19.540 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.541+0000 7f9db8835700 1 -- 172.21.15.146:0/2450288255 >> v1:172.21.15.146:6789/0 conn(0x7f9db40bf050 legacy=0x7f9db414ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:19.541 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.541+0000 7f9db8835700 1 -- 172.21.15.146:0/2450288255 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db4066040 con 0x7f9db4151cc0 2021-01-27T09:49:19.541 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.541+0000 7f9db8835700 1 -- 172.21.15.146:0/2450288255 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3890990827 0 0) 0x7f9dac0018a0 con 0x7f9db4151cc0 2021-01-27T09:49:19.541 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.541+0000 7f9db8835700 1 -- 172.21.15.146:0/2450288255 >> v1:172.21.15.78:6789/0 conn(0x7f9db4151cc0 legacy=0x7f9db41585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:19.541 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.541+0000 7f9db8835700 1 --2- 172.21.15.146:0/2450288255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d9c004980 0x7f9d9c004d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.541+0000 7f9db8835700 1 --2- 172.21.15.146:0/2450288255 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9d9c0034b0 0x7f9d9c003930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.541+0000 7f9db8835700 1 --2- 172.21.15.146:0/2450288255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9c003e20 0x7f9d9c00b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.541+0000 7f9db8835700 1 -- 172.21.15.146:0/2450288255 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c004300 con 0x7f9d9c004980 2021-01-27T09:49:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.541+0000 7f9db8835700 1 -- 172.21.15.146:0/2450288255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c00bc50 con 0x7f9d9c003e20 2021-01-27T09:49:19.543 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.541+0000 7f9db8835700 1 -- 172.21.15.146:0/2450288255 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c00bdc0 con 0x7f9d9c0034b0 2021-01-27T09:49:19.543 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.541+0000 7f9db9036700 1 --2- 172.21.15.146:0/2450288255 >> v2:172.21.15.146:3300/0 conn(0x7f9db414dc70 0x7f9db40bf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:49:19.543 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.541+0000 7f9dba038700 1 --2- 172.21.15.146:0/2450288255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9c003e20 0x7f9d9c00b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:19.545 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.541+0000 7f9db9837700 1 --2- 172.21.15.146:0/2450288255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d9c004980 0x7f9d9c004d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:19.545 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.541+0000 7f9dba038700 1 -- 172.21.15.146:0/2450288255 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9d9c0034b0 msgr2=0x7f9d9c003930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:49:19.545 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.541+0000 7f9dba038700 1 --2- 172.21.15.146:0/2450288255 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9d9c0034b0 0x7f9d9c003930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:19.545 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.541+0000 7f9dba038700 1 -- 172.21.15.146:0/2450288255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d9c004980 msgr2=0x7f9d9c004d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:49:19.546 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.541+0000 7f9dba038700 1 --2- 172.21.15.146:0/2450288255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d9c004980 0x7f9d9c004d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:19.546 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.541+0000 7f9dba038700 1 -- 172.21.15.146:0/2450288255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db4066040 con 0x7f9d9c003e20 2021-01-27T09:49:19.546 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.541+0000 7f9dba038700 1 -- 172.21.15.146:0/2450288255 reap_dead start 2021-01-27T09:49:19.546 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.541+0000 7f9dba038700 1 --2- 172.21.15.146:0/2450288255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9c003e20 0x7f9d9c00b760 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f9dac00c630 tx=0x7f9dac007ac0).ready entity=mon.1 client_cookie=6238132a1605b522 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:19.546 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.545+0000 7f9db8835700 1 -- 172.21.15.146:0/2450288255 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac005af0 con 0x7f9d9c003e20 2021-01-27T09:49:19.547 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.545+0000 7f9db8835700 1 -- 172.21.15.146:0/2450288255 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac005c70 con 0x7f9d9c003e20 2021-01-27T09:49:19.547 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.545+0000 7f9db8835700 1 -- 172.21.15.146:0/2450288255 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac0070d0 con 0x7f9d9c003e20 2021-01-27T09:49:19.547 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.545+0000 7f9dba839700 1 -- 172.21.15.146:0/2450288255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9c003e20 msgr2=0x7f9d9c00b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:19.547 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.545+0000 7f9dba839700 1 --2- 172.21.15.146:0/2450288255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9c003e20 0x7f9d9c00b760 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f9dac00c630 tx=0x7f9dac007ac0).stop 2021-01-27T09:49:19.547 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.545+0000 7f9dba839700 1 -- 172.21.15.146:0/2450288255 shutdown_connections 2021-01-27T09:49:19.548 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.545+0000 7f9dba839700 1 --2- 172.21.15.146:0/2450288255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9c003e20 0x7f9d9c00b760 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:19.548 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.545+0000 7f9dba839700 1 -- 172.21.15.146:0/2450288255 >> 172.21.15.146:0/2450288255 conn(0x7f9db4064f30 msgr2=0x7f9db4065340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:19.548 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.549+0000 7f9dba839700 1 -- 172.21.15.146:0/2450288255 shutdown_connections 2021-01-27T09:49:19.549 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.549+0000 7f9dba839700 1 -- 172.21.15.146:0/2450288255 wait complete. 2021-01-27T09:49:19.553 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.553+0000 7f9dba839700 1 Processor -- start 2021-01-27T09:49:19.555 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.557+0000 7f9dba839700 1 -- start start 2021-01-27T09:49:19.557 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.557+0000 7f9dba839700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d9c003e20 0x7f9db4161de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:19.558 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.557+0000 7f9dba839700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9db4148610 0x7f9db4147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:19.559 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.561+0000 7f9dba839700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9db4147e10 0x7f9db4154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:19.559 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.561+0000 7f9dba839700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db4149750 con 0x7f9d9c003e20 2021-01-27T09:49:19.560 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.561+0000 7f9dba839700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db41499f0 con 0x7f9db4148610 2021-01-27T09:49:19.560 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.561+0000 7f9dba839700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db4149c90 con 0x7f9db4147e10 2021-01-27T09:49:19.561 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.561+0000 7f9dba038700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9db4147e10 0x7f9db4154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:19.561 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.561+0000 7f9db9036700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9db4148610 0x7f9db4147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:19.561 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.561+0000 7f9dba038700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9db4147e10 0x7f9db4154c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:41012/0 (socket says 172.21.15.146:41012) 2021-01-27T09:49:19.562 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.561+0000 7f9dba038700 1 -- 172.21.15.146:0/168195636 learned_addr learned my addr 172.21.15.146:0/168195636 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:49:19.562 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.561+0000 7f9dba038700 1 -- 172.21.15.146:0/168195636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9db4148610 msgr2=0x7f9db4147920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:19.564 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.561+0000 7f9dba038700 1 --2- 172.21.15.146:0/168195636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9db4148610 0x7f9db4147920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:19.565 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.561+0000 7f9dba038700 1 -- 172.21.15.146:0/168195636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d9c003e20 msgr2=0x7f9db4161de0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-27T09:49:19.565 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.561+0000 7f9dba038700 1 --2- 172.21.15.146:0/168195636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d9c003e20 0x7f9db4161de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:19.565 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.561+0000 7f9dba038700 1 -- 172.21.15.146:0/168195636 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db4149f30 con 0x7f9db4147e10 2021-01-27T09:49:19.566 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.561+0000 7f9db9036700 1 --2- 172.21.15.146:0/168195636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9db4148610 0x7f9db4147920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:49:19.566 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.561+0000 7f9dba038700 1 --2- 172.21.15.146:0/168195636 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9db4147e10 0x7f9db4154c00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f9dac000f80 tx=0x7f9dac015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:19.567 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.561+0000 7f9da1ffb700 1 -- 172.21.15.146:0/168195636 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac017070 con 0x7f9db4147e10 2021-01-27T09:49:19.567 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.561+0000 7f9da1ffb700 1 -- 172.21.15.146:0/168195636 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac013450 con 0x7f9db4147e10 2021-01-27T09:49:19.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.561+0000 7f9da1ffb700 1 -- 172.21.15.146:0/168195636 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac013850 con 0x7f9db4147e10 2021-01-27T09:49:19.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.561+0000 7f9dba839700 1 -- 172.21.15.146:0/168195636 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db414a1d0 con 0x7f9db4147e10 2021-01-27T09:49:19.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.561+0000 7f9dba839700 1 -- 172.21.15.146:0/168195636 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db41622d0 con 0x7f9db4147e10 2021-01-27T09:49:19.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.565+0000 7f9dba839700 1 -- 172.21.15.146:0/168195636 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d90004fa0 con 0x7f9db4147e10 2021-01-27T09:49:19.569 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.565+0000 7f9da1ffb700 1 -- 172.21.15.146:0/168195636 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f9dac025030 con 0x7f9db4147e10 2021-01-27T09:49:19.569 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.569+0000 7f9da1ffb700 1 --2- 172.21.15.146:0/168195636 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9d940561e0 0x7f9d940586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:19.569 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.569+0000 7f9da1ffb700 1 -- 172.21.15.146:0/168195636 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6997+0+0 (secure 0 0 0) 0x7f9dac0705d0 con 0x7f9db4147e10 2021-01-27T09:49:19.570 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.569+0000 7f9db9837700 1 --2- 172.21.15.146:0/168195636 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9d940561e0 0x7f9d940586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:19.570 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.569+0000 7f9db9837700 1 --2- 172.21.15.146:0/168195636 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9d940561e0 0x7f9d940586a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f9db0007180 tx=0x7f9db00076b0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:19.571 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:19.573+0000 7f9da1ffb700 1 -- 172.21.15.146:0/168195636 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f9dac075060 con 0x7f9db4147e10 2021-01-27T09:49:20.107 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.109+0000 7f9dba839700 1 -- 172.21.15.146:0/168195636 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d900057d0 con 0x7f9db4147e10 2021-01-27T09:49:20.112 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.113+0000 7f9da1ffb700 1 -- 172.21.15.146:0/168195636 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+3228 (secure 0 0 0) 0x7f9dac023090 con 0x7f9db4147e10 2021-01-27T09:49:20.113 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:49:20.113 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:49:19.652406+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4971":{"gid":4971,"name":"e","rank":2,"incarnation":22,"state":"up:resolve","state_seq":33,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:49:20.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.121+0000 7f9dba839700 1 -- 172.21.15.146:0/168195636 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9d940561e0 msgr2=0x7f9d940586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:20.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.121+0000 7f9dba839700 1 --2- 172.21.15.146:0/168195636 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9d940561e0 0x7f9d940586a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f9db0007180 tx=0x7f9db00076b0).stop 2021-01-27T09:49:20.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.121+0000 7f9dba839700 1 -- 172.21.15.146:0/168195636 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9db4147e10 msgr2=0x7f9db4154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:20.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.121+0000 7f9dba839700 1 --2- 172.21.15.146:0/168195636 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9db4147e10 0x7f9db4154c00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f9dac000f80 tx=0x7f9dac015000).stop 2021-01-27T09:49:20.120 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.121+0000 7f9dba839700 1 -- 172.21.15.146:0/168195636 shutdown_connections 2021-01-27T09:49:20.120 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.121+0000 7f9dba839700 1 --2- 172.21.15.146:0/168195636 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9db4147e10 0x7f9db4154c00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:20.120 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.121+0000 7f9dba839700 1 --2- 172.21.15.146:0/168195636 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9d940561e0 0x7f9d940586a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:20.120 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.121+0000 7f9dba839700 1 --2- 172.21.15.146:0/168195636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9db4148610 0x7f9db4147920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:20.121 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.121+0000 7f9dba839700 1 --2- 172.21.15.146:0/168195636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d9c003e20 0x7f9db4161de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:20.121 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.121+0000 7f9dba839700 1 -- 172.21.15.146:0/168195636 >> 172.21.15.146:0/168195636 conn(0x7f9db4064f30 msgr2=0x7f9db414c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:20.121 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.121+0000 7f9dba839700 1 -- 172.21.15.146:0/168195636 shutdown_connections 2021-01-27T09:49:20.121 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.121+0000 7f9dba839700 1 -- 172.21.15.146:0/168195636 wait complete. 2021-01-27T09:49:20.122 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 23 2021-01-27T09:49:20.150 INFO:tasks.mds_thrash.fs.[cephfs]:mds.a down, removed from mdsmap 2021-01-27T09:49:20.150 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2021-01-27T09:49:20.151 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:49:20.414 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.417+0000 7fc8b6835700 1 Processor -- start 2021-01-27T09:49:20.415 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.417+0000 7fc8b6835700 1 -- start start 2021-01-27T09:49:20.417 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.417+0000 7fc8b6835700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc8b00692b0 0x7fc8b0065ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:20.417 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.417+0000 7fc8b6835700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc8b01514c0 0x7fc8b0067610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:20.417 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.417+0000 7fc8b6835700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b00bb050 con 0x7fc8b0069690 2021-01-27T09:49:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.417+0000 7fc8b6835700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b00b8db0 con 0x7fc8b00692b0 2021-01-27T09:49:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.417+0000 7fc8b6835700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b0151910 con 0x7fc8b01514c0 2021-01-27T09:49:20.419 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.417+0000 7fc8affff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc8b00692b0 0x7fc8b0065ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:20.419 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.417+0000 7fc8af7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc8b0069690 0x7fc8b00b8690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:39154/0 (socket says 172.21.15.146:39154) 2021-01-27T09:49:20.419 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.417+0000 7fc8af7fe700 1 -- 172.21.15.146:0/1755546317 learned_addr learned my addr 172.21.15.146:0/1755546317 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:49:20.420 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.421+0000 7fc8aeffd700 1 -- 172.21.15.146:0/1755546317 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553847025 0 0) 0x7fc8b00bb050 con 0x7fc8b0069690 2021-01-27T09:49:20.420 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.421+0000 7fc8aeffd700 1 -- 172.21.15.146:0/1755546317 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc89c003270 con 0x7fc8b0069690 2021-01-27T09:49:20.422 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.421+0000 7fc8aeffd700 1 -- 172.21.15.146:0/1755546317 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2455161671 0 0) 0x7fc89c003270 con 0x7fc8b0069690 2021-01-27T09:49:20.422 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.421+0000 7fc8aeffd700 1 -- 172.21.15.146:0/1755546317 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc8b01514c0 msgr2=0x7fc8b0067610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:49:20.422 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.421+0000 7fc8aeffd700 1 --2- 172.21.15.146:0/1755546317 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc8b01514c0 0x7fc8b0067610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:20.422 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.421+0000 7fc8aeffd700 1 -- 172.21.15.146:0/1755546317 >> v2:172.21.15.78:3300/0 conn(0x7fc8b00692b0 msgr2=0x7fc8b0065ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:49:20.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.421+0000 7fc8aeffd700 1 --2- 172.21.15.146:0/1755546317 >> v2:172.21.15.78:3300/0 conn(0x7fc8b00692b0 0x7fc8b0065ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:20.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.421+0000 7fc8aeffd700 1 -- 172.21.15.146:0/1755546317 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b00bb2f0 con 0x7fc8b0069690 2021-01-27T09:49:20.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.421+0000 7fc8aeffd700 1 -- 172.21.15.146:0/1755546317 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3890990827 0 0) 0x7fc8a4001520 con 0x7fc8b0069690 2021-01-27T09:49:20.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.421+0000 7fc8aeffd700 1 -- 172.21.15.146:0/1755546317 >> v1:172.21.15.78:6789/0 conn(0x7fc8b0069690 legacy=0x7fc8b00b8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:20.424 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.421+0000 7fc8aeffd700 1 --2- 172.21.15.146:0/1755546317 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc89c0037b0 0x7fc89c003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:20.424 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.421+0000 7fc8aeffd700 1 --2- 172.21.15.146:0/1755546317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc89c004510 0x7fc89c004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:20.424 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.421+0000 7fc8aeffd700 1 --2- 172.21.15.146:0/1755546317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc89c004e80 0x7fc89c00b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:20.424 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.421+0000 7fc8aeffd700 1 -- 172.21.15.146:0/1755546317 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b00b8db0 con 0x7fc89c004e80 2021-01-27T09:49:20.424 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.421+0000 7fc8aeffd700 1 -- 172.21.15.146:0/1755546317 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b0151910 con 0x7fc89c004510 2021-01-27T09:49:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.421+0000 7fc8aeffd700 1 -- 172.21.15.146:0/1755546317 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c004290 con 0x7fc89c0037b0 2021-01-27T09:49:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.421+0000 7fc8af7fe700 1 --2- 172.21.15.146:0/1755546317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc89c004510 0x7fc89c004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.421+0000 7fc8af7fe700 1 -- 172.21.15.146:0/1755546317 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc89c0037b0 msgr2=0x7fc89c003bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:49:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.421+0000 7fc8af7fe700 1 --2- 172.21.15.146:0/1755546317 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc89c0037b0 0x7fc89c003bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.421+0000 7fc8af7fe700 1 -- 172.21.15.146:0/1755546317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc89c004e80 msgr2=0x7fc89c00b760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:49:20.426 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.421+0000 7fc8af7fe700 1 --2- 172.21.15.146:0/1755546317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc89c004e80 0x7fc89c00b760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:20.426 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.421+0000 7fc8af7fe700 1 -- 172.21.15.146:0/1755546317 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89c003270 con 0x7fc89c004510 2021-01-27T09:49:20.426 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.421+0000 7fc8af7fe700 1 --2- 172.21.15.146:0/1755546317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc89c004510 0x7fc89c004990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fc8a400c410 tx=0x7fc8b014def0).ready entity=mon.1 client_cookie=7ef7cdf18205e6ca server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:20.427 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.425+0000 7fc8aeffd700 1 -- 172.21.15.146:0/1755546317 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a40072e0 con 0x7fc89c004510 2021-01-27T09:49:20.428 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.425+0000 7fc8aeffd700 1 -- 172.21.15.146:0/1755546317 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a4007440 con 0x7fc89c004510 2021-01-27T09:49:20.428 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.425+0000 7fc8aeffd700 1 -- 172.21.15.146:0/1755546317 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4005850 con 0x7fc89c004510 2021-01-27T09:49:20.428 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.425+0000 7fc8b6835700 1 -- 172.21.15.146:0/1755546317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc89c004510 msgr2=0x7fc89c004990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:20.428 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.425+0000 7fc8b6835700 1 --2- 172.21.15.146:0/1755546317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc89c004510 0x7fc89c004990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fc8a400c410 tx=0x7fc8b014def0).stop 2021-01-27T09:49:20.429 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.425+0000 7fc8b4dd2700 1 -- 172.21.15.146:0/1755546317 reap_dead start 2021-01-27T09:49:20.429 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.425+0000 7fc8b6835700 1 -- 172.21.15.146:0/1755546317 shutdown_connections 2021-01-27T09:49:20.429 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.425+0000 7fc8b6835700 1 -- 172.21.15.146:0/1755546317 >> 172.21.15.146:0/1755546317 conn(0x7fc8b0060980 msgr2=0x7fc8b0067f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:20.429 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.429+0000 7fc8b6835700 1 -- 172.21.15.146:0/1755546317 shutdown_connections 2021-01-27T09:49:20.432 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.433+0000 7fc8b6835700 1 -- 172.21.15.146:0/1755546317 wait complete. 2021-01-27T09:49:20.436 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.437+0000 7fc8b6835700 1 Processor -- start 2021-01-27T09:49:20.436 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.437+0000 7fc8b6835700 1 -- start start 2021-01-27T09:49:20.438 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.437+0000 7fc8b6835700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8b014ffe0 0x7fc8b0142410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:20.438 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.437+0000 7fc8b6835700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8b0062cd0 0x7fc8b01503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:20.438 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.441+0000 7fc8b6835700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc8b01508b0 0x7fc8b0160b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:20.439 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.441+0000 7fc8b6835700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b0150d00 con 0x7fc8b0062cd0 2021-01-27T09:49:20.439 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.441+0000 7fc8b6835700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b014b130 con 0x7fc8b014ffe0 2021-01-27T09:49:20.439 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.441+0000 7fc8b6835700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b014b360 con 0x7fc8b01508b0 2021-01-27T09:49:20.441 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.441+0000 7fc8af7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8b0062cd0 0x7fc8b01503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:20.441 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.441+0000 7fc8af7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8b0062cd0 0x7fc8b01503c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:54430/0 (socket says 172.21.15.146:54430) 2021-01-27T09:49:20.441 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.441+0000 7fc8af7fe700 1 -- 172.21.15.146:0/4094423307 learned_addr learned my addr 172.21.15.146:0/4094423307 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:49:20.441 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.441+0000 7fc8b4dd2700 1 --2- 172.21.15.146:0/4094423307 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc8b01508b0 0x7fc8b0160b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:20.442 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.441+0000 7fc8af7fe700 1 -- 172.21.15.146:0/4094423307 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc8b01508b0 msgr2=0x7fc8b0160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:20.442 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.441+0000 7fc8af7fe700 1 --2- 172.21.15.146:0/4094423307 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc8b01508b0 0x7fc8b0160b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:20.442 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.441+0000 7fc8af7fe700 1 -- 172.21.15.146:0/4094423307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8b014ffe0 msgr2=0x7fc8b0142410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:20.442 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.441+0000 7fc8af7fe700 1 --2- 172.21.15.146:0/4094423307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8b014ffe0 0x7fc8b0142410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:20.443 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.441+0000 7fc8af7fe700 1 -- 172.21.15.146:0/4094423307 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b014b600 con 0x7fc8b0062cd0 2021-01-27T09:49:20.443 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.441+0000 7fc8af7fe700 1 --2- 172.21.15.146:0/4094423307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8b0062cd0 0x7fc8b01503c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fc8a4007610 tx=0x7fc8a4013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:20.443 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.441+0000 7fc897fff700 1 -- 172.21.15.146:0/4094423307 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a401b070 con 0x7fc8b0062cd0 2021-01-27T09:49:20.443 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.441+0000 7fc897fff700 1 -- 172.21.15.146:0/4094423307 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a4005dd0 con 0x7fc8b0062cd0 2021-01-27T09:49:20.444 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.441+0000 7fc897fff700 1 -- 172.21.15.146:0/4094423307 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a40056d0 con 0x7fc8b0062cd0 2021-01-27T09:49:20.444 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.441+0000 7fc8b6835700 1 -- 172.21.15.146:0/4094423307 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b0148230 con 0x7fc8b0062cd0 2021-01-27T09:49:20.444 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.441+0000 7fc8b6835700 1 -- 172.21.15.146:0/4094423307 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b015e440 con 0x7fc8b0062cd0 2021-01-27T09:49:20.445 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.441+0000 7fc895ffb700 1 -- 172.21.15.146:0/4094423307 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc88c004fa0 con 0x7fc8b0062cd0 2021-01-27T09:49:20.445 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.445+0000 7fc897fff700 1 -- 172.21.15.146:0/4094423307 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fc8a4010070 con 0x7fc8b0062cd0 2021-01-27T09:49:20.445 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.445+0000 7fc897fff700 1 --2- 172.21.15.146:0/4094423307 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc8900561e0 0x7fc8900586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:20.446 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.445+0000 7fc897fff700 1 -- 172.21.15.146:0/4094423307 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6997+0+0 (secure 0 0 0) 0x7fc8a4070490 con 0x7fc8b0062cd0 2021-01-27T09:49:20.450 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.453+0000 7fc8affff700 1 --2- 172.21.15.146:0/4094423307 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc8900561e0 0x7fc8900586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:20.451 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.453+0000 7fc8affff700 1 --2- 172.21.15.146:0/4094423307 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc8900561e0 0x7fc8900586a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc8a0006ac0 tx=0x7fc8a0006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:20.455 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.457+0000 7fc897fff700 1 -- 172.21.15.146:0/4094423307 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fc8a4045b10 con 0x7fc8b0062cd0 2021-01-27T09:49:20.846 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.849+0000 7fc895ffb700 1 -- 172.21.15.146:0/4094423307 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc88c005520 con 0x7fc8b0062cd0 2021-01-27T09:49:20.847 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.849+0000 7fc897fff700 1 -- 172.21.15.146:0/4094423307 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3230 (secure 0 0 0) 0x7fc8a4049130 con 0x7fc8b0062cd0 2021-01-27T09:49:20.848 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:49:20.849 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:49:20.664087+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4971":{"gid":4971,"name":"e","rank":2,"incarnation":22,"state":"up:reconnect","state_seq":34,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:49:20.853 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.853+0000 7fc895ffb700 1 -- 172.21.15.146:0/4094423307 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc8900561e0 msgr2=0x7fc8900586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.853+0000 7fc895ffb700 1 --2- 172.21.15.146:0/4094423307 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc8900561e0 0x7fc8900586a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc8a0006ac0 tx=0x7fc8a0006e20).stop 2021-01-27T09:49:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.853+0000 7fc895ffb700 1 -- 172.21.15.146:0/4094423307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8b0062cd0 msgr2=0x7fc8b01503c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.853+0000 7fc895ffb700 1 --2- 172.21.15.146:0/4094423307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8b0062cd0 0x7fc8b01503c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fc8a4007610 tx=0x7fc8a4013000).stop 2021-01-27T09:49:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.853+0000 7fc895ffb700 1 -- 172.21.15.146:0/4094423307 shutdown_connections 2021-01-27T09:49:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.853+0000 7fc895ffb700 1 --2- 172.21.15.146:0/4094423307 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc8b01508b0 0x7fc8b0160b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.853+0000 7fc895ffb700 1 --2- 172.21.15.146:0/4094423307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8b0062cd0 0x7fc8b01503c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.853+0000 7fc895ffb700 1 --2- 172.21.15.146:0/4094423307 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc8900561e0 0x7fc8900586a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.853+0000 7fc895ffb700 1 --2- 172.21.15.146:0/4094423307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8b014ffe0 0x7fc8b0142410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.853+0000 7fc895ffb700 1 -- 172.21.15.146:0/4094423307 >> 172.21.15.146:0/4094423307 conn(0x7fc8b0060980 msgr2=0x7fc8b0143860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:20.857 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.857+0000 7fc895ffb700 1 -- 172.21.15.146:0/4094423307 shutdown_connections 2021-01-27T09:49:20.857 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:20.857+0000 7fc895ffb700 1 -- 172.21.15.146:0/4094423307 wait complete. 2021-01-27T09:49:20.857 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 24 2021-01-27T09:49:20.922 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 24, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-01-27T09:44:29.315988+0000", "damaged": [], "data_pools": [ 4, 5 ], "enabled": true, "epoch": 24, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_4275": { "addr": "172.21.15.78:6837/1117292103", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6836", "nonce": 1117292103, "type": "v2" }, { "addr": "172.21.15.78:6837", "nonce": 1117292103, "type": "v1" } ] }, "export_targets": [ 1, 2 ], "features": 4540138297136906239, "flags": 0, "gid": 4275, "incarnation": 4, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:active", "state_seq": 2 }, "gid_4287": { "addr": "172.21.15.146:6834/2738812606", "addrs": { "addrvec": [ { "addr": "172.21.15.146:6832", "nonce": 2738812606, "type": "v2" }, { "addr": "172.21.15.146:6834", "nonce": 2738812606, "type": "v1" } ] }, "export_targets": [], "features": 4540138297136906239, "flags": 0, "gid": 4287, "incarnation": 10, "join_fscid": -1, "name": "c", "rank": 1, "state": "up:active", "state_seq": 8 }, "gid_4971": { "addr": "172.21.15.146:6837/3665040070", "addrs": { "addrvec": [ { "addr": "172.21.15.146:6836", "nonce": 3665040070, "type": "v2" }, { "addr": "172.21.15.146:6837", "nonce": 3665040070, "type": "v1" } ] }, "export_targets": [], "features": 4540138297136906239, "flags": 0, "gid": 4971, "incarnation": 22, "join_fscid": -1, "name": "e", "rank": 2, "state": "up:reconnect", "state_seq": 34 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 3, "metadata_pool": 3, "modified": "2021-01-27T09:49:20.664087+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4275, "mds_1": 4287, "mds_2": 4971 } } } ], "standbys": [ { "addr": "172.21.15.78:6835/2572346312", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6834", "nonce": 2572346312, "type": "v2" }, { "addr": "172.21.15.78:6835", "nonce": 2572346312, "type": "v1" } ] }, "epoch": 3, "export_targets": [], "features": 4540138297136906239, "flags": 0, "gid": 4223, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.78:6839/148943173", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6838", "nonce": 148943173, "type": "v2" }, { "addr": "172.21.15.78:6839", "nonce": 148943173, "type": "v1" } ] }, "epoch": 3, "export_targets": [], "features": 4540138297136906239, "flags": 0, "gid": 4232, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2021-01-27T09:49:22.923 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:49:23.166 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.169+0000 7f7b38750700 1 Processor -- start 2021-01-27T09:49:23.168 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.169+0000 7f7b38750700 1 -- start start 2021-01-27T09:49:23.169 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.169+0000 7f7b38750700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7b30069690 0x7f7b3014a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:23.169 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.169+0000 7f7b38750700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7b300bd600 0x7f7b3014a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:23.169 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.169+0000 7f7b38750700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b30066fe0 con 0x7f7b300692b0 2021-01-27T09:49:23.169 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.169+0000 7f7b38750700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b3014aac0 con 0x7f7b30069690 2021-01-27T09:49:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.169+0000 7f7b38750700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b30067280 con 0x7f7b300bd600 2021-01-27T09:49:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.169+0000 7f7b364ec700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7b300692b0 0x7f7b30060020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:39226/0 (socket says 172.21.15.146:39226) 2021-01-27T09:49:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.169+0000 7f7b364ec700 1 -- 172.21.15.146:0/405565056 learned_addr learned my addr 172.21.15.146:0/405565056 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:49:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.173+0000 7f7b36ced700 1 --2- 172.21.15.146:0/405565056 >> v2:172.21.15.146:3300/0 conn(0x7f7b300bd600 0x7f7b3014a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.173+0000 7f7b35ceb700 1 --2- 172.21.15.146:0/405565056 >> v2:172.21.15.78:3300/0 conn(0x7f7b30069690 0x7f7b3014a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.173+0000 7f7b354ea700 1 -- 172.21.15.146:0/405565056 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836923622 0 0) 0x7f7b30066fe0 con 0x7f7b300692b0 2021-01-27T09:49:23.172 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.173+0000 7f7b354ea700 1 -- 172.21.15.146:0/405565056 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b18003270 con 0x7f7b300692b0 2021-01-27T09:49:23.172 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.173+0000 7f7b35ceb700 1 -- 172.21.15.146:0/405565056 >> v2:172.21.15.146:3300/0 conn(0x7f7b300bd600 msgr2=0x7f7b3014a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:49:23.173 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.173+0000 7f7b35ceb700 1 --2- 172.21.15.146:0/405565056 >> v2:172.21.15.146:3300/0 conn(0x7f7b300bd600 0x7f7b3014a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:23.173 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.173+0000 7f7b35ceb700 1 -- 172.21.15.146:0/405565056 >> v1:172.21.15.78:6789/0 conn(0x7f7b300692b0 legacy=0x7f7b30060020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:23.173 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.173+0000 7f7b35ceb700 1 -- 172.21.15.146:0/405565056 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b30067520 con 0x7f7b30069690 2021-01-27T09:49:23.173 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.173+0000 7f7b35ceb700 1 --2- 172.21.15.146:0/405565056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b30069690 0x7f7b3014a0e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f7b30060740 tx=0x7f7b280091a0).ready entity=mon.0 client_cookie=53680e285b542d5c server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:23.173 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.173+0000 7f7b354ea700 1 -- 172.21.15.146:0/405565056 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b28005a80 con 0x7f7b30069690 2021-01-27T09:49:23.174 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.173+0000 7f7b354ea700 1 -- 172.21.15.146:0/405565056 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b28005be0 con 0x7f7b30069690 2021-01-27T09:49:23.174 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.173+0000 7f7b354ea700 1 -- 172.21.15.146:0/405565056 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2800ba70 con 0x7f7b30069690 2021-01-27T09:49:23.175 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.173+0000 7f7b38750700 1 -- 172.21.15.146:0/405565056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b30069690 msgr2=0x7f7b3014a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:23.175 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.173+0000 7f7b38750700 1 --2- 172.21.15.146:0/405565056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b30069690 0x7f7b3014a0e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f7b30060740 tx=0x7f7b280091a0).stop 2021-01-27T09:49:23.175 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.177+0000 7f7b38750700 1 -- 172.21.15.146:0/405565056 shutdown_connections 2021-01-27T09:49:23.175 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.177+0000 7f7b38750700 1 --2- 172.21.15.146:0/405565056 >> v2:172.21.15.146:3300/0 conn(0x7f7b300bd600 0x7f7b3014a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:23.175 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.177+0000 7f7b38750700 1 --2- 172.21.15.146:0/405565056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b30069690 0x7f7b3014a0e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:23.176 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.177+0000 7f7b38750700 1 -- 172.21.15.146:0/405565056 >> 172.21.15.146:0/405565056 conn(0x7f7b30065f60 msgr2=0x7f7b30067ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:23.176 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.177+0000 7f7b38750700 1 -- 172.21.15.146:0/405565056 shutdown_connections 2021-01-27T09:49:23.176 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.177+0000 7f7b38750700 1 -- 172.21.15.146:0/405565056 wait complete. 2021-01-27T09:49:23.177 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.177+0000 7f7b38750700 1 Processor -- start 2021-01-27T09:49:23.179 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.181+0000 7f7b38750700 1 -- start start 2021-01-27T09:49:23.179 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.181+0000 7f7b38750700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b300692b0 0x7f7b300be810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:23.179 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.181+0000 7f7b38750700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b30069690 0x7f7b300bbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:23.180 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.181+0000 7f7b38750700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b300bd600 0x7f7b30164d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:23.180 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.181+0000 7f7b38750700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b30154270 con 0x7f7b30069690 2021-01-27T09:49:23.180 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.181+0000 7f7b38750700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3013b980 con 0x7f7b300692b0 2021-01-27T09:49:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.181+0000 7f7b38750700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3013bbb0 con 0x7f7b300bd600 2021-01-27T09:49:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.181+0000 7f7b364ec700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b300692b0 0x7f7b300be810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.181+0000 7f7b364ec700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b300692b0 0x7f7b300be810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51626/0 (socket says 172.21.15.146:51626) 2021-01-27T09:49:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.181+0000 7f7b364ec700 1 -- 172.21.15.146:0/2788971486 learned_addr learned my addr 172.21.15.146:0/2788971486 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:49:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.181+0000 7f7b35ceb700 1 --2- 172.21.15.146:0/2788971486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b30069690 0x7f7b300bbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.181+0000 7f7b364ec700 1 -- 172.21.15.146:0/2788971486 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b300bd600 msgr2=0x7f7b30164d60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-27T09:49:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.181+0000 7f7b364ec700 1 --2- 172.21.15.146:0/2788971486 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b300bd600 0x7f7b30164d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.181+0000 7f7b364ec700 1 -- 172.21.15.146:0/2788971486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b30069690 msgr2=0x7f7b300bbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.181+0000 7f7b364ec700 1 --2- 172.21.15.146:0/2788971486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b30069690 0x7f7b300bbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.181+0000 7f7b364ec700 1 -- 172.21.15.146:0/2788971486 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3013be50 con 0x7f7b300692b0 2021-01-27T09:49:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.181+0000 7f7b364ec700 1 --2- 172.21.15.146:0/2788971486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b300692b0 0x7f7b300be810 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f7b2000c770 tx=0x7f7b20005bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.181+0000 7f7b1e7fc700 1 -- 172.21.15.146:0/2788971486 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2000e4a0 con 0x7f7b300692b0 2021-01-27T09:49:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.181+0000 7f7b38750700 1 -- 172.21.15.146:0/2788971486 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b3013c0f0 con 0x7f7b300692b0 2021-01-27T09:49:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.185+0000 7f7b38750700 1 -- 172.21.15.146:0/2788971486 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b3013c6b0 con 0x7f7b300692b0 2021-01-27T09:49:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.185+0000 7f7b17fff700 1 -- 172.21.15.146:0/2788971486 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b3013ca10 con 0x7f7b300692b0 2021-01-27T09:49:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.185+0000 7f7b1e7fc700 1 -- 172.21.15.146:0/2788971486 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2000e600 con 0x7f7b300692b0 2021-01-27T09:49:23.198 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.197+0000 7f7b1e7fc700 1 -- 172.21.15.146:0/2788971486 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2000e980 con 0x7f7b300692b0 2021-01-27T09:49:23.198 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.197+0000 7f7b1e7fc700 1 -- 172.21.15.146:0/2788971486 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f7b20010030 con 0x7f7b300692b0 2021-01-27T09:49:23.198 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.197+0000 7f7b1e7fc700 1 --2- 172.21.15.146:0/2788971486 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f7b18056760 0x7f7b18058c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:23.199 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.197+0000 7f7b1e7fc700 1 -- 172.21.15.146:0/2788971486 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6997+0+0 (secure 0 0 0) 0x7f7b2006f510 con 0x7f7b300692b0 2021-01-27T09:49:23.199 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.197+0000 7f7b35ceb700 1 --2- 172.21.15.146:0/2788971486 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f7b18056760 0x7f7b18058c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:23.199 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.201+0000 7f7b35ceb700 1 --2- 172.21.15.146:0/2788971486 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f7b18056760 0x7f7b18058c20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f7b30069ae0 tx=0x7f7b28016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:23.205 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.205+0000 7f7b1e7fc700 1 -- 172.21.15.146:0/2788971486 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f7b20044ad0 con 0x7f7b300692b0 2021-01-27T09:49:23.649 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.649+0000 7f7b17fff700 1 -- 172.21.15.146:0/2788971486 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b30044680 con 0x7f7b300692b0 2021-01-27T09:49:23.650 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.653+0000 7f7b1e7fc700 1 -- 172.21.15.146:0/2788971486 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3227 (secure 0 0 0) 0x7f7b200480f0 con 0x7f7b300692b0 2021-01-27T09:49:23.656 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:49:23.656 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:49:22.681917+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4971":{"gid":4971,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:49:23.657 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.657+0000 7f7b17fff700 1 -- 172.21.15.146:0/2788971486 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f7b18056760 msgr2=0x7f7b18058c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:23.657 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.657+0000 7f7b17fff700 1 --2- 172.21.15.146:0/2788971486 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f7b18056760 0x7f7b18058c20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f7b30069ae0 tx=0x7f7b28016000).stop 2021-01-27T09:49:23.657 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.657+0000 7f7b17fff700 1 -- 172.21.15.146:0/2788971486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b300692b0 msgr2=0x7f7b300be810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:23.657 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.657+0000 7f7b17fff700 1 --2- 172.21.15.146:0/2788971486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b300692b0 0x7f7b300be810 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f7b2000c770 tx=0x7f7b20005bb0).stop 2021-01-27T09:49:23.658 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.657+0000 7f7b17fff700 1 -- 172.21.15.146:0/2788971486 shutdown_connections 2021-01-27T09:49:23.658 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.657+0000 7f7b17fff700 1 --2- 172.21.15.146:0/2788971486 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b300bd600 0x7f7b30164d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:23.659 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.657+0000 7f7b17fff700 1 --2- 172.21.15.146:0/2788971486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b30069690 0x7f7b300bbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:23.659 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.657+0000 7f7b17fff700 1 --2- 172.21.15.146:0/2788971486 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f7b18056760 0x7f7b18058c20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:23.659 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.657+0000 7f7b17fff700 1 --2- 172.21.15.146:0/2788971486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b300692b0 0x7f7b300be810 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:23.659 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.657+0000 7f7b17fff700 1 -- 172.21.15.146:0/2788971486 >> 172.21.15.146:0/2788971486 conn(0x7f7b30065f60 msgr2=0x7f7b30149fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:23.660 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.657+0000 7f7b17fff700 1 -- 172.21.15.146:0/2788971486 shutdown_connections 2021-01-27T09:49:23.660 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:23.657+0000 7f7b17fff700 1 -- 172.21.15.146:0/2788971486 wait complete. 2021-01-27T09:49:23.665 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 26 2021-01-27T09:49:23.695 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e has gained rank=2, replacing gid=4238 2021-01-27T09:49:23.695 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 3 secs before reviving mds.a 2021-01-27T09:49:26.696 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.a 2021-01-27T09:49:26.696 INFO:tasks.ceph.mds.a:Restarting daemon 2021-01-27T09:49:26.696 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-01-27T09:49:26.701 INFO:tasks.ceph.mds.a:Started 2021-01-27T09:49:26.702 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:49:26.954 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2021-01-27T09:49:27.059 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.061+0000 7f13b1125700 1 Processor -- start 2021-01-27T09:49:27.076 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.077+0000 7f13b1125700 1 -- start start 2021-01-27T09:49:27.076 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.077+0000 7f13b1125700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13ac064240 0x7f13ac064620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:27.077 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.077+0000 7f13b1125700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f13ac0637e0 0x7f13ac0b8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:27.078 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.077+0000 7f13b1125700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ac14c580 con 0x7f13ac14bc10 2021-01-27T09:49:27.078 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.077+0000 7f13b1125700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13ac14c820 con 0x7f13ac0637e0 2021-01-27T09:49:27.079 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.077+0000 7f13b1125700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac14cac0 con 0x7f13ac064240 2021-01-27T09:49:27.079 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.077+0000 7f13ab7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f13ac0637e0 0x7f13ac0b8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:27.079 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.077+0000 7f13ab7fe700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f13ac0637e0 0x7f13ac0b8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:54624/0 (socket says 172.21.15.146:54624) 2021-01-27T09:49:27.079 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.077+0000 7f13ab7fe700 1 -- 172.21.15.146:0/464539430 learned_addr learned my addr 172.21.15.146:0/464539430 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:49:27.079 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.077+0000 7f13abfff700 1 --2- 172.21.15.146:0/464539430 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13ac064240 0x7f13ac064620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:27.080 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.077+0000 7f13ab7fe700 1 -- 172.21.15.146:0/464539430 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13ac064240 msgr2=0x7f13ac064620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:49:27.080 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.077+0000 7f13ab7fe700 1 --2- 172.21.15.146:0/464539430 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13ac064240 0x7f13ac064620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:27.080 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.077+0000 7f13ab7fe700 1 -- 172.21.15.146:0/464539430 >> v1:172.21.15.146:6789/0 conn(0x7f13ac14bc10 legacy=0x7f13ac148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:49:27.080 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.077+0000 7f13ab7fe700 1 -- 172.21.15.146:0/464539430 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ac0b83d0 con 0x7f13ac0637e0 2021-01-27T09:49:27.080 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.077+0000 7f13ab7fe700 1 --2- 172.21.15.146:0/464539430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13ac0637e0 0x7f13ac0b8db0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f13a000baa0 tx=0x7f13a0006ee0).ready entity=mon.0 client_cookie=f0a8cbc871164a73 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:27.082 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.085+0000 7f13aaffd700 1 -- 172.21.15.146:0/464539430 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a0014b70 con 0x7f13ac0637e0 2021-01-27T09:49:27.082 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.085+0000 7f13aaffd700 1 -- 172.21.15.146:0/464539430 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a0014cd0 con 0x7f13ac0637e0 2021-01-27T09:49:27.083 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.085+0000 7f13aaffd700 1 -- 172.21.15.146:0/464539430 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a0009850 con 0x7f13ac0637e0 2021-01-27T09:49:27.084 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.085+0000 7f13b1125700 1 -- 172.21.15.146:0/464539430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13ac0637e0 msgr2=0x7f13ac0b8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:27.084 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.085+0000 7f13b1125700 1 --2- 172.21.15.146:0/464539430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13ac0637e0 0x7f13ac0b8db0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f13a000baa0 tx=0x7f13a0006ee0).stop 2021-01-27T09:49:27.085 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.085+0000 7f13b1125700 1 -- 172.21.15.146:0/464539430 shutdown_connections 2021-01-27T09:49:27.085 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.085+0000 7f13b1125700 1 --2- 172.21.15.146:0/464539430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13ac0637e0 0x7f13ac0b8db0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:27.085 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.085+0000 7f13b1125700 1 --2- 172.21.15.146:0/464539430 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13ac064240 0x7f13ac064620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:27.086 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.085+0000 7f13b1125700 1 -- 172.21.15.146:0/464539430 >> 172.21.15.146:0/464539430 conn(0x7f13ac0652c0 msgr2=0x7f13ac067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:27.087 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.085+0000 7f13b1125700 1 -- 172.21.15.146:0/464539430 shutdown_connections 2021-01-27T09:49:27.087 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.085+0000 7f13b1125700 1 -- 172.21.15.146:0/464539430 wait complete. 2021-01-27T09:49:27.087 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.089+0000 7f13b1125700 1 Processor -- start 2021-01-27T09:49:27.088 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.089+0000 7f13b1125700 1 -- start start 2021-01-27T09:49:27.088 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.089+0000 7f13b1125700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13ac0637e0 0x7f13ac0bdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:27.089 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.089+0000 7f13abfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13ac0637e0 0x7f13ac0bdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:27.090 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.089+0000 7f13abfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13ac0637e0 0x7f13ac0bdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51752/0 (socket says 172.21.15.146:51752) 2021-01-27T09:49:27.090 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.089+0000 7f13abfff700 1 -- 172.21.15.146:0/2137215740 learned_addr learned my addr 172.21.15.146:0/2137215740 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:49:27.090 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.089+0000 7f13b1125700 1 --2- 172.21.15.146:0/2137215740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13ac064240 0x7f13ac0be230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:27.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.093+0000 7f13b1125700 1 --2- 172.21.15.146:0/2137215740 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13ac14bc10 0x7f13ac147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:27.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.093+0000 7f13b1125700 1 -- 172.21.15.146:0/2137215740 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac15fc40 con 0x7f13ac064240 2021-01-27T09:49:27.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.093+0000 7f13b1125700 1 -- 172.21.15.146:0/2137215740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac0be720 con 0x7f13ac0637e0 2021-01-27T09:49:27.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.093+0000 7f13b1125700 1 -- 172.21.15.146:0/2137215740 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac1607f0 con 0x7f13ac14bc10 2021-01-27T09:49:27.093 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.093+0000 7f13ab7fe700 1 --2- 172.21.15.146:0/2137215740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13ac064240 0x7f13ac0be230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:27.093 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.093+0000 7f13b0924700 1 --2- 172.21.15.146:0/2137215740 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13ac14bc10 0x7f13ac147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:27.094 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.093+0000 7f13ab7fe700 1 -- 172.21.15.146:0/2137215740 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13ac14bc10 msgr2=0x7f13ac147d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:27.094 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.093+0000 7f13ab7fe700 1 --2- 172.21.15.146:0/2137215740 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13ac14bc10 0x7f13ac147d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:27.094 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.093+0000 7f13ab7fe700 1 -- 172.21.15.146:0/2137215740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13ac0637e0 msgr2=0x7f13ac0bdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:27.095 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.093+0000 7f13ab7fe700 1 --2- 172.21.15.146:0/2137215740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13ac0637e0 0x7f13ac0bdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:27.095 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.093+0000 7f13ab7fe700 1 -- 172.21.15.146:0/2137215740 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ac160a20 con 0x7f13ac064240 2021-01-27T09:49:27.095 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.093+0000 7f13ab7fe700 1 --2- 172.21.15.146:0/2137215740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13ac064240 0x7f13ac0be230 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f13a001b000 tx=0x7f13a001c000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:27.097 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.097+0000 7f1393fff700 1 -- 172.21.15.146:0/2137215740 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a0014460 con 0x7f13ac064240 2021-01-27T09:49:27.097 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.097+0000 7f13b1125700 1 -- 172.21.15.146:0/2137215740 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13ac160cc0 con 0x7f13ac064240 2021-01-27T09:49:27.097 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.097+0000 7f13b1125700 1 -- 172.21.15.146:0/2137215740 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13ac161520 con 0x7f13ac064240 2021-01-27T09:49:27.097 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.097+0000 7f1393fff700 1 -- 172.21.15.146:0/2137215740 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a00145c0 con 0x7f13ac064240 2021-01-27T09:49:27.098 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.097+0000 7f1393fff700 1 -- 172.21.15.146:0/2137215740 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a001c620 con 0x7f13ac064240 2021-01-27T09:49:27.098 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.101+0000 7f1393fff700 1 -- 172.21.15.146:0/2137215740 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f13a0023070 con 0x7f13ac064240 2021-01-27T09:49:27.100 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.101+0000 7f1393fff700 1 --2- 172.21.15.146:0/2137215740 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f138c056230 0x7f138c0586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:27.100 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.101+0000 7f1393fff700 1 -- 172.21.15.146:0/2137215740 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6997+0+0 (secure 0 0 0) 0x7f13a0070d90 con 0x7f13ac064240 2021-01-27T09:49:27.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.101+0000 7f13abfff700 1 --2- 172.21.15.146:0/2137215740 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f138c056230 0x7f138c0586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:27.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.101+0000 7f13abfff700 1 --2- 172.21.15.146:0/2137215740 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f138c056230 0x7f138c0586f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f139c0067a0 tx=0x7f139c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:27.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.121+0000 7f1391ffb700 1 -- 172.21.15.146:0/2137215740 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13ac064a30 con 0x7f13ac064240 2021-01-27T09:49:27.128 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.129+0000 7f1393fff700 1 -- 172.21.15.146:0/2137215740 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f13a0021070 con 0x7f13ac064240 2021-01-27T09:49:27.469 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.469+0000 7f1391ffb700 1 -- 172.21.15.146:0/2137215740 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13ac064a30 con 0x7f13ac064240 2021-01-27T09:49:27.470 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.473+0000 7f1393fff700 1 -- 172.21.15.146:0/2137215740 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3225 (secure 0 0 0) 0x7f13a0046300 con 0x7f13ac064240 2021-01-27T09:49:27.471 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:49:27.471 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:49:26.699641+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[2],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4971":{"gid":4971,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:49:27.472 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.473+0000 7f1391ffb700 1 -- 172.21.15.146:0/2137215740 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f138c056230 msgr2=0x7f138c0586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:27.472 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.473+0000 7f1391ffb700 1 --2- 172.21.15.146:0/2137215740 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f138c056230 0x7f138c0586f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f139c0067a0 tx=0x7f139c008040).stop 2021-01-27T09:49:27.472 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.473+0000 7f1391ffb700 1 -- 172.21.15.146:0/2137215740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13ac064240 msgr2=0x7f13ac0be230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:27.473 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.473+0000 7f1391ffb700 1 --2- 172.21.15.146:0/2137215740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13ac064240 0x7f13ac0be230 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f13a001b000 tx=0x7f13a001c000).stop 2021-01-27T09:49:27.473 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.473+0000 7f1391ffb700 1 -- 172.21.15.146:0/2137215740 shutdown_connections 2021-01-27T09:49:27.473 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.473+0000 7f1391ffb700 1 --2- 172.21.15.146:0/2137215740 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13ac14bc10 0x7f13ac147d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:27.473 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.473+0000 7f1391ffb700 1 --2- 172.21.15.146:0/2137215740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13ac064240 0x7f13ac0be230 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:27.474 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.473+0000 7f1391ffb700 1 --2- 172.21.15.146:0/2137215740 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f138c056230 0x7f138c0586f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:27.474 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.473+0000 7f1391ffb700 1 --2- 172.21.15.146:0/2137215740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13ac0637e0 0x7f13ac0bdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:27.474 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.473+0000 7f1391ffb700 1 -- 172.21.15.146:0/2137215740 >> 172.21.15.146:0/2137215740 conn(0x7f13ac0652c0 msgr2=0x7f13ac14b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:27.475 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.473+0000 7f1391ffb700 1 -- 172.21.15.146:0/2137215740 shutdown_connections 2021-01-27T09:49:27.475 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:27.473+0000 7f1391ffb700 1 -- 172.21.15.146:0/2137215740 wait complete. 2021-01-27T09:49:27.475 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 27 2021-01-27T09:49:27.493 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2021-01-27T09:49:29.495 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:49:29.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.741+0000 7f304135c700 1 Processor -- start 2021-01-27T09:49:29.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.741+0000 7f304135c700 1 -- start start 2021-01-27T09:49:29.742 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.741+0000 7f304135c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f303c064f30 0x7f303c0671c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:29.742 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.741+0000 7f304135c700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303c060360 con 0x7f303c143e80 2021-01-27T09:49:29.743 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.741+0000 7f304135c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303c149cf0 con 0x7f303c0676b0 2021-01-27T09:49:29.743 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.741+0000 7f304135c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303c060590 con 0x7f303c064f30 2021-01-27T09:49:29.744 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.745+0000 7f303b7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f303c143e80 0x7f303c14a150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:39450/0 (socket says 172.21.15.146:39450) 2021-01-27T09:49:29.744 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.745+0000 7f303b7fe700 1 -- 172.21.15.146:0/1679574985 learned_addr learned my addr 172.21.15.146:0/1679574985 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:49:29.744 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.745+0000 7f303affd700 1 --2- 172.21.15.146:0/1679574985 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f303c064f30 0x7f303c0671c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:29.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.745+0000 7f303affd700 1 -- 172.21.15.146:0/1679574985 >> v1:172.21.15.146:6789/0 conn(0x7f303c0676b0 legacy=0x7f303c143760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:49:29.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.745+0000 7f303affd700 1 -- 172.21.15.146:0/1679574985 >> v1:172.21.15.78:6789/0 conn(0x7f303c143e80 legacy=0x7f303c14a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:29.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.745+0000 7f303affd700 1 -- 172.21.15.146:0/1679574985 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c060830 con 0x7f303c064f30 2021-01-27T09:49:29.746 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.745+0000 7f303affd700 1 --2- 172.21.15.146:0/1679574985 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f303c064f30 0x7f303c0671c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f302c00dc30 tx=0x7f302c007ec0).ready entity=mon.2 client_cookie=836dce70ae639060 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:29.747 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.749+0000 7f3039ffb700 1 -- 172.21.15.146:0/1679574985 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c00bb20 con 0x7f303c064f30 2021-01-27T09:49:29.747 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.749+0000 7f3039ffb700 1 -- 172.21.15.146:0/1679574985 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c00bc80 con 0x7f303c064f30 2021-01-27T09:49:29.747 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.749+0000 7f3039ffb700 1 -- 172.21.15.146:0/1679574985 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c0067f0 con 0x7f303c064f30 2021-01-27T09:49:29.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.749+0000 7f304135c700 1 -- 172.21.15.146:0/1679574985 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f303c064f30 msgr2=0x7f303c0671c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:29.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.749+0000 7f304135c700 1 --2- 172.21.15.146:0/1679574985 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f303c064f30 0x7f303c0671c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f302c00dc30 tx=0x7f302c007ec0).stop 2021-01-27T09:49:29.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.749+0000 7f304135c700 1 -- 172.21.15.146:0/1679574985 shutdown_connections 2021-01-27T09:49:29.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.749+0000 7f304135c700 1 --2- 172.21.15.146:0/1679574985 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f303c064f30 0x7f303c0671c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:29.748 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.749+0000 7f304135c700 1 -- 172.21.15.146:0/1679574985 >> 172.21.15.146:0/1679574985 conn(0x7f303c067dc0 msgr2=0x7f303c0681d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:29.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.749+0000 7f304135c700 1 -- 172.21.15.146:0/1679574985 shutdown_connections 2021-01-27T09:49:29.749 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.749+0000 7f304135c700 1 -- 172.21.15.146:0/1679574985 wait complete. 2021-01-27T09:49:29.751 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.753+0000 7f304135c700 1 Processor -- start 2021-01-27T09:49:29.751 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.753+0000 7f304135c700 1 -- start start 2021-01-27T09:49:29.753 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.753+0000 7f304135c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f303c064f30 0x7f303c138bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:29.753 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.753+0000 7f304135c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f303c0676b0 0x7f303c1390b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:29.754 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.753+0000 7f304135c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f303c143e80 0x7f303c134260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:29.754 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.753+0000 7f304135c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c1395a0 con 0x7f303c064f30 2021-01-27T09:49:29.754 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.753+0000 7f304135c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c14b890 con 0x7f303c0676b0 2021-01-27T09:49:29.754 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.753+0000 7f304135c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303c14bb30 con 0x7f303c143e80 2021-01-27T09:49:29.755 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.753+0000 7f303affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f303c064f30 0x7f303c138bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:29.755 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.753+0000 7f303affd700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f303c064f30 0x7f303c138bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:54724/0 (socket says 172.21.15.146:54724) 2021-01-27T09:49:29.755 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.753+0000 7f303affd700 1 -- 172.21.15.146:0/2438660707 learned_addr learned my addr 172.21.15.146:0/2438660707 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:49:29.756 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.757+0000 7f303affd700 1 -- 172.21.15.146:0/2438660707 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f303c143e80 msgr2=0x7f303c134260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-27T09:49:29.756 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.757+0000 7f303affd700 1 --2- 172.21.15.146:0/2438660707 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f303c143e80 0x7f303c134260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:29.756 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.757+0000 7f303affd700 1 -- 172.21.15.146:0/2438660707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f303c0676b0 msgr2=0x7f303c1390b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:29.756 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.757+0000 7f303affd700 1 --2- 172.21.15.146:0/2438660707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f303c0676b0 0x7f303c1390b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:29.757 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.757+0000 7f303affd700 1 -- 172.21.15.146:0/2438660707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c0bb670 con 0x7f303c064f30 2021-01-27T09:49:29.757 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.757+0000 7f303affd700 1 --2- 172.21.15.146:0/2438660707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f303c064f30 0x7f303c138bc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f303c065da0 tx=0x7f303c069a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:29.757 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.757+0000 7f3022ffd700 1 -- 172.21.15.146:0/2438660707 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c01d070 con 0x7f303c064f30 2021-01-27T09:49:29.757 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.757+0000 7f3022ffd700 1 -- 172.21.15.146:0/2438660707 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c010e30 con 0x7f303c064f30 2021-01-27T09:49:29.757 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.757+0000 7f3022ffd700 1 -- 172.21.15.146:0/2438660707 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c006230 con 0x7f303c064f30 2021-01-27T09:49:29.758 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.761+0000 7f304135c700 1 -- 172.21.15.146:0/2438660707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303c0bb910 con 0x7f303c064f30 2021-01-27T09:49:29.758 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.761+0000 7f304135c700 1 -- 172.21.15.146:0/2438660707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303c14b4e0 con 0x7f303c064f30 2021-01-27T09:49:29.760 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.761+0000 7f304135c700 1 -- 172.21.15.146:0/2438660707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303c0bb4a0 con 0x7f303c064f30 2021-01-27T09:49:29.761 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.761+0000 7f3022ffd700 1 -- 172.21.15.146:0/2438660707 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f302c00c040 con 0x7f303c064f30 2021-01-27T09:49:29.762 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.765+0000 7f3022ffd700 1 --2- 172.21.15.146:0/2438660707 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f301c0561b0 0x7f301c058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:29.762 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.765+0000 7f3022ffd700 1 -- 172.21.15.146:0/2438660707 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6997+0+0 (secure 0 0 0) 0x7f302c070ca0 con 0x7f303c064f30 2021-01-27T09:49:29.763 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.765+0000 7f303a7fc700 1 --2- 172.21.15.146:0/2438660707 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f301c0561b0 0x7f301c058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:29.764 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.765+0000 7f303a7fc700 1 --2- 172.21.15.146:0/2438660707 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f301c0561b0 0x7f301c058670 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f303c1436d0 tx=0x7f3030007800).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:29.766 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:29.769+0000 7f3022ffd700 1 -- 172.21.15.146:0/2438660707 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f302c075070 con 0x7f303c064f30 2021-01-27T09:49:30.152 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:30.153+0000 7f304135c700 1 -- 172.21.15.146:0/2438660707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f303c069ac0 con 0x7f303c064f30 2021-01-27T09:49:30.153 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:30.153+0000 7f3022ffd700 1 -- 172.21.15.146:0/2438660707 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3225 (secure 0 0 0) 0x7f302c026030 con 0x7f303c064f30 2021-01-27T09:49:30.154 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:49:30.154 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:49:26.699641+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[2],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4971":{"gid":4971,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:49:30.156 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:30.157+0000 7f304135c700 1 -- 172.21.15.146:0/2438660707 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f301c0561b0 msgr2=0x7f301c058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:30.156 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:30.157+0000 7f304135c700 1 --2- 172.21.15.146:0/2438660707 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f301c0561b0 0x7f301c058670 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f303c1436d0 tx=0x7f3030007800).stop 2021-01-27T09:49:30.156 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:30.157+0000 7f304135c700 1 -- 172.21.15.146:0/2438660707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f303c064f30 msgr2=0x7f303c138bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:30.156 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:30.157+0000 7f304135c700 1 --2- 172.21.15.146:0/2438660707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f303c064f30 0x7f303c138bc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f303c065da0 tx=0x7f303c069a50).stop 2021-01-27T09:49:30.158 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:30.157+0000 7f304135c700 1 -- 172.21.15.146:0/2438660707 shutdown_connections 2021-01-27T09:49:30.158 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:30.157+0000 7f304135c700 1 --2- 172.21.15.146:0/2438660707 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f303c143e80 0x7f303c134260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:30.158 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:30.157+0000 7f304135c700 1 --2- 172.21.15.146:0/2438660707 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f301c0561b0 0x7f301c058670 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:30.158 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:30.157+0000 7f304135c700 1 --2- 172.21.15.146:0/2438660707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f303c0676b0 0x7f303c1390b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:30.158 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:30.157+0000 7f304135c700 1 --2- 172.21.15.146:0/2438660707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f303c064f30 0x7f303c138bc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:30.159 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:30.157+0000 7f304135c700 1 -- 172.21.15.146:0/2438660707 >> 172.21.15.146:0/2438660707 conn(0x7f303c067dc0 msgr2=0x7f303c0bd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:30.159 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:30.161+0000 7f304135c700 1 -- 172.21.15.146:0/2438660707 shutdown_connections 2021-01-27T09:49:30.159 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:30.161+0000 7f304135c700 1 -- 172.21.15.146:0/2438660707 wait complete. 2021-01-27T09:49:30.160 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 27 2021-01-27T09:49:30.184 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2021-01-27T09:49:32.186 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:49:32.440 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.433+0000 7f9febce8700 1 Processor -- start 2021-01-27T09:49:32.440 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.433+0000 7f9febce8700 1 -- start start 2021-01-27T09:49:32.441 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.437+0000 7f9febce8700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9fe4067e00 0x7f9fe40681e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:32.441 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.437+0000 7f9fe9a84700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9fe4067e00 0x7f9fe40681e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:32.441 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.437+0000 7f9fe9a84700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9fe4067e00 0x7f9fe40681e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:41382/0 (socket says 172.21.15.146:41382) 2021-01-27T09:49:32.442 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.437+0000 7f9fe9a84700 1 -- 172.21.15.146:0/925284014 learned_addr learned my addr 172.21.15.146:0/925284014 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:49:32.442 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.437+0000 7f9febce8700 1 --2- 172.21.15.146:0/925284014 >> v2:172.21.15.146:3300/0 conn(0x7f9fe40beaa0 0x7f9fe415aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:32.443 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.437+0000 7f9febce8700 1 -- 172.21.15.146:0/925284014 --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe4064360 con 0x7f9fe40b7750 2021-01-27T09:49:32.443 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.437+0000 7f9febce8700 1 -- 172.21.15.146:0/925284014 --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe4064600 con 0x7f9fe40beaa0 2021-01-27T09:49:32.443 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.437+0000 7f9febce8700 1 -- 172.21.15.146:0/925284014 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe40648a0 con 0x7f9fe4067e00 2021-01-27T09:49:32.444 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.437+0000 7f9fea285700 1 --2- 172.21.15.146:0/925284014 >> v2:172.21.15.146:3300/0 conn(0x7f9fe40beaa0 0x7f9fe415aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:32.444 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.441+0000 7f9fe9a84700 1 -- 172.21.15.146:0/925284014 >> v2:172.21.15.146:3300/0 conn(0x7f9fe40beaa0 msgr2=0x7f9fe415aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:49:32.445 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.441+0000 7f9fe9a84700 1 --2- 172.21.15.146:0/925284014 >> v2:172.21.15.146:3300/0 conn(0x7f9fe40beaa0 0x7f9fe415aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:32.445 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.441+0000 7f9fe9a84700 1 -- 172.21.15.146:0/925284014 >> v1:172.21.15.78:6789/0 conn(0x7f9fe40b7750 legacy=0x7f9fe40b8de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:49:32.447 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.441+0000 7f9fe9a84700 1 -- 172.21.15.146:0/925284014 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe40b9950 con 0x7f9fe4067e00 2021-01-27T09:49:32.447 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.441+0000 7f9fea285700 1 --2- 172.21.15.146:0/925284014 >> v2:172.21.15.146:3300/0 conn(0x7f9fe40beaa0 0x7f9fe415aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:49:32.448 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.441+0000 7f9fe9a84700 1 --2- 172.21.15.146:0/925284014 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9fe4067e00 0x7f9fe40681e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f9fd4009b10 tx=0x7f9fd4006ee0).ready entity=mon.2 client_cookie=a11d7e2baa196d87 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:32.448 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.441+0000 7f9fe8a82700 1 -- 172.21.15.146:0/925284014 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd400b890 con 0x7f9fe4067e00 2021-01-27T09:49:32.448 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.441+0000 7f9fe8a82700 1 -- 172.21.15.146:0/925284014 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd400b9f0 con 0x7f9fe4067e00 2021-01-27T09:49:32.449 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.441+0000 7f9fe8a82700 1 -- 172.21.15.146:0/925284014 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd400bd70 con 0x7f9fe4067e00 2021-01-27T09:49:32.459 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.441+0000 7f9febce8700 1 -- 172.21.15.146:0/925284014 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9fe4067e00 msgr2=0x7f9fe40681e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:32.459 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.441+0000 7f9febce8700 1 --2- 172.21.15.146:0/925284014 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9fe4067e00 0x7f9fe40681e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f9fd4009b10 tx=0x7f9fd4006ee0).stop 2021-01-27T09:49:32.460 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.445+0000 7f9febce8700 1 -- 172.21.15.146:0/925284014 shutdown_connections 2021-01-27T09:49:32.460 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.445+0000 7f9febce8700 1 --2- 172.21.15.146:0/925284014 >> v2:172.21.15.146:3300/0 conn(0x7f9fe40beaa0 0x7f9fe415aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:32.461 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.445+0000 7f9febce8700 1 --2- 172.21.15.146:0/925284014 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9fe4067e00 0x7f9fe40681e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:32.461 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.445+0000 7f9febce8700 1 -- 172.21.15.146:0/925284014 >> 172.21.15.146:0/925284014 conn(0x7f9fe40609f0 msgr2=0x7f9fe4069110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:32.461 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.445+0000 7f9febce8700 1 -- 172.21.15.146:0/925284014 shutdown_connections 2021-01-27T09:49:32.462 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.445+0000 7f9febce8700 1 -- 172.21.15.146:0/925284014 wait complete. 2021-01-27T09:49:32.462 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.445+0000 7f9febce8700 1 Processor -- start 2021-01-27T09:49:32.463 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.449+0000 7f9febce8700 1 -- start start 2021-01-27T09:49:32.463 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.449+0000 7f9febce8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fe4067e00 0x7f9fe415ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:32.463 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.449+0000 7f9febce8700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fe40b7750 0x7f9fe41520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:32.464 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.449+0000 7f9fe9a84700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fe4067e00 0x7f9fe415ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:32.464 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.449+0000 7f9fe9a84700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fe4067e00 0x7f9fe415ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51900/0 (socket says 172.21.15.146:51900) 2021-01-27T09:49:32.465 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.449+0000 7f9fe9a84700 1 -- 172.21.15.146:0/3645384527 learned_addr learned my addr 172.21.15.146:0/3645384527 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:49:32.465 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.449+0000 7f9febce8700 1 --2- 172.21.15.146:0/3645384527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9fe40beaa0 0x7f9fe4159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:32.465 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.449+0000 7f9febce8700 1 -- 172.21.15.146:0/3645384527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe4152a20 con 0x7f9fe40b7750 2021-01-27T09:49:32.466 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.449+0000 7f9fe9283700 1 --2- 172.21.15.146:0/3645384527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fe40b7750 0x7f9fe41520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:32.466 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.449+0000 7f9febce8700 1 -- 172.21.15.146:0/3645384527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe4152cc0 con 0x7f9fe4067e00 2021-01-27T09:49:32.467 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.449+0000 7f9febce8700 1 -- 172.21.15.146:0/3645384527 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe4152f60 con 0x7f9fe40beaa0 2021-01-27T09:49:32.467 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.453+0000 7f9fe9283700 1 -- 172.21.15.146:0/3645384527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9fe40beaa0 msgr2=0x7f9fe4159d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-27T09:49:32.467 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.453+0000 7f9fe9283700 1 --2- 172.21.15.146:0/3645384527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9fe40beaa0 0x7f9fe4159d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:32.467 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.453+0000 7f9fe9283700 1 -- 172.21.15.146:0/3645384527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fe4067e00 msgr2=0x7f9fe415ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:32.468 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.453+0000 7f9fe9283700 1 --2- 172.21.15.146:0/3645384527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fe4067e00 0x7f9fe415ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:32.468 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.453+0000 7f9fe9283700 1 -- 172.21.15.146:0/3645384527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe415cc70 con 0x7f9fe40b7750 2021-01-27T09:49:32.468 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.453+0000 7f9fe9283700 1 --2- 172.21.15.146:0/3645384527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fe40b7750 0x7f9fe41520a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f9fe00096b0 tx=0x7f9fe0006d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:32.468 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.453+0000 7f9fd9ffb700 1 -- 172.21.15.146:0/3645384527 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe000d4a0 con 0x7f9fe40b7750 2021-01-27T09:49:32.468 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.453+0000 7f9fd9ffb700 1 -- 172.21.15.146:0/3645384527 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe000d600 con 0x7f9fe40b7750 2021-01-27T09:49:32.469 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.453+0000 7f9fd9ffb700 1 -- 172.21.15.146:0/3645384527 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe000d9c0 con 0x7f9fe40b7750 2021-01-27T09:49:32.469 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.457+0000 7f9febce8700 1 -- 172.21.15.146:0/3645384527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe415cf10 con 0x7f9fe40b7750 2021-01-27T09:49:32.470 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.457+0000 7f9febce8700 1 -- 172.21.15.146:0/3645384527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe40bd180 con 0x7f9fe40b7750 2021-01-27T09:49:32.470 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.457+0000 7f9febce8700 1 -- 172.21.15.146:0/3645384527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc0004fa0 con 0x7f9fe40b7750 2021-01-27T09:49:32.472 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.461+0000 7f9fd9ffb700 1 -- 172.21.15.146:0/3645384527 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f9fe000f030 con 0x7f9fe40b7750 2021-01-27T09:49:32.472 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.461+0000 7f9fd9ffb700 1 --2- 172.21.15.146:0/3645384527 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9fc80563b0 0x7f9fc8058870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:49:32.472 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.461+0000 7f9fd9ffb700 1 -- 172.21.15.146:0/3645384527 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6997+0+0 (secure 0 0 0) 0x7f9fe006f2e0 con 0x7f9fe40b7750 2021-01-27T09:49:32.473 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.461+0000 7f9fe9a84700 1 --2- 172.21.15.146:0/3645384527 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9fc80563b0 0x7f9fc8058870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:49:32.473 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.465+0000 7f9fe9a84700 1 --2- 172.21.15.146:0/3645384527 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9fc80563b0 0x7f9fc8058870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f9fd4006f20 tx=0x7f9fd4018000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:49:32.474 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.473+0000 7f9fd9ffb700 1 -- 172.21.15.146:0/3645384527 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f9fe0044850 con 0x7f9fe40b7750 2021-01-27T09:49:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.813+0000 7f9febce8700 1 -- 172.21.15.146:0/3645384527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9fc00057d0 con 0x7f9fe40b7750 2021-01-27T09:49:32.813 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.813+0000 7f9fd9ffb700 1 -- 172.21.15.146:0/3645384527 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+3581 (secure 0 0 0) 0x7f9fe0047e70 con 0x7f9fe40b7750 2021-01-27T09:49:32.814 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:49:32.814 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":5040,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6835/3537280353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3537280353},{"type":"v1","addr":"172.21.15.146:6835","nonce":3537280353}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:49:26.699641+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[2],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4971":{"gid":4971,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:49:32.820 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.821+0000 7f9febce8700 1 -- 172.21.15.146:0/3645384527 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9fc80563b0 msgr2=0x7f9fc8058870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:32.820 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.821+0000 7f9febce8700 1 --2- 172.21.15.146:0/3645384527 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9fc80563b0 0x7f9fc8058870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f9fd4006f20 tx=0x7f9fd4018000).stop 2021-01-27T09:49:32.821 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.821+0000 7f9febce8700 1 -- 172.21.15.146:0/3645384527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fe40b7750 msgr2=0x7f9fe41520a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:49:32.821 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.821+0000 7f9febce8700 1 --2- 172.21.15.146:0/3645384527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fe40b7750 0x7f9fe41520a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f9fe00096b0 tx=0x7f9fe0006d80).stop 2021-01-27T09:49:32.821 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.821+0000 7f9febce8700 1 -- 172.21.15.146:0/3645384527 shutdown_connections 2021-01-27T09:49:32.821 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.821+0000 7f9febce8700 1 --2- 172.21.15.146:0/3645384527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9fe40beaa0 0x7f9fe4159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:49:32.821 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.821+0000 7f9febce8700 1 --2- 172.21.15.146:0/3645384527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fe40b7750 0x7f9fe41520a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:32.822 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.821+0000 7f9febce8700 1 --2- 172.21.15.146:0/3645384527 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9fc80563b0 0x7f9fc8058870 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:32.822 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.821+0000 7f9febce8700 1 --2- 172.21.15.146:0/3645384527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fe4067e00 0x7f9fe415ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:49:32.822 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.821+0000 7f9febce8700 1 -- 172.21.15.146:0/3645384527 >> 172.21.15.146:0/3645384527 conn(0x7f9fe40609f0 msgr2=0x7f9fe40bb580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:49:32.841 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.841+0000 7f9febce8700 1 -- 172.21.15.146:0/3645384527 shutdown_connections 2021-01-27T09:49:32.842 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:49:32.845+0000 7f9febce8700 1 -- 172.21.15.146:0/3645384527 wait complete. 2021-01-27T09:49:32.845 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 28 2021-01-27T09:49:32.888 INFO:tasks.mds_thrash.fs.[cephfs]:mds.a reported in up:standby state 2021-01-27T09:49:32.888 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 105 secs before thrashing 2021-01-27T09:49:46.151 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:49:46.538 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-27T09:49:50.313 INFO:tasks.ceph.osd.7.smithi078.stderr:2021-01-27T09:49:50.315+0000 7fda82b17700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 19671) UID: 0 2021-01-27T09:49:50.363 INFO:tasks.ceph.osd.6.smithi078.stderr:2021-01-27T09:49:50.315+0000 7ffa68a07700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 19671) UID: 0 2021-01-27T09:49:50.363 INFO:tasks.ceph.osd.5.smithi078.stderr:2021-01-27T09:49:50.315+0000 7f55f21fd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 19671) UID: 0 2021-01-27T09:49:50.364 INFO:tasks.ceph.osd.4.smithi078.stderr:2021-01-27T09:49:50.315+0000 7f378a1e8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 19671) UID: 0 2021-01-27T09:51:17.889 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:51:30.458 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.452+0000 7f62188ed700 1 Processor -- start 2021-01-27T09:51:30.460 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.452+0000 7f62188ed700 1 -- start start 2021-01-27T09:51:30.460 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.452+0000 7f62188ed700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6214143ac0 0x7f6214067500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:30.460 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.452+0000 7f62188ed700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f62140bd500 0x7f621414a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:30.461 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.452+0000 7f62188ed700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6214069710 con 0x7f6214143ea0 2021-01-27T09:51:30.461 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.452+0000 7f62188ed700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6214149bf0 con 0x7f6214143ac0 2021-01-27T09:51:30.461 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.452+0000 7f62188ed700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62140ad280 con 0x7f62140bd500 2021-01-27T09:51:30.462 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.456+0000 7f6213fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f62140bd500 0x7f621414a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:30.462 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.456+0000 7f6213fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f62140bd500 0x7f621414a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:43434/0 (socket says 172.21.15.146:43434) 2021-01-27T09:51:30.463 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.456+0000 7f6213fff700 1 -- 172.21.15.146:0/1010874493 learned_addr learned my addr 172.21.15.146:0/1010874493 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:51:30.463 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.456+0000 7f62137fe700 1 --2- 172.21.15.146:0/1010874493 >> v2:172.21.15.78:3300/0 conn(0x7f6214143ac0 0x7f6214067500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:30.463 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.456+0000 7f6213fff700 1 -- 172.21.15.146:0/1010874493 >> v2:172.21.15.78:3300/0 conn(0x7f6214143ac0 msgr2=0x7f6214067500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:51:30.464 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.456+0000 7f6213fff700 1 --2- 172.21.15.146:0/1010874493 >> v2:172.21.15.78:3300/0 conn(0x7f6214143ac0 0x7f6214067500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:30.464 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.456+0000 7f6213fff700 1 -- 172.21.15.146:0/1010874493 >> v1:172.21.15.146:6789/0 conn(0x7f6214143ea0 legacy=0x7f6214064d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:51:30.464 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.456+0000 7f6213fff700 1 -- 172.21.15.146:0/1010874493 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6214069940 con 0x7f62140bd500 2021-01-27T09:51:30.465 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.456+0000 7f6213fff700 1 --2- 172.21.15.146:0/1010874493 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f62140bd500 0x7f621414a280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f6214063dc0 tx=0x7f6204006f70).ready entity=mon.2 client_cookie=48c4651908825577 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:30.465 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.460+0000 7f62127fc700 1 -- 172.21.15.146:0/1010874493 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620400f070 con 0x7f62140bd500 2021-01-27T09:51:30.466 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.460+0000 7f62127fc700 1 -- 172.21.15.146:0/1010874493 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6204008bf0 con 0x7f62140bd500 2021-01-27T09:51:30.466 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.460+0000 7f62188ed700 1 -- 172.21.15.146:0/1010874493 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f62140bd500 msgr2=0x7f621414a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:30.467 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.460+0000 7f62188ed700 1 --2- 172.21.15.146:0/1010874493 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f62140bd500 0x7f621414a280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f6214063dc0 tx=0x7f6204006f70).stop 2021-01-27T09:51:30.467 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.460+0000 7f62188ed700 1 -- 172.21.15.146:0/1010874493 shutdown_connections 2021-01-27T09:51:30.467 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.460+0000 7f62188ed700 1 --2- 172.21.15.146:0/1010874493 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f62140bd500 0x7f621414a280 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:30.468 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.460+0000 7f62188ed700 1 --2- 172.21.15.146:0/1010874493 >> v2:172.21.15.78:3300/0 conn(0x7f6214143ac0 0x7f6214067500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:30.468 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.460+0000 7f62188ed700 1 -- 172.21.15.146:0/1010874493 >> 172.21.15.146:0/1010874493 conn(0x7f6214060a30 msgr2=0x7f6214065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:51:30.468 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.464+0000 7f62188ed700 1 -- 172.21.15.146:0/1010874493 shutdown_connections 2021-01-27T09:51:30.469 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.464+0000 7f62188ed700 1 -- 172.21.15.146:0/1010874493 wait complete. 2021-01-27T09:51:30.470 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.464+0000 7f62188ed700 1 Processor -- start 2021-01-27T09:51:30.472 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.464+0000 7f62188ed700 1 -- start start 2021-01-27T09:51:30.473 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.468+0000 7f62188ed700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62140bd500 0x7f6214165010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:30.473 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.468+0000 7f62188ed700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6214143ac0 0x7f6214138500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:30.473 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.468+0000 7f62188ed700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6214143ea0 0x7f6214162180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:30.473 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.468+0000 7f62188ed700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62141375c0 con 0x7f62140bd500 2021-01-27T09:51:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.468+0000 7f62188ed700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62141655c0 con 0x7f6214143ac0 2021-01-27T09:51:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.468+0000 7f62188ed700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6214165860 con 0x7f6214143ea0 2021-01-27T09:51:30.475 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.468+0000 7f6213fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6214143ea0 0x7f6214162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:30.475 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.468+0000 7f6213fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6214143ea0 0x7f6214162180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:43438/0 (socket says 172.21.15.146:43438) 2021-01-27T09:51:30.475 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.468+0000 7f6213fff700 1 -- 172.21.15.146:0/2585525765 learned_addr learned my addr 172.21.15.146:0/2585525765 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:51:30.475 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.468+0000 7f6213fff700 1 -- 172.21.15.146:0/2585525765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6214143ac0 msgr2=0x7f6214138500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:30.476 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.468+0000 7f6213fff700 1 --2- 172.21.15.146:0/2585525765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6214143ac0 0x7f6214138500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:51:30.476 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.468+0000 7f6213fff700 1 -- 172.21.15.146:0/2585525765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62140bd500 msgr2=0x7f6214165010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-27T09:51:30.476 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.468+0000 7f6213fff700 1 --2- 172.21.15.146:0/2585525765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62140bd500 0x7f6214165010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:51:30.476 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.468+0000 7f6213fff700 1 -- 172.21.15.146:0/2585525765 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6214165b00 con 0x7f6214143ea0 2021-01-27T09:51:30.476 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.468+0000 7f6213fff700 1 --2- 172.21.15.146:0/2585525765 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6214143ea0 0x7f6214162180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f620400abe0 tx=0x7f62140ae720).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:30.480 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.476+0000 7f61fb7fe700 1 -- 172.21.15.146:0/2585525765 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6204008250 con 0x7f6214143ea0 2021-01-27T09:51:30.481 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.476+0000 7f62188ed700 1 -- 172.21.15.146:0/2585525765 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6214165da0 con 0x7f6214143ea0 2021-01-27T09:51:30.481 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.476+0000 7f61fb7fe700 1 -- 172.21.15.146:0/2585525765 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62040083b0 con 0x7f6214143ea0 2021-01-27T09:51:30.481 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.476+0000 7f62188ed700 1 -- 172.21.15.146:0/2585525765 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6214161ce0 con 0x7f6214143ea0 2021-01-27T09:51:30.482 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.476+0000 7f61fb7fe700 1 -- 172.21.15.146:0/2585525765 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6204008730 con 0x7f6214143ea0 2021-01-27T09:51:30.483 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.476+0000 7f62188ed700 1 -- 172.21.15.146:0/2585525765 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6214141180 con 0x7f6214143ea0 2021-01-27T09:51:30.484 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.480+0000 7f61fb7fe700 1 -- 172.21.15.146:0/2585525765 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f620400c820 con 0x7f6214143ea0 2021-01-27T09:51:30.485 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.480+0000 7f61fb7fe700 1 --2- 172.21.15.146:0/2585525765 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f61f4056230 0x7f61f40586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:30.485 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.480+0000 7f61fb7fe700 1 -- 172.21.15.146:0/2585525765 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6997+0+0 (secure 0 0 0) 0x7f6204070bf0 con 0x7f6214143ea0 2021-01-27T09:51:30.486 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.480+0000 7f62137fe700 1 --2- 172.21.15.146:0/2585525765 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f61f4056230 0x7f61f40586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:30.486 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.480+0000 7f62137fe700 1 --2- 172.21.15.146:0/2585525765 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f61f4056230 0x7f61f40586f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f620c009c30 tx=0x7f620c009220).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:30.495 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.488+0000 7f61fb7fe700 1 -- 172.21.15.146:0/2585525765 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f6204046270 con 0x7f6214143ea0 2021-01-27T09:51:30.824 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.820+0000 7f62188ed700 1 -- 172.21.15.146:0/2585525765 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6214141180 con 0x7f6214143ea0 2021-01-27T09:51:30.826 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.820+0000 7f61fb7fe700 1 -- 172.21.15.146:0/2585525765 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3580 (secure 0 0 0) 0x7f6204049890 con 0x7f6214143ea0 2021-01-27T09:51:30.826 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:51:30.827 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":5040,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6835/3537280353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3537280353},{"type":"v1","addr":"172.21.15.146:6835","nonce":3537280353}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":28}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:49:41.804473+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4971":{"gid":4971,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:51:30.832 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.828+0000 7f62188ed700 1 -- 172.21.15.146:0/2585525765 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f61f4056230 msgr2=0x7f61f40586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:30.833 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.828+0000 7f62188ed700 1 --2- 172.21.15.146:0/2585525765 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f61f4056230 0x7f61f40586f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f620c009c30 tx=0x7f620c009220).stop 2021-01-27T09:51:30.834 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.828+0000 7f62188ed700 1 -- 172.21.15.146:0/2585525765 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6214143ea0 msgr2=0x7f6214162180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:30.834 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.828+0000 7f62188ed700 1 --2- 172.21.15.146:0/2585525765 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6214143ea0 0x7f6214162180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f620400abe0 tx=0x7f62140ae720).stop 2021-01-27T09:51:30.834 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.828+0000 7f62188ed700 1 -- 172.21.15.146:0/2585525765 shutdown_connections 2021-01-27T09:51:30.834 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.828+0000 7f62188ed700 1 --2- 172.21.15.146:0/2585525765 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6214143ea0 0x7f6214162180 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:30.835 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.828+0000 7f62188ed700 1 --2- 172.21.15.146:0/2585525765 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f61f4056230 0x7f61f40586f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:30.835 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.828+0000 7f62188ed700 1 --2- 172.21.15.146:0/2585525765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6214143ac0 0x7f6214138500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:51:30.835 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.828+0000 7f62188ed700 1 --2- 172.21.15.146:0/2585525765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62140bd500 0x7f6214165010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:51:30.835 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.828+0000 7f62188ed700 1 -- 172.21.15.146:0/2585525765 >> 172.21.15.146:0/2585525765 conn(0x7f6214060a30 msgr2=0x7f621414a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:51:30.836 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.828+0000 7f62188ed700 1 -- 172.21.15.146:0/2585525765 shutdown_connections 2021-01-27T09:51:30.836 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:30.828+0000 7f62188ed700 1 -- 172.21.15.146:0/2585525765 wait complete. 2021-01-27T09:51:30.838 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 29 2021-01-27T09:51:30.863 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.b (rank=0) 2021-01-27T09:51:30.864 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-01-27T09:51:30.864 INFO:teuthology.orchestra.run:waiting for 300 2021-01-27T09:51:30.875 INFO:tasks.ceph.mds.b:Stopped 2021-01-27T09:51:30.875 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:51:31.088 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.080+0000 7f20dd665700 1 Processor -- start 2021-01-27T09:51:31.089 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.084+0000 7f20dd665700 1 -- start start 2021-01-27T09:51:31.090 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.084+0000 7f20dd665700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f20d80bb1d0 0x7f20d8064620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:31.090 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.084+0000 7f20dd665700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d80b98f0 con 0x7f20d80679f0 2021-01-27T09:51:31.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.084+0000 7f20dd665700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d80b9b90 con 0x7f20d8064240 2021-01-27T09:51:31.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.084+0000 7f20dd665700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d8063f00 con 0x7f20d80bb1d0 2021-01-27T09:51:31.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.084+0000 7f20d77fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f20d80679f0 0x7f20d80baab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:41578/0 (socket says 172.21.15.146:41578) 2021-01-27T09:51:31.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.084+0000 7f20d77fe700 1 -- 172.21.15.146:0/3283496145 learned_addr learned my addr 172.21.15.146:0/3283496145 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:51:31.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.084+0000 7f20dce64700 1 --2- 172.21.15.146:0/3283496145 >> v2:172.21.15.78:3300/0 conn(0x7f20d80bb1d0 0x7f20d8064620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:31.093 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.084+0000 7f20dce64700 1 -- 172.21.15.146:0/3283496145 >> v1:172.21.15.146:6789/0 conn(0x7f20d8064240 legacy=0x7f20d80637e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:31.093 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.084+0000 7f20dce64700 1 -- 172.21.15.146:0/3283496145 >> v1:172.21.15.78:6789/0 conn(0x7f20d80679f0 legacy=0x7f20d80baab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:31.093 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.084+0000 7f20dce64700 1 -- 172.21.15.146:0/3283496145 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d80b9e30 con 0x7f20d80bb1d0 2021-01-27T09:51:31.094 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.088+0000 7f20dce64700 1 --2- 172.21.15.146:0/3283496145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20d80bb1d0 0x7f20d8064620 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f20d0009cc0 tx=0x7f20d0009220).ready entity=mon.0 client_cookie=555c9fa8927abe5d server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:31.112 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.108+0000 7f20d6ffd700 1 -- 172.21.15.146:0/3283496145 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d0009ed0 con 0x7f20d80bb1d0 2021-01-27T09:51:31.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.108+0000 7f20d6ffd700 1 -- 172.21.15.146:0/3283496145 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d000baf0 con 0x7f20d80bb1d0 2021-01-27T09:51:31.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.108+0000 7f20d6ffd700 1 -- 172.21.15.146:0/3283496145 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d000be90 con 0x7f20d80bb1d0 2021-01-27T09:51:31.114 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.108+0000 7f20dd665700 1 -- 172.21.15.146:0/3283496145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20d80bb1d0 msgr2=0x7f20d8064620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:31.114 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.108+0000 7f20dd665700 1 --2- 172.21.15.146:0/3283496145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20d80bb1d0 0x7f20d8064620 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f20d0009cc0 tx=0x7f20d0009220).stop 2021-01-27T09:51:31.114 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.108+0000 7f20dd665700 1 -- 172.21.15.146:0/3283496145 shutdown_connections 2021-01-27T09:51:31.115 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.108+0000 7f20dd665700 1 --2- 172.21.15.146:0/3283496145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20d80bb1d0 0x7f20d8064620 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:31.115 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.108+0000 7f20dd665700 1 -- 172.21.15.146:0/3283496145 >> 172.21.15.146:0/3283496145 conn(0x7f20d80652c0 msgr2=0x7f20d8067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:51:31.115 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.108+0000 7f20dd665700 1 -- 172.21.15.146:0/3283496145 shutdown_connections 2021-01-27T09:51:31.116 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.108+0000 7f20dd665700 1 -- 172.21.15.146:0/3283496145 wait complete. 2021-01-27T09:51:31.116 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.112+0000 7f20dd665700 1 Processor -- start 2021-01-27T09:51:31.117 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.112+0000 7f20dd665700 1 -- start start 2021-01-27T09:51:31.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.112+0000 7f20dd665700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20d8064240 0x7f20d814d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:31.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.112+0000 7f20dd665700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f20d80679f0 0x7f20d8161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:31.120 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.112+0000 7f20d7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20d8064240 0x7f20d814d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:31.120 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.112+0000 7f20d7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20d8064240 0x7f20d814d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:56852/0 (socket says 172.21.15.146:56852) 2021-01-27T09:51:31.121 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.112+0000 7f20d7fff700 1 -- 172.21.15.146:0/600516505 learned_addr learned my addr 172.21.15.146:0/600516505 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:51:31.121 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.112+0000 7f20d77fe700 1 --2- 172.21.15.146:0/600516505 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f20d80679f0 0x7f20d8161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:31.121 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.112+0000 7f20dd665700 1 --2- 172.21.15.146:0/600516505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20d80bb1d0 0x7f20d81620a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:31.122 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.116+0000 7f20dce64700 1 --2- 172.21.15.146:0/600516505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20d80bb1d0 0x7f20d81620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:31.123 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.116+0000 7f20dd665700 1 -- 172.21.15.146:0/600516505 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d814e100 con 0x7f20d8064240 2021-01-27T09:51:31.123 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.116+0000 7f20dd665700 1 -- 172.21.15.146:0/600516505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d81617c0 con 0x7f20d80bb1d0 2021-01-27T09:51:31.123 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.116+0000 7f20dd665700 1 -- 172.21.15.146:0/600516505 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d8162590 con 0x7f20d80679f0 2021-01-27T09:51:31.123 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.116+0000 7f20dce64700 1 -- 172.21.15.146:0/600516505 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f20d80679f0 msgr2=0x7f20d8161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:31.124 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.116+0000 7f20dce64700 1 --2- 172.21.15.146:0/600516505 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f20d80679f0 0x7f20d8161bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:31.124 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.116+0000 7f20dce64700 1 -- 172.21.15.146:0/600516505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20d8064240 msgr2=0x7f20d814d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:31.124 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.116+0000 7f20dce64700 1 --2- 172.21.15.146:0/600516505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20d8064240 0x7f20d814d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:31.125 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.116+0000 7f20dce64700 1 -- 172.21.15.146:0/600516505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d80be3f0 con 0x7f20d80bb1d0 2021-01-27T09:51:31.125 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.116+0000 7f20dce64700 1 --2- 172.21.15.146:0/600516505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20d80bb1d0 0x7f20d81620a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f20d0013000 tx=0x7f20d80a7eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:31.125 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.116+0000 7f20cffff700 1 -- 172.21.15.146:0/600516505 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d0009990 con 0x7f20d80bb1d0 2021-01-27T09:51:31.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.116+0000 7f20cffff700 1 -- 172.21.15.146:0/600516505 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d001c600 con 0x7f20d80bb1d0 2021-01-27T09:51:31.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.116+0000 7f20cffff700 1 -- 172.21.15.146:0/600516505 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d001c9a0 con 0x7f20d80bb1d0 2021-01-27T09:51:31.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.116+0000 7f20dd665700 1 -- 172.21.15.146:0/600516505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d80bd660 con 0x7f20d80bb1d0 2021-01-27T09:51:31.127 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.120+0000 7f20cffff700 1 -- 172.21.15.146:0/600516505 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f20d000f070 con 0x7f20d80bb1d0 2021-01-27T09:51:31.127 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.120+0000 7f20dd665700 1 -- 172.21.15.146:0/600516505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d80bdba0 con 0x7f20d80bb1d0 2021-01-27T09:51:31.127 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.120+0000 7f20cffff700 1 --2- 172.21.15.146:0/600516505 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f20bc056210 0x7f20bc0586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:31.127 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.120+0000 7f20cffff700 1 -- 172.21.15.146:0/600516505 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6997+0+0 (secure 0 0 0) 0x7f20d00709e0 con 0x7f20d80bb1d0 2021-01-27T09:51:31.128 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.120+0000 7f20d7fff700 1 --2- 172.21.15.146:0/600516505 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f20bc056210 0x7f20bc0586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:31.128 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.120+0000 7f20cdffb700 1 -- 172.21.15.146:0/600516505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d80be690 con 0x7f20d80bb1d0 2021-01-27T09:51:31.129 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.124+0000 7f20d7fff700 1 --2- 172.21.15.146:0/600516505 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f20bc056210 0x7f20bc0586d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f20c0003880 tx=0x7f20c0007bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:31.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.128+0000 7f20cffff700 1 -- 172.21.15.146:0/600516505 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f20d80be690 con 0x7f20d80bb1d0 2021-01-27T09:51:31.469 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.464+0000 7f20cdffb700 1 -- 172.21.15.146:0/600516505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20d80be690 con 0x7f20d80bb1d0 2021-01-27T09:51:31.470 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.464+0000 7f20cffff700 1 -- 172.21.15.146:0/600516505 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3580 (secure 0 0 0) 0x7f20d002c090 con 0x7f20d80bb1d0 2021-01-27T09:51:31.471 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:51:31.471 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":5040,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6835/3537280353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3537280353},{"type":"v1","addr":"172.21.15.146:6835","nonce":3537280353}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":28}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:49:41.804473+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4971":{"gid":4971,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:51:31.472 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.468+0000 7f20cdffb700 1 -- 172.21.15.146:0/600516505 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f20bc056210 msgr2=0x7f20bc0586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:31.473 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.468+0000 7f20cdffb700 1 --2- 172.21.15.146:0/600516505 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f20bc056210 0x7f20bc0586d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f20c0003880 tx=0x7f20c0007bc0).stop 2021-01-27T09:51:31.473 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.468+0000 7f20cdffb700 1 -- 172.21.15.146:0/600516505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20d80bb1d0 msgr2=0x7f20d81620a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:31.473 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.468+0000 7f20cdffb700 1 --2- 172.21.15.146:0/600516505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20d80bb1d0 0x7f20d81620a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f20d0013000 tx=0x7f20d80a7eb0).stop 2021-01-27T09:51:31.475 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.468+0000 7f20cdffb700 1 -- 172.21.15.146:0/600516505 shutdown_connections 2021-01-27T09:51:31.475 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.468+0000 7f20cdffb700 1 --2- 172.21.15.146:0/600516505 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f20bc056210 0x7f20bc0586d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:31.475 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.468+0000 7f20cdffb700 1 --2- 172.21.15.146:0/600516505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20d80bb1d0 0x7f20d81620a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:31.476 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.468+0000 7f20cdffb700 1 --2- 172.21.15.146:0/600516505 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f20d80679f0 0x7f20d8161bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:31.476 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.468+0000 7f20cdffb700 1 --2- 172.21.15.146:0/600516505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20d8064240 0x7f20d814d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:31.476 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.468+0000 7f20cdffb700 1 -- 172.21.15.146:0/600516505 >> 172.21.15.146:0/600516505 conn(0x7f20d80652c0 msgr2=0x7f20d8067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:51:31.476 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.468+0000 7f20cdffb700 1 -- 172.21.15.146:0/600516505 shutdown_connections 2021-01-27T09:51:31.477 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:31.468+0000 7f20cdffb700 1 -- 172.21.15.146:0/600516505 wait complete. 2021-01-27T09:51:31.477 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 29 2021-01-27T09:51:31.501 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-01-27T09:51:33.501 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:51:33.757 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.752+0000 7f566083b700 1 Processor -- start 2021-01-27T09:51:33.763 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.752+0000 7f566083b700 1 -- start start 2021-01-27T09:51:33.763 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.752+0000 7f566083b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f565c14dc70 0x7f565c0bf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:33.763 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.752+0000 7f566083b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f565c151cc0 0x7f565c14b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:33.763 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.752+0000 7f566083b700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565c065e10 con 0x7f565c0bf050 2021-01-27T09:51:33.764 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.752+0000 7f566083b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f565c0c4b50 con 0x7f565c151cc0 2021-01-27T09:51:33.764 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.752+0000 7f566083b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c14b790 con 0x7f565c14dc70 2021-01-27T09:51:33.764 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.752+0000 7f565bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f565c151cc0 0x7f565c14b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:33.764 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.752+0000 7f565bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f565c151cc0 0x7f565c14b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54050/0 (socket says 172.21.15.146:54050) 2021-01-27T09:51:33.765 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.752+0000 7f565bfff700 1 -- 172.21.15.146:0/2041321451 learned_addr learned my addr 172.21.15.146:0/2041321451 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:51:33.765 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.756+0000 7f565bfff700 1 -- 172.21.15.146:0/2041321451 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f565c14dc70 msgr2=0x7f565c0bf430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:51:33.765 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.756+0000 7f565bfff700 1 --2- 172.21.15.146:0/2041321451 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f565c14dc70 0x7f565c0bf430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:51:33.765 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.756+0000 7f565bfff700 1 -- 172.21.15.146:0/2041321451 >> v1:172.21.15.78:6789/0 conn(0x7f565c0bf050 legacy=0x7f565c14ab80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:51:33.766 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.756+0000 7f565bfff700 1 -- 172.21.15.146:0/2041321451 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c066580 con 0x7f565c151cc0 2021-01-27T09:51:33.766 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.756+0000 7f565bfff700 1 --2- 172.21.15.146:0/2041321451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f565c151cc0 0x7f565c14b2a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f5654014c50 tx=0x7f565400fb00).ready entity=mon.1 client_cookie=fc6f4e75ed59341 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:33.785 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.772+0000 7f565a7fc700 1 -- 172.21.15.146:0/2041321451 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5654014e60 con 0x7f565c151cc0 2021-01-27T09:51:33.786 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.772+0000 7f565a7fc700 1 -- 172.21.15.146:0/2041321451 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5654012d00 con 0x7f565c151cc0 2021-01-27T09:51:33.786 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.772+0000 7f566083b700 1 -- 172.21.15.146:0/2041321451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f565c151cc0 msgr2=0x7f565c14b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:33.786 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.772+0000 7f566083b700 1 --2- 172.21.15.146:0/2041321451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f565c151cc0 0x7f565c14b2a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f5654014c50 tx=0x7f565400fb00).stop 2021-01-27T09:51:33.787 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.776+0000 7f566083b700 1 -- 172.21.15.146:0/2041321451 shutdown_connections 2021-01-27T09:51:33.787 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.776+0000 7f566083b700 1 --2- 172.21.15.146:0/2041321451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f565c151cc0 0x7f565c14b2a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:33.787 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.776+0000 7f566083b700 1 --2- 172.21.15.146:0/2041321451 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f565c14dc70 0x7f565c0bf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:51:33.788 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.776+0000 7f566083b700 1 -- 172.21.15.146:0/2041321451 >> 172.21.15.146:0/2041321451 conn(0x7f565c064f30 msgr2=0x7f565c065340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:51:33.792 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.784+0000 7f566083b700 1 -- 172.21.15.146:0/2041321451 shutdown_connections 2021-01-27T09:51:33.794 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.788+0000 7f566083b700 1 -- 172.21.15.146:0/2041321451 wait complete. 2021-01-27T09:51:33.797 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.792+0000 7f566083b700 1 Processor -- start 2021-01-27T09:51:33.797 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.792+0000 7f566083b700 1 -- start start 2021-01-27T09:51:33.798 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.792+0000 7f566083b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f565c0bf050 0x7f565c0c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:33.798 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.792+0000 7f566083b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f565c14dc70 0x7f565c0bcd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:33.799 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.792+0000 7f565affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f565c14dc70 0x7f565c0bcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:33.799 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.792+0000 7f565affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f565c14dc70 0x7f565c0bcd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54054/0 (socket says 172.21.15.146:54054) 2021-01-27T09:51:33.800 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.792+0000 7f565b7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f565c0bf050 0x7f565c0c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:33.800 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.792+0000 7f565affd700 1 -- 172.21.15.146:0/2427589640 learned_addr learned my addr 172.21.15.146:0/2427589640 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:51:33.800 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.792+0000 7f566083b700 1 --2- 172.21.15.146:0/2427589640 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f565c151cc0 0x7f565c148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:33.801 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.792+0000 7f566083b700 1 -- 172.21.15.146:0/2427589640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c146620 con 0x7f565c0bf050 2021-01-27T09:51:33.801 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.792+0000 7f566083b700 1 -- 172.21.15.146:0/2427589640 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c146880 con 0x7f565c14dc70 2021-01-27T09:51:33.801 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.792+0000 7f566083b700 1 -- 172.21.15.146:0/2427589640 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c146b20 con 0x7f565c151cc0 2021-01-27T09:51:33.802 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.796+0000 7f565affd700 1 -- 172.21.15.146:0/2427589640 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f565c151cc0 msgr2=0x7f565c148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:33.802 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.796+0000 7f565affd700 1 --2- 172.21.15.146:0/2427589640 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f565c151cc0 0x7f565c148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:51:33.802 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.796+0000 7f565affd700 1 -- 172.21.15.146:0/2427589640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f565c0bf050 msgr2=0x7f565c0c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:33.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.796+0000 7f565affd700 1 --2- 172.21.15.146:0/2427589640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f565c0bf050 0x7f565c0c3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:33.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.796+0000 7f565affd700 1 -- 172.21.15.146:0/2427589640 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c146dc0 con 0x7f565c14dc70 2021-01-27T09:51:33.812 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.796+0000 7f565affd700 1 --2- 172.21.15.146:0/2427589640 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f565c14dc70 0x7f565c0bcd90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f56500096b0 tx=0x7f5650006e10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:33.812 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.796+0000 7f56437fe700 1 -- 172.21.15.146:0/2427589640 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565000d500 con 0x7f565c14dc70 2021-01-27T09:51:33.813 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.796+0000 7f56437fe700 1 -- 172.21.15.146:0/2427589640 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565000d660 con 0x7f565c14dc70 2021-01-27T09:51:33.813 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.796+0000 7f566083b700 1 -- 172.21.15.146:0/2427589640 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f565c147060 con 0x7f565c14dc70 2021-01-27T09:51:33.813 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.796+0000 7f566083b700 1 -- 172.21.15.146:0/2427589640 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565c1475a0 con 0x7f565c14dc70 2021-01-27T09:51:33.813 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.796+0000 7f566083b700 1 -- 172.21.15.146:0/2427589640 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f565c0c47f0 con 0x7f565c14dc70 2021-01-27T09:51:33.814 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.796+0000 7f56437fe700 1 -- 172.21.15.146:0/2427589640 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565000da20 con 0x7f565c14dc70 2021-01-27T09:51:33.814 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.804+0000 7f56437fe700 1 -- 172.21.15.146:0/2427589640 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f5650012420 con 0x7f565c14dc70 2021-01-27T09:51:33.814 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.804+0000 7f56437fe700 1 --2- 172.21.15.146:0/2427589640 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f56480563e0 0x7f56480588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:33.814 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.804+0000 7f56437fe700 1 -- 172.21.15.146:0/2427589640 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6997+0+0 (secure 0 0 0) 0x7f565006fd70 con 0x7f565c14dc70 2021-01-27T09:51:33.815 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.804+0000 7f565b7fe700 1 --2- 172.21.15.146:0/2427589640 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f56480563e0 0x7f56480588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:33.815 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.808+0000 7f565b7fe700 1 --2- 172.21.15.146:0/2427589640 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f56480563e0 0x7f56480588a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f564c00b700 tx=0x7f564c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:33.815 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:33.808+0000 7f56437fe700 1 -- 172.21.15.146:0/2427589640 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f5650045280 con 0x7f565c14dc70 2021-01-27T09:51:34.195 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:34.188+0000 7f566083b700 1 -- 172.21.15.146:0/2427589640 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f565c0c47f0 con 0x7f565c14dc70 2021-01-27T09:51:34.196 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:34.188+0000 7f56437fe700 1 -- 172.21.15.146:0/2427589640 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3580 (secure 0 0 0) 0x7f565c0c47f0 con 0x7f565c14dc70 2021-01-27T09:51:34.196 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:51:34.196 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":5040,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6835/3537280353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3537280353},{"type":"v1","addr":"172.21.15.146:6835","nonce":3537280353}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":28}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:49:41.804473+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4971":{"gid":4971,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:51:34.199 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:34.192+0000 7f566083b700 1 -- 172.21.15.146:0/2427589640 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f56480563e0 msgr2=0x7f56480588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:34.199 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:34.192+0000 7f566083b700 1 --2- 172.21.15.146:0/2427589640 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f56480563e0 0x7f56480588a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f564c00b700 tx=0x7f564c008040).stop 2021-01-27T09:51:34.199 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:34.192+0000 7f566083b700 1 -- 172.21.15.146:0/2427589640 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f565c14dc70 msgr2=0x7f565c0bcd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:34.199 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:34.192+0000 7f566083b700 1 --2- 172.21.15.146:0/2427589640 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f565c14dc70 0x7f565c0bcd90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f56500096b0 tx=0x7f5650006e10).stop 2021-01-27T09:51:34.200 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:34.192+0000 7f566083b700 1 -- 172.21.15.146:0/2427589640 shutdown_connections 2021-01-27T09:51:34.200 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:34.192+0000 7f566083b700 1 --2- 172.21.15.146:0/2427589640 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f565c151cc0 0x7f565c148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:51:34.200 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:34.192+0000 7f566083b700 1 --2- 172.21.15.146:0/2427589640 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f56480563e0 0x7f56480588a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:34.200 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:34.192+0000 7f566083b700 1 --2- 172.21.15.146:0/2427589640 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f565c14dc70 0x7f565c0bcd90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:34.192+0000 7f566083b700 1 --2- 172.21.15.146:0/2427589640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f565c0bf050 0x7f565c0c3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:34.192+0000 7f566083b700 1 -- 172.21.15.146:0/2427589640 >> 172.21.15.146:0/2427589640 conn(0x7f565c064f30 msgr2=0x7f565c0c4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:51:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:34.192+0000 7f566083b700 1 -- 172.21.15.146:0/2427589640 shutdown_connections 2021-01-27T09:51:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:34.192+0000 7f566083b700 1 -- 172.21.15.146:0/2427589640 wait complete. 2021-01-27T09:51:34.205 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 29 2021-01-27T09:51:34.231 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-01-27T09:51:36.233 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:51:37.115 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.108+0000 7fac10dd3700 1 Processor -- start 2021-01-27T09:51:37.116 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.108+0000 7fac10dd3700 1 -- start start 2021-01-27T09:51:37.117 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.108+0000 7fac10dd3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac0c064f00 0x7fac0c0bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:37.117 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.108+0000 7fac10dd3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fac0c0652e0 0x7fac0c0beb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:37.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.108+0000 7fac10dd3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0c0ae480 con 0x7fac0c069110 2021-01-27T09:51:37.120 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.108+0000 7fac10dd3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0c0ae6b0 con 0x7fac0c0652e0 2021-01-27T09:51:37.120 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.108+0000 7fac10dd3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0ae950 con 0x7fac0c064f00 2021-01-27T09:51:37.120 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.112+0000 7fac0affd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fac0c0652e0 0x7fac0c0beb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:37.121 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.112+0000 7fac0affd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fac0c0652e0 0x7fac0c0beb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:56992/0 (socket says 172.21.15.146:56992) 2021-01-27T09:51:37.121 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.112+0000 7fac0affd700 1 -- 172.21.15.146:0/1724826733 learned_addr learned my addr 172.21.15.146:0/1724826733 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:51:37.122 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.112+0000 7fac0affd700 1 -- 172.21.15.146:0/1724826733 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac0c064f00 msgr2=0x7fac0c0bcbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-01-27T09:51:37.122 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.112+0000 7fac0affd700 1 --2- 172.21.15.146:0/1724826733 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac0c064f00 0x7fac0c0bcbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:51:37.123 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.112+0000 7fac0affd700 1 -- 172.21.15.146:0/1724826733 >> v1:172.21.15.146:6789/0 conn(0x7fac0c069110 legacy=0x7fac0c14bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:37.123 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.112+0000 7fac0affd700 1 -- 172.21.15.146:0/1724826733 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c0aebf0 con 0x7fac0c0652e0 2021-01-27T09:51:37.123 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.112+0000 7fac0affd700 1 --2- 172.21.15.146:0/1724826733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac0c0652e0 0x7fac0c0beb90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fac04009d90 tx=0x7fac040092d0).ready entity=mon.0 client_cookie=aef33f5e8bc06d76 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:37.131 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.112+0000 7fac0a7fc700 1 -- 172.21.15.146:0/1724826733 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0400bc80 con 0x7fac0c0652e0 2021-01-27T09:51:37.131 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.112+0000 7fac0a7fc700 1 -- 172.21.15.146:0/1724826733 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0400bde0 con 0x7fac0c0652e0 2021-01-27T09:51:37.132 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.112+0000 7fac0a7fc700 1 -- 172.21.15.146:0/1724826733 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0400bc80 con 0x7fac0c0652e0 2021-01-27T09:51:37.132 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.112+0000 7fac10dd3700 1 -- 172.21.15.146:0/1724826733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac0c0652e0 msgr2=0x7fac0c0beb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.112+0000 7fac10dd3700 1 --2- 172.21.15.146:0/1724826733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac0c0652e0 0x7fac0c0beb90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fac04009d90 tx=0x7fac040092d0).stop 2021-01-27T09:51:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.116+0000 7fac10dd3700 1 -- 172.21.15.146:0/1724826733 shutdown_connections 2021-01-27T09:51:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.116+0000 7fac10dd3700 1 --2- 172.21.15.146:0/1724826733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac0c0652e0 0x7fac0c0beb90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:37.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.116+0000 7fac10dd3700 1 --2- 172.21.15.146:0/1724826733 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac0c064f00 0x7fac0c0bcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:51:37.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.116+0000 7fac10dd3700 1 -- 172.21.15.146:0/1724826733 >> 172.21.15.146:0/1724826733 conn(0x7fac0c060a30 msgr2=0x7fac0c065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:51:37.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.116+0000 7fac10dd3700 1 -- 172.21.15.146:0/1724826733 shutdown_connections 2021-01-27T09:51:37.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.116+0000 7fac10dd3700 1 -- 172.21.15.146:0/1724826733 wait complete. 2021-01-27T09:51:37.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.116+0000 7fac10dd3700 1 Processor -- start 2021-01-27T09:51:37.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.120+0000 7fac10dd3700 1 -- start start 2021-01-27T09:51:37.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.120+0000 7fac10dd3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac0c064f00 0x7fac0c0afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:37.137 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.120+0000 7fac10dd3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac0c0652e0 0x7fac0c0aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:37.137 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.120+0000 7fac10dd3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac0c069110 0x7fac0c164fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:37.138 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.120+0000 7fac10dd3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0b0480 con 0x7fac0c0652e0 2021-01-27T09:51:37.138 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.120+0000 7fac10dd3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0b2c40 con 0x7fac0c064f00 2021-01-27T09:51:37.139 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.120+0000 7fac10dd3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0b16d0 con 0x7fac0c069110 2021-01-27T09:51:37.139 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.120+0000 7fac0b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac0c064f00 0x7fac0c0afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:37.139 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.120+0000 7fac0bfff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac0c069110 0x7fac0c164fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:37.140 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.120+0000 7fac0b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac0c064f00 0x7fac0c0afaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54124/0 (socket says 172.21.15.146:54124) 2021-01-27T09:51:37.140 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.120+0000 7fac0b7fe700 1 -- 172.21.15.146:0/2259701668 learned_addr learned my addr 172.21.15.146:0/2259701668 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:51:37.141 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.120+0000 7fac0affd700 1 --2- 172.21.15.146:0/2259701668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac0c0652e0 0x7fac0c0aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:37.141 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.120+0000 7fac0bfff700 1 -- 172.21.15.146:0/2259701668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac0c064f00 msgr2=0x7fac0c0afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:37.141 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.120+0000 7fac0bfff700 1 --2- 172.21.15.146:0/2259701668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac0c064f00 0x7fac0c0afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:37.142 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.120+0000 7fac0bfff700 1 -- 172.21.15.146:0/2259701668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac0c0652e0 msgr2=0x7fac0c0aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:37.142 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.120+0000 7fac0bfff700 1 --2- 172.21.15.146:0/2259701668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac0c0652e0 0x7fac0c0aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:37.143 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.120+0000 7fac0bfff700 1 -- 172.21.15.146:0/2259701668 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c0b2e70 con 0x7fac0c069110 2021-01-27T09:51:37.143 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.120+0000 7fac0bfff700 1 --2- 172.21.15.146:0/2259701668 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac0c069110 0x7fac0c164fc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fabfc00c4a0 tx=0x7fabfc007b40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:37.144 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.120+0000 7fabf37fe700 1 -- 172.21.15.146:0/2259701668 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc00f470 con 0x7fac0c069110 2021-01-27T09:51:37.144 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.120+0000 7fabf37fe700 1 -- 172.21.15.146:0/2259701668 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabfc00f5d0 con 0x7fac0c069110 2021-01-27T09:51:37.144 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.120+0000 7fabf37fe700 1 -- 172.21.15.146:0/2259701668 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc00f950 con 0x7fac0c069110 2021-01-27T09:51:37.145 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.124+0000 7fac10dd3700 1 -- 172.21.15.146:0/2259701668 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0c0b3110 con 0x7fac0c069110 2021-01-27T09:51:37.145 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.124+0000 7fac10dd3700 1 -- 172.21.15.146:0/2259701668 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0c0bb650 con 0x7fac0c069110 2021-01-27T09:51:37.147 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.124+0000 7fabf37fe700 1 -- 172.21.15.146:0/2259701668 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fabfc019030 con 0x7fac0c069110 2021-01-27T09:51:37.147 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.128+0000 7fabf37fe700 1 --2- 172.21.15.146:0/2259701668 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fabec0561e0 0x7fabec0586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:37.148 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.128+0000 7fabf37fe700 1 -- 172.21.15.146:0/2259701668 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6997+0+0 (secure 0 0 0) 0x7fabfc06e8d0 con 0x7fac0c069110 2021-01-27T09:51:37.148 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.128+0000 7fac0b7fe700 1 --2- 172.21.15.146:0/2259701668 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fabec0561e0 0x7fabec0586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:37.148 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.128+0000 7fac10dd3700 1 -- 172.21.15.146:0/2259701668 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac0c0af680 con 0x7fac0c069110 2021-01-27T09:51:37.149 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.132+0000 7fac0b7fe700 1 --2- 172.21.15.146:0/2259701668 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fabec0561e0 0x7fabec0586a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fac0000b7d0 tx=0x7fac00008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:37.152 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.136+0000 7fabf37fe700 1 -- 172.21.15.146:0/2259701668 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fabfc043e70 con 0x7fac0c069110 2021-01-27T09:51:37.590 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.584+0000 7fac10dd3700 1 -- 172.21.15.146:0/2259701668 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac0c0beff0 con 0x7fac0c069110 2021-01-27T09:51:37.591 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.584+0000 7fabf37fe700 1 -- 172.21.15.146:0/2259701668 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3580 (secure 0 0 0) 0x7fac0c0beff0 con 0x7fac0c069110 2021-01-27T09:51:37.598 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:51:37.598 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":5040,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6835/3537280353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3537280353},{"type":"v1","addr":"172.21.15.146:6835","nonce":3537280353}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":28}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:49:41.804473+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4971":{"gid":4971,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:51:37.598 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.588+0000 7fabf17fa700 1 -- 172.21.15.146:0/2259701668 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fabec0561e0 msgr2=0x7fabec0586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:37.599 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.588+0000 7fabf17fa700 1 --2- 172.21.15.146:0/2259701668 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fabec0561e0 0x7fabec0586a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fac0000b7d0 tx=0x7fac00008040).stop 2021-01-27T09:51:37.599 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.588+0000 7fabf17fa700 1 -- 172.21.15.146:0/2259701668 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac0c069110 msgr2=0x7fac0c164fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:37.599 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.588+0000 7fabf17fa700 1 --2- 172.21.15.146:0/2259701668 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac0c069110 0x7fac0c164fc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fabfc00c4a0 tx=0x7fabfc007b40).stop 2021-01-27T09:51:37.603 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.596+0000 7fabf17fa700 1 -- 172.21.15.146:0/2259701668 shutdown_connections 2021-01-27T09:51:37.603 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.596+0000 7fabf17fa700 1 --2- 172.21.15.146:0/2259701668 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac0c069110 0x7fac0c164fc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:37.605 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.596+0000 7fabf17fa700 1 --2- 172.21.15.146:0/2259701668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac0c0652e0 0x7fac0c0aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:37.605 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.596+0000 7fabf17fa700 1 --2- 172.21.15.146:0/2259701668 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fabec0561e0 0x7fabec0586a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:37.605 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.596+0000 7fabf17fa700 1 --2- 172.21.15.146:0/2259701668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac0c064f00 0x7fac0c0afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:37.605 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.596+0000 7fabf17fa700 1 -- 172.21.15.146:0/2259701668 >> 172.21.15.146:0/2259701668 conn(0x7fac0c060a30 msgr2=0x7fac0c14f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:51:37.616 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.612+0000 7fabf17fa700 1 -- 172.21.15.146:0/2259701668 shutdown_connections 2021-01-27T09:51:37.617 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:37.612+0000 7fabf17fa700 1 -- 172.21.15.146:0/2259701668 wait complete. 2021-01-27T09:51:37.619 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 29 2021-01-27T09:51:37.646 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-01-27T09:51:39.647 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:51:44.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.120+0000 7ff4ba20f700 1 Processor -- start 2021-01-27T09:51:44.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.120+0000 7ff4ba20f700 1 -- start start 2021-01-27T09:51:44.132 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.120+0000 7ff4ba20f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff4b40bdc10 0x7ff4b40b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:44.132 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.120+0000 7ff4ba20f700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff4b40bdff0 0x7ff4b414dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:44.132 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.120+0000 7ff4ba20f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4b40bad40 0x7ff4b4151e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:44.132 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.120+0000 7ff4ba20f700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b4151470 con 0x7ff4b40bdff0 2021-01-27T09:51:44.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.120+0000 7ff4ba20f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b40bb7c0 con 0x7ff4b40bdc10 2021-01-27T09:51:44.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.120+0000 7ff4ba20f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b40bb280 con 0x7ff4b40bad40 2021-01-27T09:51:44.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.124+0000 7ff4b2ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff4b40bdff0 0x7ff4b414dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:44.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.124+0000 7ff4b2ffd700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff4b40bdff0 0x7ff4b414dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:57126/0 (socket says 172.21.15.146:57126) 2021-01-27T09:51:44.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.124+0000 7ff4b2ffd700 1 -- 172.21.15.146:0/1830704124 learned_addr learned my addr 172.21.15.146:0/1830704124 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:51:44.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.124+0000 7ff4b37fe700 1 --2- 172.21.15.146:0/1830704124 >> v2:172.21.15.146:3300/0 conn(0x7ff4b40bdc10 0x7ff4b40b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:44.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.124+0000 7ff4b2ffd700 1 -- 172.21.15.146:0/1830704124 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4b40bad40 msgr2=0x7ff4b4151e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:51:44.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.124+0000 7ff4b2ffd700 1 --2- 172.21.15.146:0/1830704124 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4b40bad40 0x7ff4b4151e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:51:44.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.124+0000 7ff4b2ffd700 1 -- 172.21.15.146:0/1830704124 >> v2:172.21.15.146:3300/0 conn(0x7ff4b40bdc10 msgr2=0x7ff4b40b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:51:44.137 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.124+0000 7ff4b2ffd700 1 --2- 172.21.15.146:0/1830704124 >> v2:172.21.15.146:3300/0 conn(0x7ff4b40bdc10 0x7ff4b40b8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:44.137 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.124+0000 7ff4b2ffd700 1 -- 172.21.15.146:0/1830704124 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b40bb520 con 0x7ff4b40bdff0 2021-01-27T09:51:44.137 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.124+0000 7ff4b37fe700 1 --2- 172.21.15.146:0/1830704124 >> v2:172.21.15.146:3300/0 conn(0x7ff4b40bdc10 0x7ff4b40b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:51:44.138 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.124+0000 7ff4b2ffd700 1 --2- 172.21.15.146:0/1830704124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4b40bdff0 0x7ff4b414dd90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7ff4b40688b0 tx=0x7ff4ac0092d0).ready entity=mon.0 client_cookie=4bcc46dc7150a596 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:44.138 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.124+0000 7ff4b27fc700 1 -- 172.21.15.146:0/1830704124 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac00bc80 con 0x7ff4b40bdff0 2021-01-27T09:51:44.138 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.124+0000 7ff4b27fc700 1 -- 172.21.15.146:0/1830704124 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac00bde0 con 0x7ff4b40bdff0 2021-01-27T09:51:44.138 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.124+0000 7ff4b27fc700 1 -- 172.21.15.146:0/1830704124 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac011610 con 0x7ff4b40bdff0 2021-01-27T09:51:44.139 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.124+0000 7ff4ba20f700 1 -- 172.21.15.146:0/1830704124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4b40bdff0 msgr2=0x7ff4b414dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:44.139 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.124+0000 7ff4ba20f700 1 --2- 172.21.15.146:0/1830704124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4b40bdff0 0x7ff4b414dd90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7ff4b40688b0 tx=0x7ff4ac0092d0).stop 2021-01-27T09:51:44.147 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.128+0000 7ff4ba20f700 1 -- 172.21.15.146:0/1830704124 shutdown_connections 2021-01-27T09:51:44.147 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.128+0000 7ff4ba20f700 1 --2- 172.21.15.146:0/1830704124 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4b40bad40 0x7ff4b4151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:51:44.148 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.128+0000 7ff4ba20f700 1 --2- 172.21.15.146:0/1830704124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4b40bdff0 0x7ff4b414dd90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:44.148 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.128+0000 7ff4ba20f700 1 --2- 172.21.15.146:0/1830704124 >> v2:172.21.15.146:3300/0 conn(0x7ff4b40bdc10 0x7ff4b40b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:44.148 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.128+0000 7ff4ba20f700 1 -- 172.21.15.146:0/1830704124 >> 172.21.15.146:0/1830704124 conn(0x7ff4b4064dd0 msgr2=0x7ff4b40651e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:51:44.148 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.128+0000 7ff4ba20f700 1 -- 172.21.15.146:0/1830704124 shutdown_connections 2021-01-27T09:51:44.148 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.128+0000 7ff4ba20f700 1 -- 172.21.15.146:0/1830704124 wait complete. 2021-01-27T09:51:44.149 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.128+0000 7ff4ba20f700 1 Processor -- start 2021-01-27T09:51:44.149 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.128+0000 7ff4ba20f700 1 -- start start 2021-01-27T09:51:44.149 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.132+0000 7ff4ba20f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b40bad40 0x7ff4b4150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:44.150 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.132+0000 7ff4ba20f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4b40bdc10 0x7ff4b414d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:44.150 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.132+0000 7ff4ba20f700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4b40bdff0 0x7ff4b4150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:44.150 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.132+0000 7ff4ba20f700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b415ed20 con 0x7ff4b40bdff0 2021-01-27T09:51:44.150 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.132+0000 7ff4ba20f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b414c100 con 0x7ff4b40bad40 2021-01-27T09:51:44.150 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.132+0000 7ff4ba20f700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b415ef80 con 0x7ff4b40bdc10 2021-01-27T09:51:44.151 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.132+0000 7ff4b37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b40bad40 0x7ff4b4150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:44.151 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.132+0000 7ff4b37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b40bad40 0x7ff4b4150410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54256/0 (socket says 172.21.15.146:54256) 2021-01-27T09:51:44.151 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.132+0000 7ff4b37fe700 1 -- 172.21.15.146:0/1890476141 learned_addr learned my addr 172.21.15.146:0/1890476141 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:51:44.151 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.140+0000 7ff4b37fe700 1 -- 172.21.15.146:0/1890476141 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4b40bdc10 msgr2=0x7ff4b414d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:44.151 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.140+0000 7ff4b37fe700 1 --2- 172.21.15.146:0/1890476141 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4b40bdc10 0x7ff4b414d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:51:44.152 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.140+0000 7ff4b37fe700 1 -- 172.21.15.146:0/1890476141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4b40bdff0 msgr2=0x7ff4b4150bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-27T09:51:44.152 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.140+0000 7ff4b37fe700 1 --2- 172.21.15.146:0/1890476141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4b40bdff0 0x7ff4b4150bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:51:44.152 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.140+0000 7ff4b37fe700 1 -- 172.21.15.146:0/1890476141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b415f220 con 0x7ff4b40bad40 2021-01-27T09:51:44.152 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.140+0000 7ff4b37fe700 1 --2- 172.21.15.146:0/1890476141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b40bad40 0x7ff4b4150410 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7ff4a400ef20 tx=0x7ff4a4006e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:44.153 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.144+0000 7ff49b7fe700 1 -- 172.21.15.146:0/1890476141 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a400cbe0 con 0x7ff4b40bad40 2021-01-27T09:51:44.154 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.144+0000 7ff49b7fe700 1 -- 172.21.15.146:0/1890476141 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a400cd40 con 0x7ff4b40bad40 2021-01-27T09:51:44.154 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.144+0000 7ff49b7fe700 1 -- 172.21.15.146:0/1890476141 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4012600 con 0x7ff4b40bad40 2021-01-27T09:51:44.154 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.144+0000 7ff4ba20f700 1 -- 172.21.15.146:0/1890476141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b414e6f0 con 0x7ff4b40bad40 2021-01-27T09:51:44.154 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.144+0000 7ff4ba20f700 1 -- 172.21.15.146:0/1890476141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b414db30 con 0x7ff4b40bad40 2021-01-27T09:51:44.155 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.148+0000 7ff4ba20f700 1 -- 172.21.15.146:0/1890476141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b415f3b0 con 0x7ff4b40bad40 2021-01-27T09:51:44.162 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.156+0000 7ff49b7fe700 1 -- 172.21.15.146:0/1890476141 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7ff4a4012970 con 0x7ff4b40bad40 2021-01-27T09:51:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.156+0000 7ff49b7fe700 1 --2- 172.21.15.146:0/1890476141 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff4940561b0 0x7ff494058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.156+0000 7ff49b7fe700 1 -- 172.21.15.146:0/1890476141 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6997+0+0 (secure 0 0 0) 0x7ff4a40707e0 con 0x7ff4b40bad40 2021-01-27T09:51:44.164 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.156+0000 7ff49b7fe700 1 -- 172.21.15.146:0/1890476141 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7ff4a4045d50 con 0x7ff4b40bad40 2021-01-27T09:51:44.164 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.156+0000 7ff4b2ffd700 1 --2- 172.21.15.146:0/1890476141 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff4940561b0 0x7ff494058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:44.178 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.172+0000 7ff4b2ffd700 1 --2- 172.21.15.146:0/1890476141 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff4940561b0 0x7ff494058670 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7ff4b40688b0 tx=0x7ff4ac017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:44.497 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.492+0000 7ff4ba20f700 1 -- 172.21.15.146:0/1890476141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4b4044680 con 0x7ff4b40bad40 2021-01-27T09:51:44.498 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.492+0000 7ff49b7fe700 1 -- 172.21.15.146:0/1890476141 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3580 (secure 0 0 0) 0x7ff4a4049370 con 0x7ff4b40bad40 2021-01-27T09:51:44.498 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:51:44.498 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":5040,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6835/3537280353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3537280353},{"type":"v1","addr":"172.21.15.146:6835","nonce":3537280353}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":28}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:49:41.804473+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4971":{"gid":4971,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:51:44.500 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.492+0000 7ff4ba20f700 1 -- 172.21.15.146:0/1890476141 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff4940561b0 msgr2=0x7ff494058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:44.501 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.496+0000 7ff4ba20f700 1 --2- 172.21.15.146:0/1890476141 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff4940561b0 0x7ff494058670 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7ff4b40688b0 tx=0x7ff4ac017000).stop 2021-01-27T09:51:44.502 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.496+0000 7ff4ba20f700 1 -- 172.21.15.146:0/1890476141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b40bad40 msgr2=0x7ff4b4150410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:44.502 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.496+0000 7ff4ba20f700 1 --2- 172.21.15.146:0/1890476141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b40bad40 0x7ff4b4150410 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7ff4a400ef20 tx=0x7ff4a4006e20).stop 2021-01-27T09:51:44.503 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.496+0000 7ff4ba20f700 1 -- 172.21.15.146:0/1890476141 shutdown_connections 2021-01-27T09:51:44.503 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.496+0000 7ff4ba20f700 1 --2- 172.21.15.146:0/1890476141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4b40bdff0 0x7ff4b4150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:51:44.503 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.496+0000 7ff4ba20f700 1 --2- 172.21.15.146:0/1890476141 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4b40bdc10 0x7ff4b414d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:51:44.504 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.496+0000 7ff4ba20f700 1 --2- 172.21.15.146:0/1890476141 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff4940561b0 0x7ff494058670 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:44.504 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.496+0000 7ff4ba20f700 1 --2- 172.21.15.146:0/1890476141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b40bad40 0x7ff4b4150410 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:44.504 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.496+0000 7ff4ba20f700 1 -- 172.21.15.146:0/1890476141 >> 172.21.15.146:0/1890476141 conn(0x7ff4b4064dd0 msgr2=0x7ff4b414aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:51:44.504 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.496+0000 7ff4ba20f700 1 -- 172.21.15.146:0/1890476141 shutdown_connections 2021-01-27T09:51:44.505 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:44.496+0000 7ff4ba20f700 1 -- 172.21.15.146:0/1890476141 wait complete. 2021-01-27T09:51:44.505 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 29 2021-01-27T09:51:44.534 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-01-27T09:51:46.535 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:51:46.781 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.772+0000 7f16d759e700 1 Processor -- start 2021-01-27T09:51:46.782 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.772+0000 7f16d759e700 1 -- start start 2021-01-27T09:51:46.782 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.772+0000 7f16d759e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16d004f920 0x7f16d00e58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:46.782 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.772+0000 7f16d759e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f16d0050380 0x7f16d0033090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:46.783 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.772+0000 7f16d759e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d0032720 con 0x7f16d004fd00 2021-01-27T09:51:46.783 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.772+0000 7f16d759e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16d0035240 con 0x7f16d0050380 2021-01-27T09:51:46.783 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.772+0000 7f16d759e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00354e0 con 0x7f16d004f920 2021-01-27T09:51:46.784 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.776+0000 7f16d5d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f16d0050380 0x7f16d0033090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:46.784 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.776+0000 7f16d5d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f16d0050380 0x7f16d0033090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54310/0 (socket says 172.21.15.146:54310) 2021-01-27T09:51:46.784 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.776+0000 7f16d5d9b700 1 -- 172.21.15.146:0/572139183 learned_addr learned my addr 172.21.15.146:0/572139183 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:51:46.785 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.776+0000 7f16d659c700 1 --2- 172.21.15.146:0/572139183 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16d004f920 0x7f16d00e58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:46.786 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.776+0000 7f16d5d9b700 1 -- 172.21.15.146:0/572139183 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16d004f920 msgr2=0x7f16d00e58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:51:46.786 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.776+0000 7f16d5d9b700 1 --2- 172.21.15.146:0/572139183 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16d004f920 0x7f16d00e58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:46.786 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.776+0000 7f16d5d9b700 1 -- 172.21.15.146:0/572139183 >> v1:172.21.15.146:6789/0 conn(0x7f16d004fd00 legacy=0x7f16d00de980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:51:46.786 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.776+0000 7f16d5d9b700 1 -- 172.21.15.146:0/572139183 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d0035780 con 0x7f16d0050380 2021-01-27T09:51:46.786 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.776+0000 7f16d5d9b700 1 --2- 172.21.15.146:0/572139183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16d0050380 0x7f16d0033090 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f16c800ba20 tx=0x7f16c8006ee0).ready entity=mon.1 client_cookie=8b8b88dcbd60bfeb server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:46.787 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.780+0000 7f16d559a700 1 -- 172.21.15.146:0/572139183 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c8009890 con 0x7f16d0050380 2021-01-27T09:51:46.787 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.780+0000 7f16d559a700 1 -- 172.21.15.146:0/572139183 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c80099f0 con 0x7f16d0050380 2021-01-27T09:51:46.788 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.780+0000 7f16d559a700 1 -- 172.21.15.146:0/572139183 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c8009d70 con 0x7f16d0050380 2021-01-27T09:51:46.788 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.780+0000 7f16d759e700 1 -- 172.21.15.146:0/572139183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16d0050380 msgr2=0x7f16d0033090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:46.789 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.780+0000 7f16d759e700 1 --2- 172.21.15.146:0/572139183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16d0050380 0x7f16d0033090 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f16c800ba20 tx=0x7f16c8006ee0).stop 2021-01-27T09:51:46.789 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.780+0000 7f16d759e700 1 -- 172.21.15.146:0/572139183 shutdown_connections 2021-01-27T09:51:46.789 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.780+0000 7f16d759e700 1 --2- 172.21.15.146:0/572139183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16d0050380 0x7f16d0033090 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:46.789 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.780+0000 7f16d759e700 1 --2- 172.21.15.146:0/572139183 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16d004f920 0x7f16d00e58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:46.789 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.780+0000 7f16d759e700 1 -- 172.21.15.146:0/572139183 >> 172.21.15.146:0/572139183 conn(0x7f16d0006e60 msgr2=0x7f16d0007240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:51:46.790 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.780+0000 7f16d759e700 1 -- 172.21.15.146:0/572139183 shutdown_connections 2021-01-27T09:51:46.790 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.780+0000 7f16d759e700 1 -- 172.21.15.146:0/572139183 wait complete. 2021-01-27T09:51:46.790 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.784+0000 7f16d759e700 1 Processor -- start 2021-01-27T09:51:46.791 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.784+0000 7f16d759e700 1 -- start start 2021-01-27T09:51:46.793 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.788+0000 7f16d759e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16d004f920 0x7f16d00dd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:46.794 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.788+0000 7f16d759e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16d004fd00 0x7f16d004d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:46.794 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.788+0000 7f16d659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16d004f920 0x7f16d00dd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:46.795 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.788+0000 7f16d659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16d004f920 0x7f16d00dd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54316/0 (socket says 172.21.15.146:54316) 2021-01-27T09:51:46.795 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.788+0000 7f16d759e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16d0049bb0 0x7f16d00cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:46.795 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.788+0000 7f16d5d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16d004fd00 0x7f16d004d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:46.795 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.788+0000 7f16d5d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16d004fd00 0x7f16d004d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:57192/0 (socket says 172.21.15.146:57192) 2021-01-27T09:51:46.795 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.788+0000 7f16d759e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00cc3b0 con 0x7f16d004fd00 2021-01-27T09:51:46.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.788+0000 7f16d759e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d002b340 con 0x7f16d004f920 2021-01-27T09:51:46.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.788+0000 7f16d759e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00ce650 con 0x7f16d0049bb0 2021-01-27T09:51:46.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.788+0000 7f16d6d9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16d0049bb0 0x7f16d00cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:46.796 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.788+0000 7f16d6d9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16d0049bb0 0x7f16d00cca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:43806/0 (socket says 172.21.15.146:43806) 2021-01-27T09:51:46.797 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.788+0000 7f16d6d9d700 1 -- 172.21.15.146:0/597707730 learned_addr learned my addr 172.21.15.146:0/597707730 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:51:46.797 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.788+0000 7f16d6d9d700 1 -- 172.21.15.146:0/597707730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16d004f920 msgr2=0x7f16d00dd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:46.797 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.788+0000 7f16d6d9d700 1 --2- 172.21.15.146:0/597707730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16d004f920 0x7f16d00dd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:46.798 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.788+0000 7f16d6d9d700 1 -- 172.21.15.146:0/597707730 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16d004fd00 msgr2=0x7f16d004d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:46.798 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.788+0000 7f16d6d9d700 1 --2- 172.21.15.146:0/597707730 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16d004fd00 0x7f16d004d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:46.798 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.788+0000 7f16d6d9d700 1 -- 172.21.15.146:0/597707730 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d00ce8b0 con 0x7f16d0049bb0 2021-01-27T09:51:46.798 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.788+0000 7f16d6d9d700 1 --2- 172.21.15.146:0/597707730 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16d0049bb0 0x7f16d00cca40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f16d806f8b0 tx=0x7f16d805f7d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:46.829 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.820+0000 7f16c67fc700 1 -- 172.21.15.146:0/597707730 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8063d60 con 0x7f16d0049bb0 2021-01-27T09:51:46.829 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.820+0000 7f16c67fc700 1 -- 172.21.15.146:0/597707730 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d8063ec0 con 0x7f16d0049bb0 2021-01-27T09:51:46.829 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.820+0000 7f16d759e700 1 -- 172.21.15.146:0/597707730 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d00ceb50 con 0x7f16d0049bb0 2021-01-27T09:51:46.829 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.820+0000 7f16d759e700 1 -- 172.21.15.146:0/597707730 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d004bd80 con 0x7f16d0049bb0 2021-01-27T09:51:46.832 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.824+0000 7f16c67fc700 1 -- 172.21.15.146:0/597707730 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8062300 con 0x7f16d0049bb0 2021-01-27T09:51:46.833 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.824+0000 7f16c67fc700 1 -- 172.21.15.146:0/597707730 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f16d8090070 con 0x7f16d0049bb0 2021-01-27T09:51:46.834 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.828+0000 7f16c67fc700 1 --2- 172.21.15.146:0/597707730 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f16bc056230 0x7f16bc0586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:46.834 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.828+0000 7f16c67fc700 1 -- 172.21.15.146:0/597707730 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6997+0+0 (secure 0 0 0) 0x7f16d80df970 con 0x7f16d0049bb0 2021-01-27T09:51:46.834 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.828+0000 7f16d659c700 1 --2- 172.21.15.146:0/597707730 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f16bc056230 0x7f16bc0586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:46.835 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.828+0000 7f16d659c700 1 --2- 172.21.15.146:0/597707730 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f16bc056230 0x7f16bc0586f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f16cc00d9b0 tx=0x7f16cc008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:46.838 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.832+0000 7f16d759e700 1 -- 172.21.15.146:0/597707730 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b0004fa0 con 0x7f16d0049bb0 2021-01-27T09:51:46.845 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:46.840+0000 7f16c67fc700 1 -- 172.21.15.146:0/597707730 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f16d80b61d0 con 0x7f16d0049bb0 2021-01-27T09:51:47.267 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:47.260+0000 7f16d759e700 1 -- 172.21.15.146:0/597707730 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16b00057d0 con 0x7f16d0049bb0 2021-01-27T09:51:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:47.260+0000 7f16c67fc700 1 -- 172.21.15.146:0/597707730 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3580 (secure 0 0 0) 0x7f16d80b97f0 con 0x7f16d0049bb0 2021-01-27T09:51:47.272 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:51:47.273 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":5040,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.146:6835/3537280353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3537280353},{"type":"v1","addr":"172.21.15.146:6835","nonce":3537280353}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":28}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:49:41.804473+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4275,"mds_1":4287,"mds_2":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.78:6837/1117292103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":1117292103},{"type":"v1","addr":"172.21.15.78:6837","nonce":1117292103}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4971":{"gid":4971,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:51:47.277 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:47.272+0000 7f16d759e700 1 -- 172.21.15.146:0/597707730 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f16bc056230 msgr2=0x7f16bc0586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:47.277 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:47.272+0000 7f16d759e700 1 --2- 172.21.15.146:0/597707730 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f16bc056230 0x7f16bc0586f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f16cc00d9b0 tx=0x7f16cc008040).stop 2021-01-27T09:51:47.277 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:47.272+0000 7f16d759e700 1 -- 172.21.15.146:0/597707730 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16d0049bb0 msgr2=0x7f16d00cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:47.278 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:47.272+0000 7f16d759e700 1 --2- 172.21.15.146:0/597707730 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16d0049bb0 0x7f16d00cca40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f16d806f8b0 tx=0x7f16d805f7d0).stop 2021-01-27T09:51:47.279 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:47.272+0000 7f16d759e700 1 -- 172.21.15.146:0/597707730 shutdown_connections 2021-01-27T09:51:47.279 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:47.272+0000 7f16d759e700 1 --2- 172.21.15.146:0/597707730 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16d0049bb0 0x7f16d00cca40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:47.279 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:47.272+0000 7f16d759e700 1 --2- 172.21.15.146:0/597707730 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16d004fd00 0x7f16d004d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:47.279 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:47.272+0000 7f16d759e700 1 --2- 172.21.15.146:0/597707730 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f16bc056230 0x7f16bc0586f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:47.280 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:47.272+0000 7f16d759e700 1 --2- 172.21.15.146:0/597707730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16d004f920 0x7f16d00dd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:47.280 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:47.272+0000 7f16d759e700 1 -- 172.21.15.146:0/597707730 >> 172.21.15.146:0/597707730 conn(0x7f16d0006e60 msgr2=0x7f16d004c440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:51:47.281 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:47.272+0000 7f16d759e700 1 -- 172.21.15.146:0/597707730 shutdown_connections 2021-01-27T09:51:47.281 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:47.272+0000 7f16d759e700 1 -- 172.21.15.146:0/597707730 wait complete. 2021-01-27T09:51:47.289 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 29 2021-01-27T09:51:47.319 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2021-01-27T09:51:49.319 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:51:50.376 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.368+0000 7fc4cd428700 1 Processor -- start 2021-01-27T09:51:50.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.368+0000 7fc4cd428700 1 -- start start 2021-01-27T09:51:50.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.372+0000 7fc4cd428700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc4c80bf050 0x7fc4c80bf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:50.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.372+0000 7fc4cd428700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc4c8151cc0 0x7fc4c814b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:50.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.372+0000 7fc4cd428700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c8065e10 con 0x7fc4c814dc70 2021-01-27T09:51:50.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.372+0000 7fc4cd428700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c80c4b50 con 0x7fc4c80bf050 2021-01-27T09:51:50.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.372+0000 7fc4cd428700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c8152130 con 0x7fc4c8151cc0 2021-01-27T09:51:50.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.372+0000 7fc4ccc27700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc4c8151cc0 0x7fc4c814b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:50.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.372+0000 7fc4ccc27700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc4c8151cc0 0x7fc4c814b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:43884/0 (socket says 172.21.15.146:43884) 2021-01-27T09:51:50.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.372+0000 7fc4ccc27700 1 -- 172.21.15.146:0/726303464 learned_addr learned my addr 172.21.15.146:0/726303464 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:51:50.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.372+0000 7fc4c7fff700 1 --2- 172.21.15.146:0/726303464 >> v2:172.21.15.78:3300/0 conn(0x7fc4c80bf050 0x7fc4c80bf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:50.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.372+0000 7fc4c7fff700 1 -- 172.21.15.146:0/726303464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc4c8151cc0 msgr2=0x7fc4c814b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:51:50.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.372+0000 7fc4c7fff700 1 --2- 172.21.15.146:0/726303464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc4c8151cc0 0x7fc4c814b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:50.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.372+0000 7fc4c7fff700 1 -- 172.21.15.146:0/726303464 >> v1:172.21.15.146:6789/0 conn(0x7fc4c814dc70 legacy=0x7fc4c814ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:51:50.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.372+0000 7fc4c7fff700 1 -- 172.21.15.146:0/726303464 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c8066580 con 0x7fc4c80bf050 2021-01-27T09:51:50.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.372+0000 7fc4c7fff700 1 --2- 172.21.15.146:0/726303464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4c80bf050 0x7fc4c80bf430 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fc4c8061810 tx=0x7fc4b8006e20).ready entity=mon.0 client_cookie=bef5c48af6a0c23f server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:50.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.376+0000 7fc4c6ffd700 1 -- 172.21.15.146:0/726303464 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b80097f0 con 0x7fc4c80bf050 2021-01-27T09:51:50.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.376+0000 7fc4c6ffd700 1 -- 172.21.15.146:0/726303464 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b8009950 con 0x7fc4c80bf050 2021-01-27T09:51:50.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.376+0000 7fc4c6ffd700 1 -- 172.21.15.146:0/726303464 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8009cd0 con 0x7fc4c80bf050 2021-01-27T09:51:50.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.376+0000 7fc4cd428700 1 -- 172.21.15.146:0/726303464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4c80bf050 msgr2=0x7fc4c80bf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:50.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.376+0000 7fc4cd428700 1 --2- 172.21.15.146:0/726303464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4c80bf050 0x7fc4c80bf430 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fc4c8061810 tx=0x7fc4b8006e20).stop 2021-01-27T09:51:50.384 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.376+0000 7fc4cd428700 1 -- 172.21.15.146:0/726303464 shutdown_connections 2021-01-27T09:51:50.384 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.376+0000 7fc4cd428700 1 --2- 172.21.15.146:0/726303464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc4c8151cc0 0x7fc4c814b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:50.384 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.376+0000 7fc4cd428700 1 --2- 172.21.15.146:0/726303464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4c80bf050 0x7fc4c80bf430 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:50.384 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.376+0000 7fc4cd428700 1 -- 172.21.15.146:0/726303464 >> 172.21.15.146:0/726303464 conn(0x7fc4c8064f30 msgr2=0x7fc4c8065340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:51:50.385 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.376+0000 7fc4cd428700 1 -- 172.21.15.146:0/726303464 shutdown_connections 2021-01-27T09:51:50.385 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.376+0000 7fc4cd428700 1 -- 172.21.15.146:0/726303464 wait complete. 2021-01-27T09:51:50.386 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.380+0000 7fc4cd428700 1 Processor -- start 2021-01-27T09:51:50.386 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.380+0000 7fc4cd428700 1 -- start start 2021-01-27T09:51:50.387 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.380+0000 7fc4cd428700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4c80bf050 0x7fc4c8161220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:50.388 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.380+0000 7fc4cd428700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc4c814dc70 0x7fc4c80bbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:50.388 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.380+0000 7fc4cd428700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4c8151cc0 0x7fc4c80b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:50.389 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.380+0000 7fc4cd428700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c80b3040 con 0x7fc4c80bf050 2021-01-27T09:51:50.389 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.380+0000 7fc4c7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4c80bf050 0x7fc4c8161220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:50.389 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.380+0000 7fc4c7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4c80bf050 0x7fc4c8161220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:57278/0 (socket says 172.21.15.146:57278) 2021-01-27T09:51:50.389 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.380+0000 7fc4c7fff700 1 -- 172.21.15.146:0/1417924939 learned_addr learned my addr 172.21.15.146:0/1417924939 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:51:50.390 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.380+0000 7fc4ccc27700 1 --2- 172.21.15.146:0/1417924939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4c8151cc0 0x7fc4c80b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:50.390 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.384+0000 7fc4cd428700 1 -- 172.21.15.146:0/1417924939 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c80bd170 con 0x7fc4c8151cc0 2021-01-27T09:51:50.390 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.384+0000 7fc4c77fe700 1 --2- 172.21.15.146:0/1417924939 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc4c814dc70 0x7fc4c80bbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:50.391 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.384+0000 7fc4cd428700 1 -- 172.21.15.146:0/1417924939 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c80b3270 con 0x7fc4c814dc70 2021-01-27T09:51:50.391 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.384+0000 7fc4c7fff700 1 -- 172.21.15.146:0/1417924939 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc4c814dc70 msgr2=0x7fc4c80bbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:50.391 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.384+0000 7fc4c7fff700 1 --2- 172.21.15.146:0/1417924939 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc4c814dc70 0x7fc4c80bbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:50.392 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.384+0000 7fc4c7fff700 1 -- 172.21.15.146:0/1417924939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4c8151cc0 msgr2=0x7fc4c80b14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:50.392 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.384+0000 7fc4c7fff700 1 --2- 172.21.15.146:0/1417924939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4c8151cc0 0x7fc4c80b14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:50.392 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.384+0000 7fc4c7fff700 1 -- 172.21.15.146:0/1417924939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c80b3510 con 0x7fc4c80bf050 2021-01-27T09:51:50.392 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.384+0000 7fc4c7fff700 1 --2- 172.21.15.146:0/1417924939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4c80bf050 0x7fc4c8161220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fc4b8007fd0 tx=0x7fc4b8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:50.392 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.384+0000 7fc4affff700 1 -- 172.21.15.146:0/1417924939 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8011c20 con 0x7fc4c80bf050 2021-01-27T09:51:50.393 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.384+0000 7fc4affff700 1 -- 172.21.15.146:0/1417924939 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b8011d80 con 0x7fc4c80bf050 2021-01-27T09:51:50.393 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.384+0000 7fc4affff700 1 -- 172.21.15.146:0/1417924939 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b801c630 con 0x7fc4c80bf050 2021-01-27T09:51:50.393 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.384+0000 7fc4cd428700 1 -- 172.21.15.146:0/1417924939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c8160ae0 con 0x7fc4c80bf050 2021-01-27T09:51:50.394 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.384+0000 7fc4cd428700 1 -- 172.21.15.146:0/1417924939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c80b37b0 con 0x7fc4c80bf050 2021-01-27T09:51:50.394 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.388+0000 7fc4cd428700 1 -- 172.21.15.146:0/1417924939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c8044ee0 con 0x7fc4c80bf050 2021-01-27T09:51:50.395 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.388+0000 7fc4affff700 1 -- 172.21.15.146:0/1417924939 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fc4b800f070 con 0x7fc4c80bf050 2021-01-27T09:51:50.397 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.388+0000 7fc4affff700 1 --2- 172.21.15.146:0/1417924939 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc4a8056230 0x7fc4a80586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:50.397 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.388+0000 7fc4affff700 1 -- 172.21.15.146:0/1417924939 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7fc4b80717f0 con 0x7fc4c80bf050 2021-01-27T09:51:50.398 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.392+0000 7fc4c77fe700 1 --2- 172.21.15.146:0/1417924939 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc4a8056230 0x7fc4a80586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:50.398 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.392+0000 7fc4affff700 1 -- 172.21.15.146:0/1417924939 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fc4b8046d10 con 0x7fc4c80bf050 2021-01-27T09:51:50.401 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.396+0000 7fc4c77fe700 1 --2- 172.21.15.146:0/1417924939 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc4a8056230 0x7fc4a80586f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fc4c8063350 tx=0x7fc4bc008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.696+0000 7fc4cd428700 1 -- 172.21.15.146:0/1417924939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4c8044680 con 0x7fc4c80bf050 2021-01-27T09:51:50.703 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.696+0000 7fc4affff700 1 -- 172.21.15.146:0/1417924939 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+3228 (secure 0 0 0) 0x7fc4b804a330 con 0x7fc4c80bf050 2021-01-27T09:51:50.704 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:51:50.705 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:51:48.651304+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5040,"mds_1":4287,"mds_2":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4971":{"gid":4971,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_5040":{"gid":5040,"name":"a","rank":0,"incarnation":30,"state":"up:replay","state_seq":2,"addr":"172.21.15.146:6835/3537280353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3537280353},{"type":"v1","addr":"172.21.15.146:6835","nonce":3537280353}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:51:50.708 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.700+0000 7fc4adffb700 1 -- 172.21.15.146:0/1417924939 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc4a8056230 msgr2=0x7fc4a80586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:50.708 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.700+0000 7fc4adffb700 1 --2- 172.21.15.146:0/1417924939 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc4a8056230 0x7fc4a80586f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fc4c8063350 tx=0x7fc4bc008040).stop 2021-01-27T09:51:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.700+0000 7fc4adffb700 1 -- 172.21.15.146:0/1417924939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4c80bf050 msgr2=0x7fc4c8161220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.700+0000 7fc4adffb700 1 --2- 172.21.15.146:0/1417924939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4c80bf050 0x7fc4c8161220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fc4b8007fd0 tx=0x7fc4b8016000).stop 2021-01-27T09:51:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.700+0000 7fc4adffb700 1 -- 172.21.15.146:0/1417924939 shutdown_connections 2021-01-27T09:51:50.710 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.704+0000 7fc4adffb700 1 --2- 172.21.15.146:0/1417924939 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fc4a8056230 0x7fc4a80586f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:50.710 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.704+0000 7fc4adffb700 1 --2- 172.21.15.146:0/1417924939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4c8151cc0 0x7fc4c80b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:50.710 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.704+0000 7fc4adffb700 1 --2- 172.21.15.146:0/1417924939 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc4c814dc70 0x7fc4c80bbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:50.710 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.704+0000 7fc4adffb700 1 --2- 172.21.15.146:0/1417924939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4c80bf050 0x7fc4c8161220 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:50.710 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.704+0000 7fc4adffb700 1 -- 172.21.15.146:0/1417924939 >> 172.21.15.146:0/1417924939 conn(0x7fc4c8064f30 msgr2=0x7fc4c814b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:51:50.711 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.704+0000 7fc4adffb700 1 -- 172.21.15.146:0/1417924939 shutdown_connections 2021-01-27T09:51:50.711 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:50.704+0000 7fc4adffb700 1 -- 172.21.15.146:0/1417924939 wait complete. 2021-01-27T09:51:50.725 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 30 2021-01-27T09:51:50.751 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b down, removed from mdsmap 2021-01-27T09:51:50.751 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2021-01-27T09:51:50.752 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:51:51.045 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.032+0000 7fe25e097700 1 Processor -- start 2021-01-27T09:51:51.046 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.032+0000 7fe25e097700 1 -- start start 2021-01-27T09:51:51.046 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.032+0000 7fe25e097700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe258064f00 0x7fe2580bece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:51.046 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.032+0000 7fe25e097700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2580ae7f0 con 0x7fe2580652e0 2021-01-27T09:51:51.047 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.032+0000 7fe25e097700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2580aea90 con 0x7fe258069110 2021-01-27T09:51:51.047 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.032+0000 7fe25e097700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2580be110 con 0x7fe258064f00 2021-01-27T09:51:51.047 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.032+0000 7fe25d896700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe258069110 0x7fe2581650f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53992/0 (socket says 172.21.15.146:53992) 2021-01-27T09:51:51.047 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.032+0000 7fe25c894700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe2580652e0 0x7fe258080380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:42024/0 (socket says 172.21.15.146:42024) 2021-01-27T09:51:51.047 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.032+0000 7fe25d896700 1 -- 172.21.15.146:0/1425668876 learned_addr learned my addr 172.21.15.146:0/1425668876 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:51:51.048 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.036+0000 7fe25d095700 1 --2- 172.21.15.146:0/1425668876 >> v2:172.21.15.146:3300/0 conn(0x7fe258064f00 0x7fe2580bece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:51.048 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.036+0000 7fe25d095700 1 -- 172.21.15.146:0/1425668876 >> v1:172.21.15.146:6789/0 conn(0x7fe258069110 legacy=0x7fe2581650f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:51.048 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.036+0000 7fe25d095700 1 -- 172.21.15.146:0/1425668876 >> v1:172.21.15.78:6789/0 conn(0x7fe2580652e0 legacy=0x7fe258080380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:51.048 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.036+0000 7fe25d095700 1 -- 172.21.15.146:0/1425668876 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2580be300 con 0x7fe258064f00 2021-01-27T09:51:51.049 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.036+0000 7fe25d095700 1 --2- 172.21.15.146:0/1425668876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe258064f00 0x7fe2580bece0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fe248006a90 tx=0x7fe248006e20).ready entity=mon.1 client_cookie=3fac2520fec36326 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:51.054 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.044+0000 7fe24ffff700 1 -- 172.21.15.146:0/1425668876 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2480097b0 con 0x7fe258064f00 2021-01-27T09:51:51.055 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.044+0000 7fe24ffff700 1 -- 172.21.15.146:0/1425668876 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe248009910 con 0x7fe258064f00 2021-01-27T09:51:51.055 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.044+0000 7fe25e097700 1 -- 172.21.15.146:0/1425668876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe258064f00 msgr2=0x7fe2580bece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:51.055 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.044+0000 7fe25e097700 1 --2- 172.21.15.146:0/1425668876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe258064f00 0x7fe2580bece0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fe248006a90 tx=0x7fe248006e20).stop 2021-01-27T09:51:51.056 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.044+0000 7fe25e097700 1 -- 172.21.15.146:0/1425668876 shutdown_connections 2021-01-27T09:51:51.056 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.044+0000 7fe25e097700 1 --2- 172.21.15.146:0/1425668876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe258064f00 0x7fe2580bece0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:51.056 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.044+0000 7fe25e097700 1 -- 172.21.15.146:0/1425668876 >> 172.21.15.146:0/1425668876 conn(0x7fe258060a30 msgr2=0x7fe258065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:51:51.057 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.044+0000 7fe25e097700 1 -- 172.21.15.146:0/1425668876 shutdown_connections 2021-01-27T09:51:51.057 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.044+0000 7fe25e097700 1 -- 172.21.15.146:0/1425668876 wait complete. 2021-01-27T09:51:51.060 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.052+0000 7fe25e097700 1 Processor -- start 2021-01-27T09:51:51.061 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.052+0000 7fe25e097700 1 -- start start 2021-01-27T09:51:51.063 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.052+0000 7fe25e097700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2580652e0 0x7fe2580aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:51.063 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.052+0000 7fe25e097700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe258069110 0x7fe258158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:51.064 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.052+0000 7fe25e097700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe258156fa0 0x7fe25816d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:51.064 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.052+0000 7fe25e097700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2580bdbb0 con 0x7fe258156fa0 2021-01-27T09:51:51.064 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.052+0000 7fe25e097700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe258158d10 con 0x7fe2580652e0 2021-01-27T09:51:51.064 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.052+0000 7fe25e097700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2580bcdb0 con 0x7fe258069110 2021-01-27T09:51:51.065 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.052+0000 7fe25c894700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe258069110 0x7fe258158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:51.065 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.052+0000 7fe25d896700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe258156fa0 0x7fe25816d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:51.065 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.052+0000 7fe25c894700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe258069110 0x7fe258158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:43912/0 (socket says 172.21.15.146:43912) 2021-01-27T09:51:51.066 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.052+0000 7fe25c894700 1 -- 172.21.15.146:0/271860494 learned_addr learned my addr 172.21.15.146:0/271860494 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:51:51.066 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.052+0000 7fe25d095700 1 --2- 172.21.15.146:0/271860494 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2580652e0 0x7fe2580aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:51.066 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.052+0000 7fe25d896700 1 -- 172.21.15.146:0/271860494 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe258069110 msgr2=0x7fe258158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:51.066 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.052+0000 7fe25d896700 1 --2- 172.21.15.146:0/271860494 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe258069110 0x7fe258158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:51.066 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.052+0000 7fe25d896700 1 -- 172.21.15.146:0/271860494 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2580652e0 msgr2=0x7fe2580aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:51.067 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.052+0000 7fe25d896700 1 --2- 172.21.15.146:0/271860494 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2580652e0 0x7fe2580aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:51.067 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.052+0000 7fe25d896700 1 -- 172.21.15.146:0/271860494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2580bd050 con 0x7fe258156fa0 2021-01-27T09:51:51.067 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.052+0000 7fe25d896700 1 --2- 172.21.15.146:0/271860494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe258156fa0 0x7fe25816d970 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fe25400c530 tx=0x7fe254007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:51.067 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.056+0000 7fe24d7fa700 1 -- 172.21.15.146:0/271860494 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2540072e0 con 0x7fe258156fa0 2021-01-27T09:51:51.067 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.056+0000 7fe24d7fa700 1 -- 172.21.15.146:0/271860494 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe254007440 con 0x7fe258156fa0 2021-01-27T09:51:51.068 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.056+0000 7fe25e097700 1 -- 172.21.15.146:0/271860494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2580bd2f0 con 0x7fe258156fa0 2021-01-27T09:51:51.068 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.056+0000 7fe24d7fa700 1 -- 172.21.15.146:0/271860494 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe254005830 con 0x7fe258156fa0 2021-01-27T09:51:51.068 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.056+0000 7fe25e097700 1 -- 172.21.15.146:0/271860494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe258158240 con 0x7fe258156fa0 2021-01-27T09:51:51.068 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.056+0000 7fe25e097700 1 -- 172.21.15.146:0/271860494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2580be4e0 con 0x7fe258156fa0 2021-01-27T09:51:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.056+0000 7fe24d7fa700 1 -- 172.21.15.146:0/271860494 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fe25401a060 con 0x7fe258156fa0 2021-01-27T09:51:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.060+0000 7fe24d7fa700 1 --2- 172.21.15.146:0/271860494 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe23c0563e0 0x7fe23c0588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.060+0000 7fe24d7fa700 1 -- 172.21.15.146:0/271860494 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7fe25406ec30 con 0x7fe258156fa0 2021-01-27T09:51:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.064+0000 7fe25d095700 1 --2- 172.21.15.146:0/271860494 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe23c0563e0 0x7fe23c0588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:51.071 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.064+0000 7fe25d095700 1 --2- 172.21.15.146:0/271860494 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe23c0563e0 0x7fe23c0588a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fe258063d00 tx=0x7fe2580ae980).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:51.072 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.064+0000 7fe24d7fa700 1 -- 172.21.15.146:0/271860494 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fe254044260 con 0x7fe258156fa0 2021-01-27T09:51:51.417 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.412+0000 7fe25e097700 1 -- 172.21.15.146:0/271860494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe230004e30 con 0x7fe258156fa0 2021-01-27T09:51:51.418 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.412+0000 7fe24d7fa700 1 -- 172.21.15.146:0/271860494 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+3230 (secure 0 0 0) 0x7fe254018020 con 0x7fe258156fa0 2021-01-27T09:51:51.418 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:51:51.419 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:51:51.163057+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5040,"mds_1":4287,"mds_2":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4971":{"gid":4971,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_5040":{"gid":5040,"name":"a","rank":0,"incarnation":30,"state":"up:resolve","state_seq":37,"addr":"172.21.15.146:6835/3537280353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3537280353},{"type":"v1","addr":"172.21.15.146:6835","nonce":3537280353}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:51:51.421 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.416+0000 7fe25e097700 1 -- 172.21.15.146:0/271860494 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe23c0563e0 msgr2=0x7fe23c0588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:51.422 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.416+0000 7fe25e097700 1 --2- 172.21.15.146:0/271860494 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe23c0563e0 0x7fe23c0588a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fe258063d00 tx=0x7fe2580ae980).stop 2021-01-27T09:51:51.422 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.416+0000 7fe25e097700 1 -- 172.21.15.146:0/271860494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe258156fa0 msgr2=0x7fe25816d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:51.422 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.416+0000 7fe25e097700 1 --2- 172.21.15.146:0/271860494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe258156fa0 0x7fe25816d970 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fe25400c530 tx=0x7fe254007bb0).stop 2021-01-27T09:51:51.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.416+0000 7fe25e097700 1 -- 172.21.15.146:0/271860494 shutdown_connections 2021-01-27T09:51:51.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.416+0000 7fe25e097700 1 --2- 172.21.15.146:0/271860494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe258156fa0 0x7fe25816d970 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:51.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.416+0000 7fe25e097700 1 --2- 172.21.15.146:0/271860494 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe258069110 0x7fe258158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:51.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.416+0000 7fe25e097700 1 --2- 172.21.15.146:0/271860494 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe23c0563e0 0x7fe23c0588a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:51.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.416+0000 7fe25e097700 1 --2- 172.21.15.146:0/271860494 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2580652e0 0x7fe2580aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.416+0000 7fe25e097700 1 -- 172.21.15.146:0/271860494 >> 172.21.15.146:0/271860494 conn(0x7fe258060a30 msgr2=0x7fe258069900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:51:51.426 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.420+0000 7fe25e097700 1 -- 172.21.15.146:0/271860494 shutdown_connections 2021-01-27T09:51:51.433 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:51.428+0000 7fe25e097700 1 -- 172.21.15.146:0/271860494 wait complete. 2021-01-27T09:51:51.453 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 31 2021-01-27T09:51:51.473 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 31, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2021-01-27T09:44:29.315988+0000", "damaged": [], "data_pools": [ 4, 5 ], "enabled": true, "epoch": 31, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_4287": { "addr": "172.21.15.146:6834/2738812606", "addrs": { "addrvec": [ { "addr": "172.21.15.146:6832", "nonce": 2738812606, "type": "v2" }, { "addr": "172.21.15.146:6834", "nonce": 2738812606, "type": "v1" } ] }, "export_targets": [], "features": 4540138297136906239, "flags": 0, "gid": 4287, "incarnation": 10, "join_fscid": -1, "name": "c", "rank": 1, "state": "up:active", "state_seq": 8 }, "gid_4971": { "addr": "172.21.15.146:6837/3665040070", "addrs": { "addrvec": [ { "addr": "172.21.15.146:6836", "nonce": 3665040070, "type": "v2" }, { "addr": "172.21.15.146:6837", "nonce": 3665040070, "type": "v1" } ] }, "export_targets": [], "features": 4540138297136906239, "flags": 0, "gid": 4971, "incarnation": 22, "join_fscid": -1, "name": "e", "rank": 2, "state": "up:active", "state_seq": 36 }, "gid_5040": { "addr": "172.21.15.146:6835/3537280353", "addrs": { "addrvec": [ { "addr": "172.21.15.146:6833", "nonce": 3537280353, "type": "v2" }, { "addr": "172.21.15.146:6835", "nonce": 3537280353, "type": "v1" } ] }, "export_targets": [], "features": 4540138297136906239, "flags": 0, "gid": 5040, "incarnation": 30, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:resolve", "state_seq": 37 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 3, "metadata_pool": 3, "modified": "2021-01-27T09:51:51.163057+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5040, "mds_1": 4287, "mds_2": 4971 } } } ], "standbys": [ { "addr": "172.21.15.78:6835/2572346312", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6834", "nonce": 2572346312, "type": "v2" }, { "addr": "172.21.15.78:6835", "nonce": 2572346312, "type": "v1" } ] }, "epoch": 3, "export_targets": [], "features": 4540138297136906239, "flags": 0, "gid": 4223, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.78:6839/148943173", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6838", "nonce": 148943173, "type": "v2" }, { "addr": "172.21.15.78:6839", "nonce": 148943173, "type": "v1" } ] }, "epoch": 3, "export_targets": [], "features": 4540138297136906239, "flags": 0, "gid": 4232, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2021-01-27T09:51:53.475 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:51:53.678 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.672+0000 7fbf72040700 1 Processor -- start 2021-01-27T09:51:53.679 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.672+0000 7fbf72040700 1 -- start start 2021-01-27T09:51:53.684 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.672+0000 7fbf72040700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf6c0bd500 0x7fbf6c0bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:53.684 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.672+0000 7fbf72040700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6c066d80 con 0x7fbf6c0bd8e0 2021-01-27T09:51:53.685 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.672+0000 7fbf72040700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6c0678d0 con 0x7fbf6c14a7f0 2021-01-27T09:51:53.685 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.672+0000 7fbf72040700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c069530 con 0x7fbf6c0bd500 2021-01-27T09:51:53.685 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.676+0000 7fbf7183f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbf6c14a7f0 0x7fbf6c14ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54052/0 (socket says 172.21.15.146:54052) 2021-01-27T09:51:53.686 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.676+0000 7fbf7183f700 1 -- 172.21.15.146:0/2515956436 learned_addr learned my addr 172.21.15.146:0/2515956436 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:51:53.686 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.676+0000 7fbf5bfff700 1 -- 172.21.15.146:0/2515956436 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987879826 0 0) 0x7fbf68001110 con 0x7fbf6c14a7f0 2021-01-27T09:51:53.686 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.676+0000 7fbf5bfff700 1 -- 172.21.15.146:0/2515956436 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf54003270 con 0x7fbf6c14a7f0 2021-01-27T09:51:53.686 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.676+0000 7fbf5bfff700 1 -- 172.21.15.146:0/2515956436 <== mon.1 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3722198433 0 0) 0x7fbf54003270 con 0x7fbf6c14a7f0 2021-01-27T09:51:53.687 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.676+0000 7fbf5bfff700 1 -- 172.21.15.146:0/2515956436 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf6c0bd500 msgr2=0x7fbf6c0bcbc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:51:53.687 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.676+0000 7fbf5bfff700 1 --2- 172.21.15.146:0/2515956436 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf6c0bd500 0x7fbf6c0bcbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:51:53.690 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.676+0000 7fbf5bfff700 1 -- 172.21.15.146:0/2515956436 >> v1:172.21.15.78:6789/0 conn(0x7fbf6c0bd8e0 legacy=0x7fbf6c0671b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:51:53.690 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.676+0000 7fbf5bfff700 1 -- 172.21.15.146:0/2515956436 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6c0ae600 con 0x7fbf6c14a7f0 2021-01-27T09:51:53.690 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.676+0000 7fbf5bfff700 1 -- 172.21.15.146:0/2515956436 <== mon.1 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3890990827 0 0) 0x7fbf680016b0 con 0x7fbf6c14a7f0 2021-01-27T09:51:53.690 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.676+0000 7fbf5bfff700 1 -- 172.21.15.146:0/2515956436 >> v1:172.21.15.146:6789/0 conn(0x7fbf6c14a7f0 legacy=0x7fbf6c14ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:53.691 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.676+0000 7fbf5bfff700 1 --2- 172.21.15.146:0/2515956436 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf54003860 0x7fbf54003c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:53.691 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.676+0000 7fbf5bfff700 1 --2- 172.21.15.146:0/2515956436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf54004510 0x7fbf54004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:53.691 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.676+0000 7fbf5bfff700 1 --2- 172.21.15.146:0/2515956436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf54004e80 0x7fbf5400b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:53.691 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.676+0000 7fbf5bfff700 1 -- 172.21.15.146:0/2515956436 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c069530 con 0x7fbf54004e80 2021-01-27T09:51:53.692 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.676+0000 7fbf5bfff700 1 -- 172.21.15.146:0/2515956436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf54005300 con 0x7fbf54004510 2021-01-27T09:51:53.692 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.676+0000 7fbf5bfff700 1 -- 172.21.15.146:0/2515956436 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5400bc50 con 0x7fbf54003860 2021-01-27T09:51:53.692 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.676+0000 7fbf7183f700 1 --2- 172.21.15.146:0/2515956436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf54004e80 0x7fbf5400b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:53.693 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.676+0000 7fbf7083d700 1 --2- 172.21.15.146:0/2515956436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf54004510 0x7fbf54004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:53.693 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.680+0000 7fbf7183f700 1 -- 172.21.15.146:0/2515956436 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf54003860 msgr2=0x7fbf54003c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:51:53.694 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.680+0000 7fbf7103e700 1 --2- 172.21.15.146:0/2515956436 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf54003860 0x7fbf54003c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:53.694 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.680+0000 7fbf7183f700 1 --2- 172.21.15.146:0/2515956436 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf54003860 0x7fbf54003c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:53.694 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.680+0000 7fbf7183f700 1 -- 172.21.15.146:0/2515956436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf54004510 msgr2=0x7fbf54004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:51:53.695 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.680+0000 7fbf7183f700 1 --2- 172.21.15.146:0/2515956436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf54004510 0x7fbf54004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:53.695 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.680+0000 7fbf7183f700 1 -- 172.21.15.146:0/2515956436 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf54003270 con 0x7fbf54004e80 2021-01-27T09:51:53.695 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.680+0000 7fbf7083d700 1 --2- 172.21.15.146:0/2515956436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf54004510 0x7fbf54004990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:51:53.696 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.680+0000 7fbf7183f700 1 --2- 172.21.15.146:0/2515956436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf54004e80 0x7fbf5400b760 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fbf68005020 tx=0x7fbf6c0aede0).ready entity=mon.0 client_cookie=5a9a142708db2bce server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:53.696 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.680+0000 7fbf5bfff700 1 -- 172.21.15.146:0/2515956436 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf68008170 con 0x7fbf54004e80 2021-01-27T09:51:53.696 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.680+0000 7fbf5bfff700 1 -- 172.21.15.146:0/2515956436 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf680082d0 con 0x7fbf54004e80 2021-01-27T09:51:53.697 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.680+0000 7fbf5bfff700 1 -- 172.21.15.146:0/2515956436 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf68005620 con 0x7fbf54004e80 2021-01-27T09:51:53.699 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.680+0000 7fbf72040700 1 -- 172.21.15.146:0/2515956436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf54004e80 msgr2=0x7fbf5400b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:53.700 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.680+0000 7fbf72040700 1 --2- 172.21.15.146:0/2515956436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf54004e80 0x7fbf5400b760 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fbf68005020 tx=0x7fbf6c0aede0).stop 2021-01-27T09:51:53.700 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.680+0000 7fbf7183f700 1 -- 172.21.15.146:0/2515956436 reap_dead start 2021-01-27T09:51:53.700 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.680+0000 7fbf7103e700 1 --2- 172.21.15.146:0/2515956436 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf54003860 0x7fbf54003c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:51:53.701 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.688+0000 7fbf72040700 1 -- 172.21.15.146:0/2515956436 shutdown_connections 2021-01-27T09:51:53.702 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.688+0000 7fbf72040700 1 -- 172.21.15.146:0/2515956436 >> 172.21.15.146:0/2515956436 conn(0x7fbf6c060a30 msgr2=0x7fbf6c065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:51:53.702 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.688+0000 7fbf72040700 1 -- 172.21.15.146:0/2515956436 shutdown_connections 2021-01-27T09:51:53.702 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.688+0000 7fbf72040700 1 -- 172.21.15.146:0/2515956436 wait complete. 2021-01-27T09:51:53.703 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.692+0000 7fbf72040700 1 Processor -- start 2021-01-27T09:51:53.703 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.692+0000 7fbf72040700 1 -- start start 2021-01-27T09:51:53.704 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.692+0000 7fbf72040700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf6c14cf30 0x7fbf6c15dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:53.707 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.692+0000 7fbf72040700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf6c14d310 0x7fbf6c0baae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:53.708 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.692+0000 7fbf72040700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf6c150540 0x7fbf6c1538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:53.708 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.692+0000 7fbf72040700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c15e0e0 con 0x7fbf6c14cf30 2021-01-27T09:51:53.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.692+0000 7fbf72040700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c14f930 con 0x7fbf6c14d310 2021-01-27T09:51:53.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.692+0000 7fbf72040700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c0bafd0 con 0x7fbf6c150540 2021-01-27T09:51:53.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.692+0000 7fbf7183f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf6c150540 0x7fbf6c1538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:53.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.692+0000 7fbf7183f700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf6c150540 0x7fbf6c1538b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:43974/0 (socket says 172.21.15.146:43974) 2021-01-27T09:51:53.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.692+0000 7fbf7183f700 1 -- 172.21.15.146:0/4168774399 learned_addr learned my addr 172.21.15.146:0/4168774399 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:51:53.710 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.696+0000 7fbf7083d700 1 --2- 172.21.15.146:0/4168774399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf6c14d310 0x7fbf6c0baae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:53.710 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.696+0000 7fbf7183f700 1 -- 172.21.15.146:0/4168774399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf6c14d310 msgr2=0x7fbf6c0baae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:53.710 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.696+0000 7fbf7183f700 1 --2- 172.21.15.146:0/4168774399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf6c14d310 0x7fbf6c0baae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:53.710 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.696+0000 7fbf7183f700 1 -- 172.21.15.146:0/4168774399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf6c14cf30 msgr2=0x7fbf6c15dbf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-27T09:51:53.710 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.696+0000 7fbf7183f700 1 --2- 172.21.15.146:0/4168774399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf6c14cf30 0x7fbf6c15dbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:51:53.711 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.696+0000 7fbf7183f700 1 -- 172.21.15.146:0/4168774399 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6c1520a0 con 0x7fbf6c150540 2021-01-27T09:51:53.711 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.696+0000 7fbf7183f700 1 --2- 172.21.15.146:0/4168774399 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf6c150540 0x7fbf6c1538b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fbf68001eb0 tx=0x7fbf68016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:53.712 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.696+0000 7fbf597fa700 1 -- 172.21.15.146:0/4168774399 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf68005e70 con 0x7fbf6c150540 2021-01-27T09:51:53.712 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.700+0000 7fbf597fa700 1 -- 172.21.15.146:0/4168774399 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf680015f0 con 0x7fbf6c150540 2021-01-27T09:51:53.712 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.700+0000 7fbf72040700 1 -- 172.21.15.146:0/4168774399 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf6c152340 con 0x7fbf6c150540 2021-01-27T09:51:53.712 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.700+0000 7fbf597fa700 1 -- 172.21.15.146:0/4168774399 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6800d5f0 con 0x7fbf6c150540 2021-01-27T09:51:53.713 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.700+0000 7fbf72040700 1 -- 172.21.15.146:0/4168774399 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6c14fe00 con 0x7fbf6c150540 2021-01-27T09:51:53.713 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.704+0000 7fbf597fa700 1 -- 172.21.15.146:0/4168774399 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fbf68011030 con 0x7fbf6c150540 2021-01-27T09:51:53.716 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.708+0000 7fbf72040700 1 -- 172.21.15.146:0/4168774399 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf6c044680 con 0x7fbf6c150540 2021-01-27T09:51:53.717 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.712+0000 7fbf597fa700 1 --2- 172.21.15.146:0/4168774399 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbf4c056230 0x7fbf4c0586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:53.717 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.712+0000 7fbf7103e700 1 --2- 172.21.15.146:0/4168774399 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbf4c056230 0x7fbf4c0586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:53.718 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.712+0000 7fbf597fa700 1 -- 172.21.15.146:0/4168774399 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7fbf68070690 con 0x7fbf6c150540 2021-01-27T09:51:53.718 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.712+0000 7fbf7103e700 1 --2- 172.21.15.146:0/4168774399 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbf4c056230 0x7fbf4c0586f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fbf6c0bfee0 tx=0x7fbf5c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:53.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:53.716+0000 7fbf597fa700 1 -- 172.21.15.146:0/4168774399 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fbf68045bb0 con 0x7fbf6c150540 2021-01-27T09:51:54.095 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:54.088+0000 7fbf72040700 1 -- 172.21.15.146:0/4168774399 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf6c0678d0 con 0x7fbf6c150540 2021-01-27T09:51:54.098 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:54.092+0000 7fbf597fa700 1 -- 172.21.15.146:0/4168774399 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+3232 (secure 0 0 0) 0x7fbf6c0678d0 con 0x7fbf6c150540 2021-01-27T09:51:54.101 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:51:54.101 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:51:52.170172+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5040,"mds_1":4287,"mds_2":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4971":{"gid":4971,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_5040":{"gid":5040,"name":"a","rank":0,"incarnation":30,"state":"up:reconnect","state_seq":38,"addr":"172.21.15.146:6835/3537280353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3537280353},{"type":"v1","addr":"172.21.15.146:6835","nonce":3537280353}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:51:54.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:54.100+0000 7fbf72040700 1 -- 172.21.15.146:0/4168774399 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbf4c056230 msgr2=0x7fbf4c0586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:54.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:54.100+0000 7fbf72040700 1 --2- 172.21.15.146:0/4168774399 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbf4c056230 0x7fbf4c0586f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fbf6c0bfee0 tx=0x7fbf5c008040).stop 2021-01-27T09:51:54.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:54.100+0000 7fbf72040700 1 -- 172.21.15.146:0/4168774399 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf6c150540 msgr2=0x7fbf6c1538b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:54.106 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:54.100+0000 7fbf72040700 1 --2- 172.21.15.146:0/4168774399 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf6c150540 0x7fbf6c1538b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fbf68001eb0 tx=0x7fbf68016000).stop 2021-01-27T09:51:54.108 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:54.100+0000 7fbf72040700 1 -- 172.21.15.146:0/4168774399 shutdown_connections 2021-01-27T09:51:54.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:54.100+0000 7fbf72040700 1 --2- 172.21.15.146:0/4168774399 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf6c150540 0x7fbf6c1538b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:54.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:54.100+0000 7fbf72040700 1 --2- 172.21.15.146:0/4168774399 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbf4c056230 0x7fbf4c0586f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:54.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:54.100+0000 7fbf72040700 1 --2- 172.21.15.146:0/4168774399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf6c14d310 0x7fbf6c0baae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:54.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:54.100+0000 7fbf72040700 1 --2- 172.21.15.146:0/4168774399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf6c14cf30 0x7fbf6c15dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:51:54.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:54.100+0000 7fbf72040700 1 -- 172.21.15.146:0/4168774399 >> 172.21.15.146:0/4168774399 conn(0x7fbf6c060a30 msgr2=0x7fbf6c1446e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:51:54.112 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:54.104+0000 7fbf72040700 1 -- 172.21.15.146:0/4168774399 shutdown_connections 2021-01-27T09:51:54.112 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:54.104+0000 7fbf72040700 1 -- 172.21.15.146:0/4168774399 wait complete. 2021-01-27T09:51:54.117 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 32 2021-01-27T09:51:54.143 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2021-01-27T09:51:56.144 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:51:56.406 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.403+0000 7f03780bb700 1 Processor -- start 2021-01-27T09:51:56.406 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.403+0000 7f03780bb700 1 -- start start 2021-01-27T09:51:56.407 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.403+0000 7f03780bb700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0370068380 0x7f0370066560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:56.408 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.403+0000 7f03780bb700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03700be1e0 con 0x7f03700bd820 2021-01-27T09:51:56.408 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.403+0000 7f03780bb700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0370153220 con 0x7f0370067fa0 2021-01-27T09:51:56.408 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.403+0000 7f03780bb700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0370152ce0 con 0x7f0370068380 2021-01-27T09:51:56.408 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.403+0000 7f0375e57700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0370067fa0 0x7f03701522c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54126/0 (socket says 172.21.15.146:54126) 2021-01-27T09:51:56.409 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.403+0000 7f0375e57700 1 -- 172.21.15.146:0/2675679806 learned_addr learned my addr 172.21.15.146:0/2675679806 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:51:56.410 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.403+0000 7f0375656700 1 --2- 172.21.15.146:0/2675679806 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0370068380 0x7f0370066560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:56.410 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.403+0000 7f0375656700 1 -- 172.21.15.146:0/2675679806 >> v1:172.21.15.146:6789/0 conn(0x7f0370067fa0 legacy=0x7f03701522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:56.410 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.403+0000 7f0375656700 1 -- 172.21.15.146:0/2675679806 >> v1:172.21.15.78:6789/0 conn(0x7f03700bd820 legacy=0x7f037014f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:56.410 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.403+0000 7f0375656700 1 -- 172.21.15.146:0/2675679806 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0370152f80 con 0x7f0370068380 2021-01-27T09:51:56.411 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.403+0000 7f0375656700 1 --2- 172.21.15.146:0/2675679806 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0370068380 0x7f0370066560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f0368009cf0 tx=0x7f0368009220).ready entity=mon.2 client_cookie=7f8291d4ac5ff19c server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:56.411 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.407+0000 7f0374e55700 1 -- 172.21.15.146:0/2675679806 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036800baf0 con 0x7f0370068380 2021-01-27T09:51:56.411 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.407+0000 7f0374e55700 1 -- 172.21.15.146:0/2675679806 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036800bc50 con 0x7f0370068380 2021-01-27T09:51:56.412 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.407+0000 7f03780bb700 1 -- 172.21.15.146:0/2675679806 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0370068380 msgr2=0x7f0370066560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:56.412 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.407+0000 7f03780bb700 1 --2- 172.21.15.146:0/2675679806 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0370068380 0x7f0370066560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f0368009cf0 tx=0x7f0368009220).stop 2021-01-27T09:51:56.413 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.407+0000 7f03780bb700 1 -- 172.21.15.146:0/2675679806 shutdown_connections 2021-01-27T09:51:56.413 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.407+0000 7f03780bb700 1 --2- 172.21.15.146:0/2675679806 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0370068380 0x7f0370066560 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0x7f0368009cf0 tx=0x7f0368009220).stop 2021-01-27T09:51:56.413 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.407+0000 7f03780bb700 1 -- 172.21.15.146:0/2675679806 >> 172.21.15.146:0/2675679806 conn(0x7f03700609f0 msgr2=0x7f0370069110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:51:56.415 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.411+0000 7f03780bb700 1 -- 172.21.15.146:0/2675679806 shutdown_connections 2021-01-27T09:51:56.419 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.415+0000 7f03780bb700 1 -- 172.21.15.146:0/2675679806 wait complete. 2021-01-27T09:51:56.420 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.415+0000 7f03780bb700 1 Processor -- start 2021-01-27T09:51:56.421 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.415+0000 7f03780bb700 1 -- start start 2021-01-27T09:51:56.421 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.419+0000 7f03780bb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0370067fa0 0x7f0370162790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:56.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.419+0000 7f03780bb700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f03700bd820 0x7f0370151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:56.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.419+0000 7f03780bb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0370148f10 0x7f0370165920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:56.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.419+0000 7f03780bb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0370162c80 con 0x7f0370067fa0 2021-01-27T09:51:56.424 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.419+0000 7f03780bb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0370151b60 con 0x7f0370148f10 2021-01-27T09:51:56.424 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.419+0000 7f03780bb700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03700ad760 con 0x7f03700bd820 2021-01-27T09:51:56.425 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.419+0000 7f0375e57700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0370067fa0 0x7f0370162790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:56.425 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.419+0000 7f0375e57700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0370067fa0 0x7f0370162790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:57436/0 (socket says 172.21.15.146:57436) 2021-01-27T09:51:56.425 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.419+0000 7f0375e57700 1 -- 172.21.15.146:0/3514481628 learned_addr learned my addr 172.21.15.146:0/3514481628 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:51:56.425 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.419+0000 7f0375656700 1 --2- 172.21.15.146:0/3514481628 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f03700bd820 0x7f0370151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:56.426 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.419+0000 7f0375e57700 1 -- 172.21.15.146:0/3514481628 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f03700bd820 msgr2=0x7f0370151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:56.426 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.419+0000 7f0375e57700 1 --2- 172.21.15.146:0/3514481628 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f03700bd820 0x7f0370151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:56.426 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.419+0000 7f0375e57700 1 -- 172.21.15.146:0/3514481628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0370148f10 msgr2=0x7f0370165920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:56.426 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.419+0000 7f0375e57700 1 --2- 172.21.15.146:0/3514481628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0370148f10 0x7f0370165920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:51:56.427 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.419+0000 7f0375e57700 1 -- 172.21.15.146:0/3514481628 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03700ada00 con 0x7f0370067fa0 2021-01-27T09:51:56.427 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.419+0000 7f0375656700 1 --2- 172.21.15.146:0/3514481628 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f03700bd820 0x7f0370151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:51:56.428 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.419+0000 7f0375e57700 1 --2- 172.21.15.146:0/3514481628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0370067fa0 0x7f0370162790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f036c00c730 tx=0x7f036c007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:56.428 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.419+0000 7f0365ffb700 1 -- 172.21.15.146:0/3514481628 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c007320 con 0x7f0370067fa0 2021-01-27T09:51:56.428 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.419+0000 7f0365ffb700 1 -- 172.21.15.146:0/3514481628 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c007480 con 0x7f0370067fa0 2021-01-27T09:51:56.428 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.419+0000 7f03780bb700 1 -- 172.21.15.146:0/3514481628 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03700adca0 con 0x7f0370067fa0 2021-01-27T09:51:56.429 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.419+0000 7f0365ffb700 1 -- 172.21.15.146:0/3514481628 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c005830 con 0x7f0370067fa0 2021-01-27T09:51:56.429 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.419+0000 7f03780bb700 1 -- 172.21.15.146:0/3514481628 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037014a2b0 con 0x7f0370067fa0 2021-01-27T09:51:56.430 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.423+0000 7f03780bb700 1 -- 172.21.15.146:0/3514481628 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0348004fa0 con 0x7f0370067fa0 2021-01-27T09:51:56.430 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.423+0000 7f0365ffb700 1 -- 172.21.15.146:0/3514481628 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f036c010030 con 0x7f0370067fa0 2021-01-27T09:51:56.430 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.427+0000 7f0365ffb700 1 --2- 172.21.15.146:0/3514481628 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f03540563e0 0x7f03540588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:51:56.430 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.427+0000 7f0365ffb700 1 -- 172.21.15.146:0/3514481628 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7f036c06f4b0 con 0x7f0370067fa0 2021-01-27T09:51:56.431 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.427+0000 7f0375656700 1 --2- 172.21.15.146:0/3514481628 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f03540563e0 0x7f03540588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:51:56.431 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.427+0000 7f0375656700 1 --2- 172.21.15.146:0/3514481628 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f03540563e0 0x7f03540588a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f03700687d0 tx=0x7f03700b8d00).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:51:56.436 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.431+0000 7f0365ffb700 1 -- 172.21.15.146:0/3514481628 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f036c044950 con 0x7f0370067fa0 2021-01-27T09:51:56.695 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.691+0000 7f03780bb700 1 -- 172.21.15.146:0/3514481628 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03480057d0 con 0x7f0370067fa0 2021-01-27T09:51:56.696 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.691+0000 7f0365ffb700 1 -- 172.21.15.146:0/3514481628 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+3229 (secure 0 0 0) 0x7f036c047f70 con 0x7f0370067fa0 2021-01-27T09:51:56.697 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:51:56.697 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:51:56.674359+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5040,"mds_1":4287,"mds_2":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4971":{"gid":4971,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_5040":{"gid":5040,"name":"a","rank":0,"incarnation":30,"state":"up:rejoin","state_seq":40,"addr":"172.21.15.146:6835/3537280353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3537280353},{"type":"v1","addr":"172.21.15.146:6835","nonce":3537280353}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:51:56.707 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.703+0000 7f035b7fe700 1 -- 172.21.15.146:0/3514481628 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f03540563e0 msgr2=0x7f03540588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:56.707 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.703+0000 7f035b7fe700 1 --2- 172.21.15.146:0/3514481628 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f03540563e0 0x7f03540588a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f03700687d0 tx=0x7f03700b8d00).stop 2021-01-27T09:51:56.708 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.703+0000 7f035b7fe700 1 -- 172.21.15.146:0/3514481628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0370067fa0 msgr2=0x7f0370162790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:51:56.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.703+0000 7f035b7fe700 1 --2- 172.21.15.146:0/3514481628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0370067fa0 0x7f0370162790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f036c00c730 tx=0x7f036c007c20).stop 2021-01-27T09:51:56.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.703+0000 7f035b7fe700 1 -- 172.21.15.146:0/3514481628 shutdown_connections 2021-01-27T09:51:56.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.703+0000 7f035b7fe700 1 --2- 172.21.15.146:0/3514481628 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f03540563e0 0x7f03540588a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:56.709 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.703+0000 7f035b7fe700 1 --2- 172.21.15.146:0/3514481628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0370148f10 0x7f0370165920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:51:56.710 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.703+0000 7f035b7fe700 1 --2- 172.21.15.146:0/3514481628 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f03700bd820 0x7f0370151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:56.710 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.703+0000 7f035b7fe700 1 --2- 172.21.15.146:0/3514481628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0370067fa0 0x7f0370162790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:51:56.710 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.707+0000 7f035b7fe700 1 -- 172.21.15.146:0/3514481628 >> 172.21.15.146:0/3514481628 conn(0x7f03700609f0 msgr2=0x7f037014c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:51:56.711 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.707+0000 7f035b7fe700 1 -- 172.21.15.146:0/3514481628 shutdown_connections 2021-01-27T09:51:56.711 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:56.707+0000 7f035b7fe700 1 -- 172.21.15.146:0/3514481628 wait complete. 2021-01-27T09:51:56.711 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 33 2021-01-27T09:51:56.735 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2021-01-27T09:51:58.736 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:52:01.774 INFO:tasks.ceph.mds.a.smithi146.stderr:2021-01-27T09:52:01.771+0000 7f1f9b57f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2021-01-27T09:52:01.774 INFO:tasks.ceph.mds.a.smithi146.stderr:2021-01-27T09:52:01.771+0000 7f1f9b57f700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2021-01-27T09:52:01.775 INFO:tasks.ceph.mds.a.smithi146.stderr:2021-01-27T09:52:01.771+0000 7f1f9b57f700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2021-01-27T09:52:02.112 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:59.011+0000 7f79d0046700 1 Processor -- start 2021-01-27T09:52:02.112 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:59.011+0000 7f79d0046700 1 -- start start 2021-01-27T09:52:02.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:59.011+0000 7f79d0046700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79c8067e00 0x7f79c80681e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:02.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:59.011+0000 7f79d0046700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f79c80b7750 0x7f79c80b8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:02.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:59.011+0000 7f79d0046700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c8064360 con 0x7f79c80b92d0 2021-01-27T09:52:02.114 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:59.011+0000 7f79d0046700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c8064600 con 0x7f79c80b7750 2021-01-27T09:52:02.114 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:59.011+0000 7f79d0046700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c80648a0 con 0x7f79c8067e00 2021-01-27T09:52:02.115 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:59.011+0000 7f79ce5e3700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f79c80b92d0 0x7f79c815e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:42246/0 (socket says 172.21.15.146:42246) 2021-01-27T09:52:02.115 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:59.011+0000 7f79ce5e3700 1 -- 172.21.15.146:0/3765641692 learned_addr learned my addr 172.21.15.146:0/3765641692 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:52:02.115 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:59.015+0000 7f79ccde0700 1 -- 172.21.15.146:0/3765641692 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3666196875 0 0) 0x7f79c8064360 con 0x7f79c80b92d0 2021-01-27T09:52:02.116 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:59.015+0000 7f79ccde0700 1 -- 172.21.15.146:0/3765641692 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79b4003270 con 0x7f79c80b92d0 2021-01-27T09:52:02.116 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:59.015+0000 7f79cdde2700 1 --2- 172.21.15.146:0/3765641692 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79c8067e00 0x7f79c80681e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:02.117 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:59.015+0000 7f79cd5e1700 1 --2- 172.21.15.146:0/3765641692 >> v2:172.21.15.146:3300/0 conn(0x7f79c80b7750 0x7f79c80b8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:02.117 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:51:59.019+0000 7f79ccde0700 1 -- 172.21.15.146:0/3765641692 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2710674263 0 0) 0x7f79b4003270 con 0x7f79c80b92d0 2021-01-27T09:52:02.117 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.107+0000 7f79bf7fe700 1 -- 172.21.15.146:0/3765641692 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79c8067e00 msgr2=0x7f79c80681e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:52:02.118 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.107+0000 7f79bf7fe700 1 --2- 172.21.15.146:0/3765641692 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79c8067e00 0x7f79c80681e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:02.118 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.107+0000 7f79bf7fe700 1 -- 172.21.15.146:0/3765641692 >> v2:172.21.15.146:3300/0 conn(0x7f79c80b7750 msgr2=0x7f79c80b8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:52:02.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.107+0000 7f79bf7fe700 1 --2- 172.21.15.146:0/3765641692 >> v2:172.21.15.146:3300/0 conn(0x7f79c80b7750 0x7f79c80b8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:02.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.107+0000 7f79bf7fe700 1 -- 172.21.15.146:0/3765641692 >> v1:172.21.15.78:6789/0 conn(0x7f79c80b92d0 legacy=0x7f79c815e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:02.119 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.107+0000 7f79bf7fe700 1 --2- 172.21.15.146:0/3765641692 >> v2:172.21.15.78:3300/0 conn(0x7f79ac00b7c0 0x7f79ac00dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:02.120 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.107+0000 7f79bf7fe700 1 -- 172.21.15.146:0/3765641692 --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c80b9950 con 0x7f79ac0033a0 2021-01-27T09:52:02.120 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.107+0000 7f79bf7fe700 1 -- 172.21.15.146:0/3765641692 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c8064600 con 0x7f79ac00b7c0 2021-01-27T09:52:02.121 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.107+0000 7f79cd5e1700 1 --2- 172.21.15.146:0/3765641692 >> v2:172.21.15.146:3300/0 conn(0x7f79c80b7750 0x7f79c80b8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:52:02.121 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.107+0000 7f79cd5e1700 1 --2- 172.21.15.146:0/3765641692 >> v2:172.21.15.78:3300/0 conn(0x7f79ac00b7c0 0x7f79ac00dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:02.123 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.115+0000 7f79ccde0700 1 -- 172.21.15.146:0/3765641692 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834702962 0 0) 0x7f79c80b9950 con 0x7f79ac0033a0 2021-01-27T09:52:02.123 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.119+0000 7f79ccde0700 1 -- 172.21.15.146:0/3765641692 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79b4003270 con 0x7f79ac0033a0 2021-01-27T09:52:02.124 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.119+0000 7f79cd5e1700 1 -- 172.21.15.146:0/3765641692 >> v1:172.21.15.146:6789/0 conn(0x7f79ac0033a0 legacy=0x7f79ac003810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:02.124 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.119+0000 7f79cd5e1700 1 -- 172.21.15.146:0/3765641692 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac005400 con 0x7f79ac00b7c0 2021-01-27T09:52:02.124 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.119+0000 7f79cd5e1700 1 --2- 172.21.15.146:0/3765641692 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79ac00b7c0 0x7f79ac00dbb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f79c8080fa0 tx=0x7f79c0008040).ready entity=mon.0 client_cookie=89fce8b3ce317778 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:52:02.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.119+0000 7f79ccde0700 1 -- 172.21.15.146:0/3765641692 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c000cc20 con 0x7f79ac00b7c0 2021-01-27T09:52:02.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.119+0000 7f79ccde0700 1 -- 172.21.15.146:0/3765641692 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c000cd80 con 0x7f79ac00b7c0 2021-01-27T09:52:02.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.119+0000 7f79ccde0700 1 -- 172.21.15.146:0/3765641692 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c0012680 con 0x7f79ac00b7c0 2021-01-27T09:52:02.127 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.119+0000 7f79d0046700 1 -- 172.21.15.146:0/3765641692 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79ac00b7c0 msgr2=0x7f79ac00dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:02.127 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.119+0000 7f79d0046700 1 --2- 172.21.15.146:0/3765641692 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79ac00b7c0 0x7f79ac00dbb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f79c8080fa0 tx=0x7f79c0008040).stop 2021-01-27T09:52:02.128 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.119+0000 7f79ce5e3700 1 -- 172.21.15.146:0/3765641692 reap_dead start 2021-01-27T09:52:02.128 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.119+0000 7f79d0046700 1 -- 172.21.15.146:0/3765641692 shutdown_connections 2021-01-27T09:52:02.128 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.119+0000 7f79d0046700 1 --2- 172.21.15.146:0/3765641692 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79ac00b7c0 0x7f79ac00dbb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:02.129 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.119+0000 7f79d0046700 1 -- 172.21.15.146:0/3765641692 >> 172.21.15.146:0/3765641692 conn(0x7f79c80609f0 msgr2=0x7f79c8069110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:52:02.129 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.119+0000 7f79d0046700 1 -- 172.21.15.146:0/3765641692 shutdown_connections 2021-01-27T09:52:02.132 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.119+0000 7f79d0046700 1 -- 172.21.15.146:0/3765641692 wait complete. 2021-01-27T09:52:02.132 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.123+0000 7f79d0046700 1 Processor -- start 2021-01-27T09:52:02.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.123+0000 7f79d0046700 1 -- start start 2021-01-27T09:52:02.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.123+0000 7f79d0046700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79ac00b7c0 0x7f79c815a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:02.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.127+0000 7f79d0046700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79c80b1800 0x7f79c80b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:02.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.127+0000 7f79cdde2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79ac00b7c0 0x7f79c815a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:02.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.127+0000 7f79cdde2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79ac00b7c0 0x7f79c815a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:44184/0 (socket says 172.21.15.146:44184) 2021-01-27T09:52:02.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.127+0000 7f79cdde2700 1 -- 172.21.15.146:0/6988417 learned_addr learned my addr 172.21.15.146:0/6988417 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:52:02.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.127+0000 7f79d0046700 1 --2- 172.21.15.146:0/6988417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79c817b0e0 0x7f79c817b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:02.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.127+0000 7f79d0046700 1 -- 172.21.15.146:0/6988417 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c817ba60 con 0x7f79c80b1800 2021-01-27T09:52:02.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.127+0000 7f79d0046700 1 -- 172.21.15.146:0/6988417 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c80ae750 con 0x7f79c817b0e0 2021-01-27T09:52:02.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.127+0000 7f79d0046700 1 -- 172.21.15.146:0/6988417 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c80ae9f0 con 0x7f79ac00b7c0 2021-01-27T09:52:02.137 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.127+0000 7f79cd5e1700 1 --2- 172.21.15.146:0/6988417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79c80b1800 0x7f79c80b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:02.137 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.127+0000 7f79ce5e3700 1 --2- 172.21.15.146:0/6988417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79c817b0e0 0x7f79c817b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:02.138 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.127+0000 7f79cdde2700 1 -- 172.21.15.146:0/6988417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79c817b0e0 msgr2=0x7f79c817b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:02.138 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.127+0000 7f79cdde2700 1 --2- 172.21.15.146:0/6988417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79c817b0e0 0x7f79c817b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:02.138 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.127+0000 7f79cdde2700 1 -- 172.21.15.146:0/6988417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79c80b1800 msgr2=0x7f79c80b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:02.139 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.127+0000 7f79cdde2700 1 --2- 172.21.15.146:0/6988417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79c80b1800 0x7f79c80b1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:02.139 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.127+0000 7f79cdde2700 1 -- 172.21.15.146:0/6988417 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c80aec90 con 0x7f79ac00b7c0 2021-01-27T09:52:02.140 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.127+0000 7f79cdde2700 1 --2- 172.21.15.146:0/6988417 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79ac00b7c0 0x7f79c815a8e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f79c4006c00 tx=0x7f79c400a2e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:52:02.140 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.127+0000 7f79bdffb700 1 -- 172.21.15.146:0/6988417 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c40098d0 con 0x7f79ac00b7c0 2021-01-27T09:52:02.140 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.127+0000 7f79bdffb700 1 -- 172.21.15.146:0/6988417 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c4009a30 con 0x7f79ac00b7c0 2021-01-27T09:52:02.141 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.127+0000 7f79d0046700 1 -- 172.21.15.146:0/6988417 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c80aef30 con 0x7f79ac00b7c0 2021-01-27T09:52:02.141 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.127+0000 7f79bdffb700 1 -- 172.21.15.146:0/6988417 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c4009df0 con 0x7f79ac00b7c0 2021-01-27T09:52:02.142 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.127+0000 7f79d0046700 1 -- 172.21.15.146:0/6988417 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c817ac40 con 0x7f79ac00b7c0 2021-01-27T09:52:02.143 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.127+0000 7f79d0046700 1 -- 172.21.15.146:0/6988417 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c8044ee0 con 0x7f79ac00b7c0 2021-01-27T09:52:02.144 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.131+0000 7f79bdffb700 1 -- 172.21.15.146:0/6988417 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f79c400e040 con 0x7f79ac00b7c0 2021-01-27T09:52:02.144 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.131+0000 7f79bdffb700 1 --2- 172.21.15.146:0/6988417 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f79ac056f10 0x7f79ac0593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:02.145 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.131+0000 7f79bdffb700 1 -- 172.21.15.146:0/6988417 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7f79c406f400 con 0x7f79ac00b7c0 2021-01-27T09:52:02.145 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.131+0000 7f79cd5e1700 1 --2- 172.21.15.146:0/6988417 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f79ac056f10 0x7f79ac0593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:02.145 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.131+0000 7f79cd5e1700 1 --2- 172.21.15.146:0/6988417 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f79ac056f10 0x7f79ac0593d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f79c815e3c0 tx=0x7f79c0008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:52:02.146 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.135+0000 7f79bdffb700 1 -- 172.21.15.146:0/6988417 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f79c4044920 con 0x7f79ac00b7c0 2021-01-27T09:52:02.547 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.543+0000 7f79d0046700 1 -- 172.21.15.146:0/6988417 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79c80ae490 con 0x7f79ac00b7c0 2021-01-27T09:52:02.548 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.543+0000 7f79bdffb700 1 -- 172.21.15.146:0/6988417 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3229 (secure 0 0 0) 0x7f79c400a420 con 0x7f79ac00b7c0 2021-01-27T09:52:02.549 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:52:02.549 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:51:57.688412+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5040,"mds_1":4287,"mds_2":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4971":{"gid":4971,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_5040":{"gid":5040,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":41,"addr":"172.21.15.146:6835/3537280353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3537280353},{"type":"v1","addr":"172.21.15.146:6835","nonce":3537280353}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:52:02.557 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.555+0000 7f79ab7fe700 1 -- 172.21.15.146:0/6988417 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f79ac056f10 msgr2=0x7f79ac0593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:02.557 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.555+0000 7f79ab7fe700 1 --2- 172.21.15.146:0/6988417 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f79ac056f10 0x7f79ac0593d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f79c815e3c0 tx=0x7f79c0008040).stop 2021-01-27T09:52:02.558 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.555+0000 7f79ab7fe700 1 -- 172.21.15.146:0/6988417 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79ac00b7c0 msgr2=0x7f79c815a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:02.558 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.555+0000 7f79ab7fe700 1 --2- 172.21.15.146:0/6988417 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79ac00b7c0 0x7f79c815a8e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f79c4006c00 tx=0x7f79c400a2e0).stop 2021-01-27T09:52:02.558 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.555+0000 7f79ab7fe700 1 -- 172.21.15.146:0/6988417 shutdown_connections 2021-01-27T09:52:02.558 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.555+0000 7f79ab7fe700 1 --2- 172.21.15.146:0/6988417 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f79ac056f10 0x7f79ac0593d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:02.559 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.555+0000 7f79ab7fe700 1 --2- 172.21.15.146:0/6988417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79c817b0e0 0x7f79c817b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:02.559 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.555+0000 7f79ab7fe700 1 --2- 172.21.15.146:0/6988417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79c80b1800 0x7f79c80b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:02.559 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.555+0000 7f79ab7fe700 1 --2- 172.21.15.146:0/6988417 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79ac00b7c0 0x7f79c815a8e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:02.559 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.555+0000 7f79ab7fe700 1 -- 172.21.15.146:0/6988417 >> 172.21.15.146:0/6988417 conn(0x7f79c80609f0 msgr2=0x7f79c8064c50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:52:02.559 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.555+0000 7f79ab7fe700 1 -- 172.21.15.146:0/6988417 shutdown_connections 2021-01-27T09:52:02.560 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:02.555+0000 7f79ab7fe700 1 -- 172.21.15.146:0/6988417 wait complete. 2021-01-27T09:52:02.566 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 34 2021-01-27T09:52:02.588 INFO:tasks.mds_thrash.fs.[cephfs]:mds.a has gained rank=0, replacing gid=4275 2021-01-27T09:52:02.588 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 7 secs before reviving mds.b 2021-01-27T09:52:09.589 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.b 2021-01-27T09:52:09.589 INFO:tasks.ceph.mds.b:Restarting daemon 2021-01-27T09:52:09.590 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-01-27T09:52:09.592 INFO:tasks.ceph.mds.b:Started 2021-01-27T09:52:09.592 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:52:09.833 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.827+0000 7f40b595d700 1 Processor -- start 2021-01-27T09:52:09.835 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.831+0000 7f40b595d700 1 -- start start 2021-01-27T09:52:09.835 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.831+0000 7f40b595d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40b0147f10 0x7f40b00672b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:09.836 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.831+0000 7f40b595d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f40b0064d20 0x7f40b00651b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:09.836 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.831+0000 7f40b595d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b01513e0 con 0x7f40b0147b30 2021-01-27T09:52:09.836 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.831+0000 7f40b595d700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b00be8a0 con 0x7f40b0064d20 2021-01-27T09:52:09.836 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.831+0000 7f40b595d700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b00677a0 con 0x7f40b0147f10 2021-01-27T09:52:09.837 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.831+0000 7f40b495b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f40b0147b30 0x7f40b0062810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54324/0 (socket says 172.21.15.146:54324) 2021-01-27T09:52:09.837 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.831+0000 7f40b495b700 1 -- 172.21.15.146:0/3291125604 learned_addr learned my addr 172.21.15.146:0/3291125604 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:52:09.838 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.831+0000 7f40affff700 1 --2- 172.21.15.146:0/3291125604 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40b0147f10 0x7f40b00672b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:09.838 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.831+0000 7f40b515c700 1 --2- 172.21.15.146:0/3291125604 >> v2:172.21.15.78:3300/0 conn(0x7f40b0064d20 0x7f40b00651b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:09.839 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.831+0000 7f40b515c700 1 -- 172.21.15.146:0/3291125604 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40b0147f10 msgr2=0x7f40b00672b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:52:09.839 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.831+0000 7f40b515c700 1 --2- 172.21.15.146:0/3291125604 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40b0147f10 0x7f40b00672b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:09.840 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.831+0000 7f40b515c700 1 -- 172.21.15.146:0/3291125604 >> v1:172.21.15.146:6789/0 conn(0x7f40b0147b30 legacy=0x7f40b0062810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:09.840 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.831+0000 7f40b515c700 1 -- 172.21.15.146:0/3291125604 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b0151680 con 0x7f40b0064d20 2021-01-27T09:52:09.840 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.835+0000 7f40b515c700 1 --2- 172.21.15.146:0/3291125604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40b0064d20 0x7f40b00651b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f40a400b9f0 tx=0x7f40a4006e20).ready entity=mon.0 client_cookie=21f048ddc4bf0ea3 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:52:09.841 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.839+0000 7f40af7fe700 1 -- 172.21.15.146:0/3291125604 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a400bee0 con 0x7f40b0064d20 2021-01-27T09:52:09.842 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.839+0000 7f40af7fe700 1 -- 172.21.15.146:0/3291125604 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a40096e0 con 0x7f40b0064d20 2021-01-27T09:52:09.843 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.839+0000 7f40b595d700 1 -- 172.21.15.146:0/3291125604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40b0064d20 msgr2=0x7f40b00651b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:09.843 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.839+0000 7f40b595d700 1 --2- 172.21.15.146:0/3291125604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40b0064d20 0x7f40b00651b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f40a400b9f0 tx=0x7f40a4006e20).stop 2021-01-27T09:52:09.843 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.839+0000 7f40b595d700 1 -- 172.21.15.146:0/3291125604 shutdown_connections 2021-01-27T09:52:09.844 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.839+0000 7f40b595d700 1 --2- 172.21.15.146:0/3291125604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40b0064d20 0x7f40b00651b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:09.844 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.839+0000 7f40b595d700 1 --2- 172.21.15.146:0/3291125604 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40b0147f10 0x7f40b00672b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:09.844 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.839+0000 7f40b595d700 1 -- 172.21.15.146:0/3291125604 >> 172.21.15.146:0/3291125604 conn(0x7f40b0067d30 msgr2=0x7f40b0068110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:52:09.845 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.839+0000 7f40b595d700 1 -- 172.21.15.146:0/3291125604 shutdown_connections 2021-01-27T09:52:09.845 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.839+0000 7f40b595d700 1 -- 172.21.15.146:0/3291125604 wait complete. 2021-01-27T09:52:09.847 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.843+0000 7f40b595d700 1 Processor -- start 2021-01-27T09:52:09.847 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.843+0000 7f40b595d700 1 -- start start 2021-01-27T09:52:09.848 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.843+0000 7f40b595d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40b0064d20 0x7f40b015e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:09.850 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.847+0000 7f40b495b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40b0064d20 0x7f40b015e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:09.851 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.847+0000 7f40b495b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40b0064d20 0x7f40b015e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54758/0 (socket says 172.21.15.146:54758) 2021-01-27T09:52:09.851 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.847+0000 7f40b495b700 1 -- 172.21.15.146:0/3996706317 learned_addr learned my addr 172.21.15.146:0/3996706317 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:52:09.851 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.847+0000 7f40b595d700 1 --2- 172.21.15.146:0/3996706317 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40b0147b30 0x7f40b00bd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:09.852 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.847+0000 7f40b595d700 1 --2- 172.21.15.146:0/3996706317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40b0147f10 0x7f40b0160b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:09.852 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.847+0000 7f40affff700 1 --2- 172.21.15.146:0/3996706317 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40b0147b30 0x7f40b00bd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:09.853 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.847+0000 7f40b595d700 1 -- 172.21.15.146:0/3996706317 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b014e7a0 con 0x7f40b0147f10 2021-01-27T09:52:09.853 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.847+0000 7f40b595d700 1 -- 172.21.15.146:0/3996706317 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b0161530 con 0x7f40b0064d20 2021-01-27T09:52:09.854 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.847+0000 7f40b595d700 1 -- 172.21.15.146:0/3996706317 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b01617d0 con 0x7f40b0147b30 2021-01-27T09:52:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.847+0000 7f40b515c700 1 --2- 172.21.15.146:0/3996706317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40b0147f10 0x7f40b0160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.847+0000 7f40b495b700 1 -- 172.21.15.146:0/3996706317 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40b0147b30 msgr2=0x7f40b00bd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.847+0000 7f40b495b700 1 --2- 172.21.15.146:0/3996706317 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40b0147b30 0x7f40b00bd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.847+0000 7f40b495b700 1 -- 172.21.15.146:0/3996706317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40b0147f10 msgr2=0x7f40b0160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.847+0000 7f40b495b700 1 --2- 172.21.15.146:0/3996706317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40b0147f10 0x7f40b0160b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.847+0000 7f40b495b700 1 -- 172.21.15.146:0/3996706317 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b0149820 con 0x7f40b0064d20 2021-01-27T09:52:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.847+0000 7f40b495b700 1 --2- 172.21.15.146:0/3996706317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40b0064d20 0x7f40b015e8b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f40a800cc00 tx=0x7f40a8007f60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:52:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.847+0000 7f40acff9700 1 -- 172.21.15.146:0/3996706317 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8005b90 con 0x7f40b0064d20 2021-01-27T09:52:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.847+0000 7f40acff9700 1 -- 172.21.15.146:0/3996706317 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a8005d10 con 0x7f40b0064d20 2021-01-27T09:52:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.847+0000 7f40acff9700 1 -- 172.21.15.146:0/3996706317 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8007360 con 0x7f40b0064d20 2021-01-27T09:52:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.851+0000 7f40b595d700 1 -- 172.21.15.146:0/3996706317 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b0149ac0 con 0x7f40b0064d20 2021-01-27T09:52:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.851+0000 7f40b595d700 1 -- 172.21.15.146:0/3996706317 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b0148360 con 0x7f40b0064d20 2021-01-27T09:52:09.859 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.851+0000 7f40affff700 1 --2- 172.21.15.146:0/3996706317 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40b0147b30 0x7f40b00bd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:52:09.859 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.851+0000 7f40acff9700 1 -- 172.21.15.146:0/3996706317 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f40a8010030 con 0x7f40b0064d20 2021-01-27T09:52:09.859 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.851+0000 7f40acff9700 1 --2- 172.21.15.146:0/3996706317 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f409c0563b0 0x7f409c058870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:09.859 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.851+0000 7f40acff9700 1 -- 172.21.15.146:0/3996706317 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7f40a806f680 con 0x7f40b0064d20 2021-01-27T09:52:09.860 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.851+0000 7f40affff700 1 --2- 172.21.15.146:0/3996706317 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f409c0563b0 0x7f409c058870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:09.860 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.855+0000 7f40affff700 1 --2- 172.21.15.146:0/3996706317 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f409c0563b0 0x7f409c058870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f40a0006c00 tx=0x7f40a0008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:52:09.864 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.859+0000 7f40b595d700 1 -- 172.21.15.146:0/3996706317 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b0044ee0 con 0x7f40b0064d20 2021-01-27T09:52:09.878 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:09.875+0000 7f40acff9700 1 -- 172.21.15.146:0/3996706317 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f40a8044cb0 con 0x7f40b0064d20 2021-01-27T09:52:10.396 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:10.387+0000 7f40b595d700 1 -- 172.21.15.146:0/3996706317 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40b0044680 con 0x7f40b0064d20 2021-01-27T09:52:10.397 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:10.391+0000 7f40acff9700 1 -- 172.21.15.146:0/3996706317 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3229 (secure 0 0 0) 0x7f40a80482d0 con 0x7f40b0064d20 2021-01-27T09:52:10.397 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:52:10.398 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:51:57.688412+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5040,"mds_1":4287,"mds_2":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4971":{"gid":4971,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_5040":{"gid":5040,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":41,"addr":"172.21.15.146:6835/3537280353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3537280353},{"type":"v1","addr":"172.21.15.146:6835","nonce":3537280353}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:52:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:10.395+0000 7f40b595d700 1 -- 172.21.15.146:0/3996706317 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f409c0563b0 msgr2=0x7f409c058870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:10.399+0000 7f40b595d700 1 --2- 172.21.15.146:0/3996706317 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f409c0563b0 0x7f409c058870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f40a0006c00 tx=0x7f40a0008040).stop 2021-01-27T09:52:10.415 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:10.411+0000 7f40b595d700 1 -- 172.21.15.146:0/3996706317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40b0064d20 msgr2=0x7f40b015e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:10.416 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:10.411+0000 7f40b595d700 1 --2- 172.21.15.146:0/3996706317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40b0064d20 0x7f40b015e8b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f40a800cc00 tx=0x7f40a8007f60).stop 2021-01-27T09:52:10.422 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:10.419+0000 7f40b595d700 1 -- 172.21.15.146:0/3996706317 shutdown_connections 2021-01-27T09:52:10.422 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:10.419+0000 7f40b595d700 1 --2- 172.21.15.146:0/3996706317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40b0147f10 0x7f40b0160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:10.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:10.419+0000 7f40b595d700 1 --2- 172.21.15.146:0/3996706317 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40b0147b30 0x7f40b00bd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:10.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:10.419+0000 7f40b595d700 1 --2- 172.21.15.146:0/3996706317 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f409c0563b0 0x7f409c058870 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:10.423 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:10.419+0000 7f40b595d700 1 --2- 172.21.15.146:0/3996706317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40b0064d20 0x7f40b015e8b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:10.424 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:10.419+0000 7f40b595d700 1 -- 172.21.15.146:0/3996706317 >> 172.21.15.146:0/3996706317 conn(0x7f40b0067d30 msgr2=0x7f40b0146ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:52:10.424 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:10.419+0000 7f40b595d700 1 -- 172.21.15.146:0/3996706317 shutdown_connections 2021-01-27T09:52:10.425 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:10.419+0000 7f40b595d700 1 -- 172.21.15.146:0/3996706317 wait complete. 2021-01-27T09:52:10.433 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 34 2021-01-27T09:52:10.457 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is in active, standby or standby-replay 2021-01-27T09:52:10.661 INFO:tasks.ceph.mds.b.smithi078.stdout:starting mds.b at 2021-01-27T09:52:12.459 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:52:12.845 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.843+0000 7f1b9ffff700 1 Processor -- start 2021-01-27T09:52:12.846 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.843+0000 7f1b9ffff700 1 -- start start 2021-01-27T09:52:12.847 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.843+0000 7f1b9ffff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ba00bd8e0 0x7f1ba00671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:12.848 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.843+0000 7f1b9ffff700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ba0066d80 con 0x7f1ba014a7f0 2021-01-27T09:52:12.848 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.843+0000 7f1b9ffff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ba0069530 con 0x7f1ba00bd500 2021-01-27T09:52:12.848 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.843+0000 7f1b9ffff700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba00ae600 con 0x7f1ba00bd8e0 2021-01-27T09:52:12.849 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.843+0000 7f1b9effd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1ba00bd500 0x7f1ba00bcbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54376/0 (socket says 172.21.15.146:54376) 2021-01-27T09:52:12.849 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.843+0000 7f1b9effd700 1 -- 172.21.15.146:0/211111926 learned_addr learned my addr 172.21.15.146:0/211111926 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:52:12.849 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.843+0000 7f1b9f7fe700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1ba014a7f0 0x7f1ba014ac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:42414/0 (socket says 172.21.15.146:42414) 2021-01-27T09:52:12.849 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.843+0000 7f1b9e7fc700 1 --2- 172.21.15.146:0/211111926 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ba00bd8e0 0x7f1ba00671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:12.851 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.843+0000 7f1b9e7fc700 1 -- 172.21.15.146:0/211111926 >> v1:172.21.15.146:6789/0 conn(0x7f1ba00bd500 legacy=0x7f1ba00bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:12.851 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.843+0000 7f1b9e7fc700 1 -- 172.21.15.146:0/211111926 >> v1:172.21.15.78:6789/0 conn(0x7f1ba014a7f0 legacy=0x7f1ba014ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:12.851 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.843+0000 7f1b9e7fc700 1 -- 172.21.15.146:0/211111926 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba00ae8a0 con 0x7f1ba00bd8e0 2021-01-27T09:52:12.851 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.843+0000 7f1b9dffb700 1 -- 172.21.15.146:0/211111926 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933360481 0 0) 0x7f1ba0069530 con 0x7f1ba00bd500 2021-01-27T09:52:12.852 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.843+0000 7f1b9e7fc700 1 --2- 172.21.15.146:0/211111926 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ba00bd8e0 0x7f1ba00671b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f1b9400b9f0 tx=0x7f1b94006e20).ready entity=mon.2 client_cookie=2e1e42d4d0f3032d server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:52:12.852 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.847+0000 7f1b9dffb700 1 -- 172.21.15.146:0/211111926 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b94009870 con 0x7f1ba00bd8e0 2021-01-27T09:52:12.852 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.847+0000 7f1b9dffb700 1 -- 172.21.15.146:0/211111926 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b940099d0 con 0x7f1ba00bd8e0 2021-01-27T09:52:12.852 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.847+0000 7f1b9dffb700 1 -- 172.21.15.146:0/211111926 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b94009d50 con 0x7f1ba00bd8e0 2021-01-27T09:52:12.857 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.847+0000 7f1b9ffff700 1 -- 172.21.15.146:0/211111926 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ba00bd8e0 msgr2=0x7f1ba00671b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:12.857 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.847+0000 7f1b9ffff700 1 --2- 172.21.15.146:0/211111926 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ba00bd8e0 0x7f1ba00671b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f1b9400b9f0 tx=0x7f1b94006e20).stop 2021-01-27T09:52:12.858 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.847+0000 7f1b9ffff700 1 -- 172.21.15.146:0/211111926 shutdown_connections 2021-01-27T09:52:12.858 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.847+0000 7f1b9ffff700 1 --2- 172.21.15.146:0/211111926 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ba00bd8e0 0x7f1ba00671b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:12.858 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.847+0000 7f1b9ffff700 1 -- 172.21.15.146:0/211111926 >> 172.21.15.146:0/211111926 conn(0x7f1ba0060a30 msgr2=0x7f1ba0065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:52:12.858 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.847+0000 7f1b9ffff700 1 -- 172.21.15.146:0/211111926 shutdown_connections 2021-01-27T09:52:12.861 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.859+0000 7f1b9ffff700 1 -- 172.21.15.146:0/211111926 wait complete. 2021-01-27T09:52:12.865 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.859+0000 7f1b9ffff700 1 Processor -- start 2021-01-27T09:52:12.865 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.863+0000 7f1b9ffff700 1 -- start start 2021-01-27T09:52:12.866 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.863+0000 7f1b9ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba00bd500 0x7f1ba00bcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:12.867 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.863+0000 7f1b9ffff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ba00bd8e0 0x7f1ba0153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:12.868 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.863+0000 7f1b9ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ba014a7f0 0x7f1ba0150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:12.868 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.863+0000 7f1b9ffff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba0162f50 con 0x7f1ba014a7f0 2021-01-27T09:52:12.868 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.863+0000 7f1b9ffff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba0162820 con 0x7f1ba00bd500 2021-01-27T09:52:12.868 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.863+0000 7f1b9ffff700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba014f5e0 con 0x7f1ba00bd8e0 2021-01-27T09:52:12.869 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.863+0000 7f1b9e7fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ba00bd8e0 0x7f1ba0153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:12.869 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.863+0000 7f1b9effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba00bd500 0x7f1ba00bcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:12.869 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.863+0000 7f1b9e7fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ba00bd8e0 0x7f1ba0153670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:44298/0 (socket says 172.21.15.146:44298) 2021-01-27T09:52:12.869 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.863+0000 7f1b9e7fc700 1 -- 172.21.15.146:0/2333063605 learned_addr learned my addr 172.21.15.146:0/2333063605 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:52:12.869 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.863+0000 7f1b9f7fe700 1 --2- 172.21.15.146:0/2333063605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ba014a7f0 0x7f1ba0150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:12.870 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.863+0000 7f1b9e7fc700 1 -- 172.21.15.146:0/2333063605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba00bd500 msgr2=0x7f1ba00bcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:12.870 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.863+0000 7f1b9e7fc700 1 --2- 172.21.15.146:0/2333063605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba00bd500 0x7f1ba00bcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:12.870 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.863+0000 7f1b9e7fc700 1 -- 172.21.15.146:0/2333063605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ba014a7f0 msgr2=0x7f1ba0150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:12.870 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.863+0000 7f1b9e7fc700 1 --2- 172.21.15.146:0/2333063605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ba014a7f0 0x7f1ba0150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:12.870 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.863+0000 7f1b9e7fc700 1 -- 172.21.15.146:0/2333063605 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba014f880 con 0x7f1ba00bd8e0 2021-01-27T09:52:12.871 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.863+0000 7f1b9e7fc700 1 --2- 172.21.15.146:0/2333063605 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ba00bd8e0 0x7f1ba0153670 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f1b94010000 tx=0x7f1b94016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:52:12.872 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.863+0000 7f1b86ffd700 1 -- 172.21.15.146:0/2333063605 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b94011e00 con 0x7f1ba00bd8e0 2021-01-27T09:52:12.872 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.863+0000 7f1b86ffd700 1 -- 172.21.15.146:0/2333063605 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9401d430 con 0x7f1ba00bd8e0 2021-01-27T09:52:12.872 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.867+0000 7f1b86ffd700 1 -- 172.21.15.146:0/2333063605 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9401d7d0 con 0x7f1ba00bd8e0 2021-01-27T09:52:12.872 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.867+0000 7f1b9ffff700 1 -- 172.21.15.146:0/2333063605 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba014fb20 con 0x7f1ba00bd8e0 2021-01-27T09:52:12.873 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.867+0000 7f1b9ffff700 1 -- 172.21.15.146:0/2333063605 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba0162540 con 0x7f1ba00bd8e0 2021-01-27T09:52:12.873 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.867+0000 7f1b9ffff700 1 -- 172.21.15.146:0/2333063605 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba00adfe0 con 0x7f1ba00bd8e0 2021-01-27T09:52:12.873 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.867+0000 7f1b86ffd700 1 -- 172.21.15.146:0/2333063605 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f1b94024030 con 0x7f1ba00bd8e0 2021-01-27T09:52:12.874 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.871+0000 7f1b86ffd700 1 --2- 172.21.15.146:0/2333063605 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f1b80056230 0x7f1b800586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:12.874 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.871+0000 7f1b86ffd700 1 -- 172.21.15.146:0/2333063605 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7f1b94070680 con 0x7f1ba00bd8e0 2021-01-27T09:52:12.877 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.875+0000 7f1b86ffd700 1 -- 172.21.15.146:0/2333063605 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f1ba00adfe0 con 0x7f1ba00bd8e0 2021-01-27T09:52:12.880 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.875+0000 7f1b9effd700 1 --2- 172.21.15.146:0/2333063605 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f1b80056230 0x7f1b800586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:12.881 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:12.879+0000 7f1b9effd700 1 --2- 172.21.15.146:0/2333063605 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f1b80056230 0x7f1b800586f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f1b90007fd0 tx=0x7f1b90007a10).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:52:13.177 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:13.171+0000 7f1b9ffff700 1 -- 172.21.15.146:0/2333063605 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ba00adfe0 con 0x7f1ba00bd8e0 2021-01-27T09:52:13.178 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:13.175+0000 7f1b86ffd700 1 -- 172.21.15.146:0/2333063605 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3229 (secure 0 0 0) 0x7f1ba00adfe0 con 0x7f1ba00bd8e0 2021-01-27T09:52:13.178 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:52:13.178 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:51:57.688412+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5040,"mds_1":4287,"mds_2":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4971":{"gid":4971,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_5040":{"gid":5040,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":41,"addr":"172.21.15.146:6835/3537280353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3537280353},{"type":"v1","addr":"172.21.15.146:6835","nonce":3537280353}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:52:13.181 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:13.179+0000 7f1b9ffff700 1 -- 172.21.15.146:0/2333063605 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f1b80056230 msgr2=0x7f1b800586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:13.181 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:13.179+0000 7f1b9ffff700 1 --2- 172.21.15.146:0/2333063605 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f1b80056230 0x7f1b800586f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f1b90007fd0 tx=0x7f1b90007a10).stop 2021-01-27T09:52:13.182 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:13.179+0000 7f1b9ffff700 1 -- 172.21.15.146:0/2333063605 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ba00bd8e0 msgr2=0x7f1ba0153670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:13.182 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:13.179+0000 7f1b9ffff700 1 --2- 172.21.15.146:0/2333063605 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ba00bd8e0 0x7f1ba0153670 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f1b94010000 tx=0x7f1b94016000).stop 2021-01-27T09:52:13.183 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:13.179+0000 7f1b9ffff700 1 -- 172.21.15.146:0/2333063605 shutdown_connections 2021-01-27T09:52:13.183 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:13.179+0000 7f1b9ffff700 1 --2- 172.21.15.146:0/2333063605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ba014a7f0 0x7f1ba0150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:13.183 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:13.179+0000 7f1b9ffff700 1 --2- 172.21.15.146:0/2333063605 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ba00bd8e0 0x7f1ba0153670 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:13.183 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:13.179+0000 7f1b9ffff700 1 --2- 172.21.15.146:0/2333063605 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f1b80056230 0x7f1b800586f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:13.183 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:13.179+0000 7f1b9ffff700 1 --2- 172.21.15.146:0/2333063605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba00bd500 0x7f1ba00bcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:13.184 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:13.179+0000 7f1b9ffff700 1 -- 172.21.15.146:0/2333063605 >> 172.21.15.146:0/2333063605 conn(0x7f1ba0060a30 msgr2=0x7f1ba01466c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:52:13.184 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:13.179+0000 7f1b9ffff700 1 -- 172.21.15.146:0/2333063605 shutdown_connections 2021-01-27T09:52:13.184 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:13.179+0000 7f1b9ffff700 1 -- 172.21.15.146:0/2333063605 wait complete. 2021-01-27T09:52:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 34 2021-01-27T09:52:13.218 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is in active, standby or standby-replay 2021-01-27T09:52:15.219 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:52:15.506 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.503+0000 7f9ef7fff700 1 Processor -- start 2021-01-27T09:52:15.506 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.503+0000 7f9ef7fff700 1 -- start start 2021-01-27T09:52:15.507 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.503+0000 7f9ef7fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ef814dc70 0x7f9ef80bf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:15.508 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.503+0000 7f9ef7fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9ef8151cc0 0x7f9ef814b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:15.509 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.503+0000 7f9ef6ffd700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9ef80bf050 0x7f9ef814ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:42432/0 (socket says 172.21.15.146:42432) 2021-01-27T09:52:15.509 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.503+0000 7f9ef6ffd700 1 -- 172.21.15.146:0/3060367548 learned_addr learned my addr 172.21.15.146:0/3060367548 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:52:15.509 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.503+0000 7f9ef77fe700 1 --2- 172.21.15.146:0/3060367548 >> v2:172.21.15.146:3300/0 conn(0x7f9ef8151cc0 0x7f9ef814b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:15.510 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.503+0000 7f9ef7fff700 1 -- 172.21.15.146:0/3060367548 --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef8065e10 con 0x7f9ef80bf050 2021-01-27T09:52:15.510 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.503+0000 7f9ef67fc700 1 --2- 172.21.15.146:0/3060367548 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ef814dc70 0x7f9ef80bf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:15.510 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.503+0000 7f9ef7fff700 1 -- 172.21.15.146:0/3060367548 --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef80c4b50 con 0x7f9ef8151cc0 2021-01-27T09:52:15.510 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.503+0000 7f9ef7fff700 1 -- 172.21.15.146:0/3060367548 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef814b790 con 0x7f9ef814dc70 2021-01-27T09:52:15.511 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.503+0000 7f9ef5ffb700 1 -- 172.21.15.146:0/3060367548 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240992161 0 0) 0x7f9ef8065e10 con 0x7f9ef80bf050 2021-01-27T09:52:15.511 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.503+0000 7f9ef5ffb700 1 -- 172.21.15.146:0/3060367548 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ee4003270 con 0x7f9ef80bf050 2021-01-27T09:52:15.511 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.503+0000 7f9ef67fc700 1 -- 172.21.15.146:0/3060367548 >> v2:172.21.15.146:3300/0 conn(0x7f9ef8151cc0 msgr2=0x7f9ef814b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:52:15.511 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.503+0000 7f9ef67fc700 1 --2- 172.21.15.146:0/3060367548 >> v2:172.21.15.146:3300/0 conn(0x7f9ef8151cc0 0x7f9ef814b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:15.511 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.503+0000 7f9ef67fc700 1 -- 172.21.15.146:0/3060367548 >> v1:172.21.15.78:6789/0 conn(0x7f9ef80bf050 legacy=0x7f9ef814ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:15.512 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.503+0000 7f9ef67fc700 1 -- 172.21.15.146:0/3060367548 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef8066580 con 0x7f9ef814dc70 2021-01-27T09:52:15.512 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.507+0000 7f9ef67fc700 1 --2- 172.21.15.146:0/3060367548 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ef814dc70 0x7f9ef80bf430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f9ef0009cc0 tx=0x7f9ef0009220).ready entity=mon.2 client_cookie=9809696043a73ee4 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:52:15.513 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.507+0000 7f9ef5ffb700 1 -- 172.21.15.146:0/3060367548 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef000b9f0 con 0x7f9ef814dc70 2021-01-27T09:52:15.513 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.507+0000 7f9ef5ffb700 1 -- 172.21.15.146:0/3060367548 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef000bb50 con 0x7f9ef814dc70 2021-01-27T09:52:15.513 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.507+0000 7f9ef5ffb700 1 -- 172.21.15.146:0/3060367548 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0011400 con 0x7f9ef814dc70 2021-01-27T09:52:15.514 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.507+0000 7f9ef7fff700 1 -- 172.21.15.146:0/3060367548 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ef814dc70 msgr2=0x7f9ef80bf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:15.514 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.507+0000 7f9ef7fff700 1 --2- 172.21.15.146:0/3060367548 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ef814dc70 0x7f9ef80bf430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f9ef0009cc0 tx=0x7f9ef0009220).stop 2021-01-27T09:52:15.514 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.507+0000 7f9ef7fff700 1 -- 172.21.15.146:0/3060367548 shutdown_connections 2021-01-27T09:52:15.514 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.507+0000 7f9ef7fff700 1 --2- 172.21.15.146:0/3060367548 >> v2:172.21.15.146:3300/0 conn(0x7f9ef8151cc0 0x7f9ef814b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:15.514 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.507+0000 7f9ef7fff700 1 --2- 172.21.15.146:0/3060367548 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ef814dc70 0x7f9ef80bf430 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0x7f9ef0009cc0 tx=0x7f9ef0009220).stop 2021-01-27T09:52:15.515 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.507+0000 7f9ef7fff700 1 -- 172.21.15.146:0/3060367548 >> 172.21.15.146:0/3060367548 conn(0x7f9ef8064f30 msgr2=0x7f9ef8065340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:52:15.527 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.515+0000 7f9ef7fff700 1 -- 172.21.15.146:0/3060367548 shutdown_connections 2021-01-27T09:52:15.528 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.523+0000 7f9ef7fff700 1 -- 172.21.15.146:0/3060367548 wait complete. 2021-01-27T09:52:15.528 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.523+0000 7f9ef7fff700 1 Processor -- start 2021-01-27T09:52:15.528 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.523+0000 7f9ef7fff700 1 -- start start 2021-01-27T09:52:15.529 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.523+0000 7f9ef7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ef80bf050 0x7f9ef816a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:15.529 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.527+0000 7f9ef7fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef8151cc0 0x7f9ef816e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:15.529 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.527+0000 7f9ef7fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ef814ee40 0x7f9ef815eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:15.530 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.527+0000 7f9ef7fff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef816d770 con 0x7f9ef8151cc0 2021-01-27T09:52:15.530 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.527+0000 7f9ef7fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef816e5d0 con 0x7f9ef80bf050 2021-01-27T09:52:15.530 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.527+0000 7f9ef7fff700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef814f380 con 0x7f9ef814ee40 2021-01-27T09:52:15.531 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.527+0000 7f9ef77fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ef814ee40 0x7f9ef815eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:15.531 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.527+0000 7f9ef67fc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef8151cc0 0x7f9ef816e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:15.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.527+0000 7f9ef77fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ef814ee40 0x7f9ef815eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:44322/0 (socket says 172.21.15.146:44322) 2021-01-27T09:52:15.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.527+0000 7f9ef77fe700 1 -- 172.21.15.146:0/329369386 learned_addr learned my addr 172.21.15.146:0/329369386 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:52:15.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.527+0000 7f9ef6ffd700 1 --2- 172.21.15.146:0/329369386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ef80bf050 0x7f9ef816a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:15.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.527+0000 7f9ef67fc700 1 -- 172.21.15.146:0/329369386 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ef814ee40 msgr2=0x7f9ef815eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:15.532 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.527+0000 7f9ef67fc700 1 --2- 172.21.15.146:0/329369386 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ef814ee40 0x7f9ef815eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:15.533 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.527+0000 7f9ef67fc700 1 -- 172.21.15.146:0/329369386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ef80bf050 msgr2=0x7f9ef816a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:15.533 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.527+0000 7f9ef67fc700 1 --2- 172.21.15.146:0/329369386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ef80bf050 0x7f9ef816a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:15.533 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.527+0000 7f9ef67fc700 1 -- 172.21.15.146:0/329369386 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef814f620 con 0x7f9ef8151cc0 2021-01-27T09:52:15.533 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.527+0000 7f9ef77fe700 1 --2- 172.21.15.146:0/329369386 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ef814ee40 0x7f9ef815eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:52:15.533 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.527+0000 7f9ef6ffd700 1 --2- 172.21.15.146:0/329369386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ef80bf050 0x7f9ef816a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:52:15.534 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.527+0000 7f9ef67fc700 1 --2- 172.21.15.146:0/329369386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef8151cc0 0x7f9ef816e0e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f9ef0014000 tx=0x7f9ef0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:52:15.535 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.527+0000 7f9edeffd700 1 -- 172.21.15.146:0/329369386 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0011d20 con 0x7f9ef8151cc0 2021-01-27T09:52:15.535 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.527+0000 7f9ef7fff700 1 -- 172.21.15.146:0/329369386 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef814f8c0 con 0x7f9ef8151cc0 2021-01-27T09:52:15.535 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.527+0000 7f9ef7fff700 1 -- 172.21.15.146:0/329369386 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef816dc40 con 0x7f9ef8151cc0 2021-01-27T09:52:15.535 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.527+0000 7f9edeffd700 1 -- 172.21.15.146:0/329369386 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef001e070 con 0x7f9ef8151cc0 2021-01-27T09:52:15.535 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.527+0000 7f9edeffd700 1 -- 172.21.15.146:0/329369386 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0011d20 con 0x7f9ef8151cc0 2021-01-27T09:52:15.536 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.531+0000 7f9edeffd700 1 -- 172.21.15.146:0/329369386 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f9ef000f070 con 0x7f9ef8151cc0 2021-01-27T09:52:15.536 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.531+0000 7f9edeffd700 1 --2- 172.21.15.146:0/329369386 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9ed8056240 0x7f9ed8058700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:52:15.537 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.535+0000 7f9edeffd700 1 -- 172.21.15.146:0/329369386 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7f9ef00496b0 con 0x7f9ef8151cc0 2021-01-27T09:52:15.538 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.535+0000 7f9ef6ffd700 1 --2- 172.21.15.146:0/329369386 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9ed8056240 0x7f9ed8058700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:52:15.538 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.535+0000 7f9ef6ffd700 1 --2- 172.21.15.146:0/329369386 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9ed8056240 0x7f9ed8058700 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f9eec007fd0 tx=0x7f9eec009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:52:15.546 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.543+0000 7f9ef7fff700 1 -- 172.21.15.146:0/329369386 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed0004fa0 con 0x7f9ef8151cc0 2021-01-27T09:52:15.552 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.547+0000 7f9edeffd700 1 -- 172.21.15.146:0/329369386 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f9ef00461e0 con 0x7f9ef8151cc0 2021-01-27T09:52:15.935 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.931+0000 7f9ef7fff700 1 -- 172.21.15.146:0/329369386 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ed0005250 con 0x7f9ef8151cc0 2021-01-27T09:52:15.936 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.931+0000 7f9edeffd700 1 -- 172.21.15.146:0/329369386 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+3579 (secure 0 0 0) 0x7f9ef0002020 con 0x7f9ef8151cc0 2021-01-27T09:52:15.937 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:52:15.938 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4835,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.78:6837/546715319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":546715319},{"type":"v1","addr":"172.21.15.78:6837","nonce":546715319}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:51:57.688412+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5040,"mds_1":4287,"mds_2":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_4971":{"gid":4971,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_5040":{"gid":5040,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":41,"addr":"172.21.15.146:6835/3537280353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3537280353},{"type":"v1","addr":"172.21.15.146:6835","nonce":3537280353}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:52:15.957 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.955+0000 7f9ef7fff700 1 -- 172.21.15.146:0/329369386 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9ed8056240 msgr2=0x7f9ed8058700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:15.957 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.955+0000 7f9ef7fff700 1 --2- 172.21.15.146:0/329369386 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9ed8056240 0x7f9ed8058700 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f9eec007fd0 tx=0x7f9eec009040).stop 2021-01-27T09:52:15.958 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.955+0000 7f9ef7fff700 1 -- 172.21.15.146:0/329369386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef8151cc0 msgr2=0x7f9ef816e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:52:15.959 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.955+0000 7f9ef7fff700 1 --2- 172.21.15.146:0/329369386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef8151cc0 0x7f9ef816e0e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f9ef0014000 tx=0x7f9ef0017000).stop 2021-01-27T09:52:15.959 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.955+0000 7f9ef7fff700 1 -- 172.21.15.146:0/329369386 shutdown_connections 2021-01-27T09:52:15.959 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.955+0000 7f9ef7fff700 1 --2- 172.21.15.146:0/329369386 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ef814ee40 0x7f9ef815eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:15.959 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.955+0000 7f9ef7fff700 1 --2- 172.21.15.146:0/329369386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef8151cc0 0x7f9ef816e0e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:15.959 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.955+0000 7f9ef7fff700 1 --2- 172.21.15.146:0/329369386 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f9ed8056240 0x7f9ed8058700 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:15.960 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.955+0000 7f9ef7fff700 1 --2- 172.21.15.146:0/329369386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ef80bf050 0x7f9ef816a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:52:15.960 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.955+0000 7f9ef7fff700 1 -- 172.21.15.146:0/329369386 >> 172.21.15.146:0/329369386 conn(0x7f9ef8064f30 msgr2=0x7f9ef80bf430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:52:15.960 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.955+0000 7f9ef7fff700 1 -- 172.21.15.146:0/329369386 shutdown_connections 2021-01-27T09:52:15.960 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:52:15.955+0000 7f9ef7fff700 1 -- 172.21.15.146:0/329369386 wait complete. 2021-01-27T09:52:15.961 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 35 2021-01-27T09:52:15.990 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b reported in up:standby state 2021-01-27T09:52:15.990 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 111 secs before thrashing 2021-01-27T09:53:08.747 INFO:tasks.workunit.client.0.smithi146.stdout:Syncing()...20 sec 2021-01-27T09:53:08.747 INFO:tasks.workunit.client.0.smithi146.stdout:FFSB benchmark finished at: Wed Jan 27 09:53:08 2021 2021-01-27T09:53:08.748 INFO:tasks.workunit.client.0.smithi146.stdout: 2021-01-27T09:53:08.748 INFO:tasks.workunit.client.0.smithi146.stdout:Results: 2021-01-27T09:53:08.748 INFO:tasks.workunit.client.0.smithi146.stdout:Benchmark took 351.40 sec 2021-01-27T09:53:08.748 INFO:tasks.workunit.client.0.smithi146.stdout: 2021-01-27T09:53:08.748 INFO:tasks.workunit.client.0.smithi146.stdout:Total Results 2021-01-27T09:53:08.749 INFO:tasks.workunit.client.0.smithi146.stdout:=============== 2021-01-27T09:53:08.749 INFO:tasks.workunit.client.0.smithi146.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2021-01-27T09:53:08.749 INFO:tasks.workunit.client.0.smithi146.stdout: ======= ============ ========= ======= =========== ========== 2021-01-27T09:53:08.749 INFO:tasks.workunit.client.0.smithi146.stdout: write : 1272320 3620.71 100.000% 100.000% 283MB/sec 2021-01-27T09:53:08.750 INFO:tasks.workunit.client.0.smithi146.stdout:- 2021-01-27T09:53:08.750 INFO:tasks.workunit.client.0.smithi146.stdout:3620.71 Transactions per Second 2021-01-27T09:53:08.750 INFO:tasks.workunit.client.0.smithi146.stdout: 2021-01-27T09:53:08.750 INFO:tasks.workunit.client.0.smithi146.stdout:Throughput Results 2021-01-27T09:53:08.751 INFO:tasks.workunit.client.0.smithi146.stdout:=================== 2021-01-27T09:53:08.751 INFO:tasks.workunit.client.0.smithi146.stdout:Write Throughput: 283MB/sec 2021-01-27T09:53:08.751 INFO:tasks.workunit.client.0.smithi146.stdout: 2021-01-27T09:53:08.751 INFO:tasks.workunit.client.0.smithi146.stdout:System Call Latency statistics in millisecs 2021-01-27T09:53:08.751 INFO:tasks.workunit.client.0.smithi146.stdout:===== 2021-01-27T09:53:08.752 INFO:tasks.workunit.client.0.smithi146.stdout: Min Avg Max Total Calls 2021-01-27T09:53:08.752 INFO:tasks.workunit.client.0.smithi146.stdout: ======== ======== ======== ============ 2021-01-27T09:53:08.752 INFO:tasks.workunit.client.0.smithi146.stdout:[ open] 0.020000 4.067231 262.497009 994 2021-01-27T09:53:08.752 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2021-01-27T09:53:08.753 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2021-01-27T09:53:08.753 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2021-01-27T09:53:08.753 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2021-01-27T09:53:08.753 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[4] 200.000000 - 500.000000 : 5 2021-01-27T09:53:08.753 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[5] 100.000000 - 200.000000 : 2 2021-01-27T09:53:08.754 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[6] 50.000000 - 100.000000 : 8 2021-01-27T09:53:08.754 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[7] 20.000000 - 50.000000 : 32 2021-01-27T09:53:08.754 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[8] 10.000000 - 20.000000 : 42 2021-01-27T09:53:08.754 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[9] 5.000000 - 10.000000 : 31 2021-01-27T09:53:08.755 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[10] 2.000000 - 5.000000 : 43 2021-01-27T09:53:08.755 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[11] 1.000000 - 2.000000 : 20 2021-01-27T09:53:08.755 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[12] 0.500000 - 1.000000 : 3 2021-01-27T09:53:08.755 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[13] 0.200000 - 0.500000 : 0 2021-01-27T09:53:08.755 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[14] 0.100000 - 0.200000 : 2 2021-01-27T09:53:08.756 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[15] 0.050000 - 0.100000 : 3 2021-01-27T09:53:08.756 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[16] 0.020000 - 0.050000 : 803 2021-01-27T09:53:08.756 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2021-01-27T09:53:08.756 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2021-01-27T09:53:08.756 INFO:tasks.workunit.client.0.smithi146.stdout: 2021-01-27T09:53:08.757 INFO:tasks.workunit.client.0.smithi146.stdout:[ write] 0.005000 5.192955 217066.593750 1272320 2021-01-27T09:53:08.757 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[0] 5000.000000 - 10000.000000 : 13 2021-01-27T09:53:08.757 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[1] 2000.000000 - 5000.000000 : 20 2021-01-27T09:53:08.757 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[2] 1000.000000 - 2000.000000 : 6 2021-01-27T09:53:08.758 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[3] 500.000000 - 1000.000000 : 3 2021-01-27T09:53:08.758 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[4] 200.000000 - 500.000000 : 10 2021-01-27T09:53:08.758 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[5] 100.000000 - 200.000000 : 11 2021-01-27T09:53:08.758 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[6] 50.000000 - 100.000000 : 140 2021-01-27T09:53:08.759 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[7] 20.000000 - 50.000000 : 1314 2021-01-27T09:53:08.759 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[8] 10.000000 - 20.000000 : 903 2021-01-27T09:53:08.759 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[9] 5.000000 - 10.000000 : 677 2021-01-27T09:53:08.759 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[10] 2.000000 - 5.000000 : 530 2021-01-27T09:53:08.759 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[11] 1.000000 - 2.000000 : 281 2021-01-27T09:53:08.760 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[12] 0.500000 - 1.000000 : 400 2021-01-27T09:53:08.760 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[13] 0.200000 - 0.500000 : 547 2021-01-27T09:53:08.760 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[14] 0.100000 - 0.200000 : 788 2021-01-27T09:53:08.760 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[15] 0.050000 - 0.100000 : 3639 2021-01-27T09:53:08.760 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[16] 0.020000 - 0.050000 : 137960 2021-01-27T09:53:08.761 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[17] 0.010000 - 0.020000 : 1114861 2021-01-27T09:53:08.761 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[18] 0.000000 - 0.010000 : 10114 2021-01-27T09:53:08.761 INFO:tasks.workunit.client.0.smithi146.stdout: 2021-01-27T09:53:08.761 INFO:tasks.workunit.client.0.smithi146.stdout:[ lseek] 0.001000 3.023256 247888.250000 1272320 2021-01-27T09:53:08.762 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[0] 5000.000000 - 10000.000000 : 8 2021-01-27T09:53:08.762 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[1] 2000.000000 - 5000.000000 : 8 2021-01-27T09:53:08.764 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[2] 1000.000000 - 2000.000000 : 7 2021-01-27T09:53:08.764 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[3] 500.000000 - 1000.000000 : 2 2021-01-27T09:53:08.764 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[4] 200.000000 - 500.000000 : 1 2021-01-27T09:53:08.764 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[5] 100.000000 - 200.000000 : 2 2021-01-27T09:53:08.765 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[6] 50.000000 - 100.000000 : 31 2021-01-27T09:53:08.765 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[7] 20.000000 - 50.000000 : 298 2021-01-27T09:53:08.765 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[8] 10.000000 - 20.000000 : 205 2021-01-27T09:53:08.765 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[9] 5.000000 - 10.000000 : 165 2021-01-27T09:53:08.766 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[10] 2.000000 - 5.000000 : 126 2021-01-27T09:53:08.766 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[11] 1.000000 - 2.000000 : 66 2021-01-27T09:53:08.766 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[12] 0.500000 - 1.000000 : 51 2021-01-27T09:53:08.766 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[13] 0.200000 - 0.500000 : 91 2021-01-27T09:53:08.767 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[14] 0.100000 - 0.200000 : 121 2021-01-27T09:53:08.767 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[15] 0.050000 - 0.100000 : 248 2021-01-27T09:53:08.767 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[16] 0.020000 - 0.050000 : 6038 2021-01-27T09:53:08.767 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[17] 0.010000 - 0.020000 : 51683 2021-01-27T09:53:08.767 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[18] 0.000000 - 0.010000 : 1213110 2021-01-27T09:53:08.768 INFO:tasks.workunit.client.0.smithi146.stdout: 2021-01-27T09:53:08.768 INFO:tasks.workunit.client.0.smithi146.stdout:[ close] 0.004000 0.038319 16.650000 994 2021-01-27T09:53:08.768 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2021-01-27T09:53:08.768 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2021-01-27T09:53:08.768 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2021-01-27T09:53:08.769 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2021-01-27T09:53:08.769 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2021-01-27T09:53:08.769 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2021-01-27T09:53:08.769 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2021-01-27T09:53:08.769 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2021-01-27T09:53:08.770 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[8] 10.000000 - 20.000000 : 1 2021-01-27T09:53:08.770 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[9] 5.000000 - 10.000000 : 2 2021-01-27T09:53:08.770 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[10] 2.000000 - 5.000000 : 0 2021-01-27T09:53:08.775 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[11] 1.000000 - 2.000000 : 0 2021-01-27T09:53:08.775 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[12] 0.500000 - 1.000000 : 0 2021-01-27T09:53:08.776 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[13] 0.200000 - 0.500000 : 2 2021-01-27T09:53:08.776 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[14] 0.100000 - 0.200000 : 0 2021-01-27T09:53:08.776 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[15] 0.050000 - 0.100000 : 1 2021-01-27T09:53:08.776 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2021-01-27T09:53:08.777 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[17] 0.010000 - 0.020000 : 255 2021-01-27T09:53:08.777 INFO:tasks.workunit.client.0.smithi146.stdout: msec_range[18] 0.000000 - 0.010000 : 733 2021-01-27T09:53:08.777 INFO:tasks.workunit.client.0.smithi146.stdout: 2021-01-27T09:53:08.777 INFO:tasks.workunit.client.0.smithi146.stdout: 2021-01-27T09:53:08.777 INFO:tasks.workunit.client.0.smithi146.stdout: 2021-01-27T09:53:08.778 INFO:tasks.workunit.client.0.smithi146.stdout: 2021-01-27T09:53:08.778 INFO:tasks.workunit.client.0.smithi146.stdout:0.4% User Time 2021-01-27T09:53:08.778 INFO:tasks.workunit.client.0.smithi146.stdout:6.8% System Time 2021-01-27T09:53:08.778 INFO:tasks.workunit.client.0.smithi146.stdout:7.2% CPU Utilization 2021-01-27T09:53:13.195 INFO:teuthology.orchestra.run:Running command with timeout 3600 2021-01-27T09:53:13.196 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2021-01-27T09:53:13.251 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2021-01-27T09:53:13.252 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2021-01-27T09:53:14.095 DEBUG:teuthology.parallel:result is None 2021-01-27T09:53:14.096 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2021-01-27T09:53:15.255 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2021-01-27T09:53:15.255 DEBUG:teuthology.run_tasks:Unwinding manager mds_thrash 2021-01-27T09:53:15.263 INFO:tasks.mds_thrash:joining mds_thrasher 2021-01-27T09:53:15.263 INFO:tasks.mds_thrash.fs.[cephfs]:stat['max_mds'] = 0 2021-01-27T09:53:15.264 INFO:tasks.mds_thrash.fs.[cephfs]:stat['deactivate'] = 0 2021-01-27T09:53:15.264 INFO:tasks.mds_thrash.fs.[cephfs]:stat['kill'] = 3 2021-01-27T09:53:15.264 INFO:tasks.mds_thrash:done joining 2021-01-27T09:53:15.265 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2021-01-27T09:53:15.286 INFO:tasks.kclient:Unmounting kernel clients... 2021-01-27T09:53:15.286 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2021-01-27T09:53:15.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-27T09:53:15.287 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2021-01-27T09:53:15.592 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2021-01-27T09:53:15.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:53:15.593 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-01-27T09:53:15.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:53:15.624 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2021-01-27T09:53:15.685 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2021-01-27T09:53:15.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:53:15.687 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2021-01-27T09:53:15.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-27T09:53:15.740 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2021-01-27T09:53:16.021 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2021-01-27T09:53:16.032 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2021-01-27T09:53:16.033 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-01-27T09:53:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.258+0000 7efe974b3700 1 Processor -- start 2021-01-27T09:53:16.266 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.258+0000 7efe974b3700 1 -- start start 2021-01-27T09:53:16.266 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.258+0000 7efe974b3700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efe9014c1e0 0x7efe900bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:16.266 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.258+0000 7efe974b3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efe900652e0 0x7efe900beb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:16.266 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.258+0000 7efe974b3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe900ae480 con 0x7efe90064f00 2021-01-27T09:53:16.267 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.258+0000 7efe974b3700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe900ae6b0 con 0x7efe9014c1e0 2021-01-27T09:53:16.267 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.258+0000 7efe974b3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe900ae950 con 0x7efe900652e0 2021-01-27T09:53:16.267 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.262+0000 7efe964b1700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7efe90064f00 0x7efe9014bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:42852/0 (socket says 172.21.15.146:42852) 2021-01-27T09:53:16.267 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.262+0000 7efe964b1700 1 -- 172.21.15.146:0/2128714806 learned_addr learned my addr 172.21.15.146:0/2128714806 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:53:16.269 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.262+0000 7efe96cb2700 1 --2- 172.21.15.146:0/2128714806 >> v2:172.21.15.146:3300/0 conn(0x7efe900652e0 0x7efe900beb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:16.269 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.262+0000 7efe95cb0700 1 --2- 172.21.15.146:0/2128714806 >> v2:172.21.15.78:3300/0 conn(0x7efe9014c1e0 0x7efe900bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:16.270 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.262+0000 7efe954af700 1 -- 172.21.15.146:0/2128714806 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2519848473 0 0) 0x7efe900ae480 con 0x7efe90064f00 2021-01-27T09:53:16.270 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.262+0000 7efe954af700 1 -- 172.21.15.146:0/2128714806 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe74003270 con 0x7efe90064f00 2021-01-27T09:53:16.270 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.262+0000 7efe96cb2700 1 -- 172.21.15.146:0/2128714806 >> v2:172.21.15.78:3300/0 conn(0x7efe9014c1e0 msgr2=0x7efe900bcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:53:16.270 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.262+0000 7efe96cb2700 1 --2- 172.21.15.146:0/2128714806 >> v2:172.21.15.78:3300/0 conn(0x7efe9014c1e0 0x7efe900bcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:16.271 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.262+0000 7efe96cb2700 1 -- 172.21.15.146:0/2128714806 >> v1:172.21.15.78:6789/0 conn(0x7efe90064f00 legacy=0x7efe9014bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:16.271 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.262+0000 7efe96cb2700 1 -- 172.21.15.146:0/2128714806 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe900aebf0 con 0x7efe900652e0 2021-01-27T09:53:16.271 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.262+0000 7efe96cb2700 1 --2- 172.21.15.146:0/2128714806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe900652e0 0x7efe900beb90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7efe900ba820 tx=0x7efe8c006e20).ready entity=mon.1 client_cookie=29776a7517ff52a7 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:16.271 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.262+0000 7efe954af700 1 -- 172.21.15.146:0/2128714806 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c009650 con 0x7efe900652e0 2021-01-27T09:53:16.271 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.262+0000 7efe954af700 1 -- 172.21.15.146:0/2128714806 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8c0097b0 con 0x7efe900652e0 2021-01-27T09:53:16.272 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.262+0000 7efe974b3700 1 -- 172.21.15.146:0/2128714806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe900652e0 msgr2=0x7efe900beb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:16.272 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.262+0000 7efe974b3700 1 --2- 172.21.15.146:0/2128714806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe900652e0 0x7efe900beb90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7efe900ba820 tx=0x7efe8c006e20).stop 2021-01-27T09:53:16.272 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.266+0000 7efe974b3700 1 -- 172.21.15.146:0/2128714806 shutdown_connections 2021-01-27T09:53:16.273 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.266+0000 7efe974b3700 1 --2- 172.21.15.146:0/2128714806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe900652e0 0x7efe900beb90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:16.273 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.266+0000 7efe974b3700 1 --2- 172.21.15.146:0/2128714806 >> v2:172.21.15.78:3300/0 conn(0x7efe9014c1e0 0x7efe900bcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:16.273 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.266+0000 7efe974b3700 1 -- 172.21.15.146:0/2128714806 >> 172.21.15.146:0/2128714806 conn(0x7efe90060a30 msgr2=0x7efe90065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:16.275 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.270+0000 7efe974b3700 1 -- 172.21.15.146:0/2128714806 shutdown_connections 2021-01-27T09:53:16.275 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.270+0000 7efe974b3700 1 -- 172.21.15.146:0/2128714806 wait complete. 2021-01-27T09:53:16.278 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.274+0000 7efe974b3700 1 Processor -- start 2021-01-27T09:53:16.278 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.274+0000 7efe974b3700 1 -- start start 2021-01-27T09:53:16.280 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.274+0000 7efe974b3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe90064f00 0x7efe9014ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:16.281 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.274+0000 7efe974b3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe900652e0 0x7efe9014db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.274+0000 7efe974b3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efe900bd190 0x7efe9014e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.274+0000 7efe974b3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9013aea0 con 0x7efe900652e0 2021-01-27T09:53:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.274+0000 7efe974b3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe901574f0 con 0x7efe90064f00 2021-01-27T09:53:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.274+0000 7efe974b3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe90156df0 con 0x7efe900bd190 2021-01-27T09:53:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.274+0000 7efe96cb2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efe900bd190 0x7efe9014e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.274+0000 7efe96cb2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efe900bd190 0x7efe9014e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:44738/0 (socket says 172.21.15.146:44738) 2021-01-27T09:53:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.274+0000 7efe96cb2700 1 -- 172.21.15.146:0/3756060524 learned_addr learned my addr 172.21.15.146:0/3756060524 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.274+0000 7efe964b1700 1 --2- 172.21.15.146:0/3756060524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe90064f00 0x7efe9014ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.278+0000 7efe96cb2700 1 -- 172.21.15.146:0/3756060524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe90064f00 msgr2=0x7efe9014ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:16.284 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.278+0000 7efe96cb2700 1 --2- 172.21.15.146:0/3756060524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe90064f00 0x7efe9014ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:16.284 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.278+0000 7efe96cb2700 1 -- 172.21.15.146:0/3756060524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe900652e0 msgr2=0x7efe9014db20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-01-27T09:53:16.284 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.278+0000 7efe96cb2700 1 --2- 172.21.15.146:0/3756060524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe900652e0 0x7efe9014db20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:53:16.286 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.278+0000 7efe96cb2700 1 -- 172.21.15.146:0/3756060524 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9013a3c0 con 0x7efe900bd190 2021-01-27T09:53:16.286 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.278+0000 7efe96cb2700 1 --2- 172.21.15.146:0/3756060524 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efe900bd190 0x7efe9014e010 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7efe8c010000 tx=0x7efe8c016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:16.286 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.278+0000 7efe867fc700 1 -- 172.21.15.146:0/3756060524 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c011e90 con 0x7efe900bd190 2021-01-27T09:53:16.286 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.278+0000 7efe974b3700 1 -- 172.21.15.146:0/3756060524 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe9013a960 con 0x7efe900bd190 2021-01-27T09:53:16.287 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.278+0000 7efe974b3700 1 -- 172.21.15.146:0/3756060524 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe90157050 con 0x7efe900bd190 2021-01-27T09:53:16.287 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.278+0000 7efe867fc700 1 -- 172.21.15.146:0/3756060524 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8c01c630 con 0x7efe900bd190 2021-01-27T09:53:16.287 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.278+0000 7efe974b3700 1 -- 172.21.15.146:0/3756060524 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe90044680 con 0x7efe900bd190 2021-01-27T09:53:16.287 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.278+0000 7efe867fc700 1 -- 172.21.15.146:0/3756060524 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c01c9b0 con 0x7efe900bd190 2021-01-27T09:53:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.282+0000 7efe867fc700 1 -- 172.21.15.146:0/3756060524 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7efe8c00f070 con 0x7efe900bd190 2021-01-27T09:53:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.282+0000 7efe867fc700 1 --2- 172.21.15.146:0/3756060524 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7efe78056260 0x7efe78058720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.282+0000 7efe867fc700 1 -- 172.21.15.146:0/3756060524 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7efe8c071960 con 0x7efe900bd190 2021-01-27T09:53:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.282+0000 7efe964b1700 1 --2- 172.21.15.146:0/3756060524 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7efe78056260 0x7efe78058720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.282+0000 7efe964b1700 1 --2- 172.21.15.146:0/3756060524 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7efe78056260 0x7efe78058720 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7efe88007fd0 tx=0x7efe88009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:16.298 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.286+0000 7efe867fc700 1 -- 172.21.15.146:0/3756060524 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7efe8c0470c0 con 0x7efe900bd190 2021-01-27T09:53:16.611 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.606+0000 7efe974b3700 1 -- 172.21.15.146:0/3756060524 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe90063890 con 0x7efe900bd190 2021-01-27T09:53:16.612 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.606+0000 7efe867fc700 1 -- 172.21.15.146:0/3756060524 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19029 (secure 0 0 0) 0x7efe8c04a660 con 0x7efe900bd190 2021-01-27T09:53:16.614 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:53:16.615 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"fsid":"968a1bec-aac5-444e-b70f-7770587be945","created":"2021-01-27T09:44:13.797940+0000","modified":"2021-01-27T09:51:48.650675+0000","last_up_change":"2021-01-27T09:44:23.479967+0000","last_in_change":"2021-01-27T09:44:23.479967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T09:44:18.497521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-27T09:44:24.550303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-27T09:44:27.607542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-27T09:44:28.331389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-01-27T09:44:31.378452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25441909-a40b-4d82-828d-326685513ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":14470},{"type":"v1","addr":"172.21.15.146:6801","nonce":14470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":14470},{"type":"v1","addr":"172.21.15.146:6803","nonce":14470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":14470},{"type":"v1","addr":"172.21.15.146:6810","nonce":14470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":14470},{"type":"v1","addr":"172.21.15.146:6807","nonce":14470}]},"public_addr":"172.21.15.146:6801/14470","cluster_addr":"172.21.15.146:6803/14470","heartbeat_back_addr":"172.21.15.146:6810/14470","heartbeat_front_addr":"172.21.15.146:6807/14470","state":["exists","up"]},{"osd":1,"uuid":"825bbc51-2ffe-4612-a300-00960e48be02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":14472},{"type":"v1","addr":"172.21.15.146:6817","nonce":14472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":14472},{"type":"v1","addr":"172.21.15.146:6819","nonce":14472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":14472},{"type":"v1","addr":"172.21.15.146:6827","nonce":14472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":14472},{"type":"v1","addr":"172.21.15.146:6823","nonce":14472}]},"public_addr":"172.21.15.146:6817/14472","cluster_addr":"172.21.15.146:6819/14472","heartbeat_back_addr":"172.21.15.146:6827/14472","heartbeat_front_addr":"172.21.15.146:6823/14472","state":["exists","up"]},{"osd":2,"uuid":"e568b97a-8e71-4ab9-bd64-056892110b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":14474},{"type":"v1","addr":"172.21.15.146:6822","nonce":14474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":14474},{"type":"v1","addr":"172.21.15.146:6826","nonce":14474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":14474},{"type":"v1","addr":"172.21.15.146:6831","nonce":14474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":14474},{"type":"v1","addr":"172.21.15.146:6829","nonce":14474}]},"public_addr":"172.21.15.146:6822/14474","cluster_addr":"172.21.15.146:6826/14474","heartbeat_back_addr":"172.21.15.146:6831/14474","heartbeat_front_addr":"172.21.15.146:6829/14474","state":["exists","up"]},{"osd":3,"uuid":"f5d50f63-f74a-4aea-a62d-51c38db4d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":14471},{"type":"v1","addr":"172.21.15.146:6806","nonce":14471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":14471},{"type":"v1","addr":"172.21.15.146:6811","nonce":14471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":14471},{"type":"v1","addr":"172.21.15.146:6815","nonce":14471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":14471},{"type":"v1","addr":"172.21.15.146:6813","nonce":14471}]},"public_addr":"172.21.15.146:6806/14471","cluster_addr":"172.21.15.146:6811/14471","heartbeat_back_addr":"172.21.15.146:6815/14471","heartbeat_front_addr":"172.21.15.146:6813/14471","state":["exists","up"]},{"osd":4,"uuid":"782458d7-6f52-48f4-9466-67b61ef27016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":15826},{"type":"v1","addr":"172.21.15.78:6817","nonce":15826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":15826},{"type":"v1","addr":"172.21.15.78:6819","nonce":15826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":15826},{"type":"v1","addr":"172.21.15.78:6823","nonce":15826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":15826},{"type":"v1","addr":"172.21.15.78:6821","nonce":15826}]},"public_addr":"172.21.15.78:6817/15826","cluster_addr":"172.21.15.78:6819/15826","heartbeat_back_addr":"172.21.15.78:6823/15826","heartbeat_front_addr":"172.21.15.78:6821/15826","state":["exists","up"]},{"osd":5,"uuid":"1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":15827},{"type":"v1","addr":"172.21.15.78:6801","nonce":15827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":15827},{"type":"v1","addr":"172.21.15.78:6803","nonce":15827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":15827},{"type":"v1","addr":"172.21.15.78:6807","nonce":15827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":15827},{"type":"v1","addr":"172.21.15.78:6805","nonce":15827}]},"public_addr":"172.21.15.78:6801/15827","cluster_addr":"172.21.15.78:6803/15827","heartbeat_back_addr":"172.21.15.78:6807/15827","heartbeat_front_addr":"172.21.15.78:6805/15827","state":["exists","up"]},{"osd":6,"uuid":"4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":15825},{"type":"v1","addr":"172.21.15.78:6809","nonce":15825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":15825},{"type":"v1","addr":"172.21.15.78:6811","nonce":15825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":15825},{"type":"v1","addr":"172.21.15.78:6815","nonce":15825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":15825},{"type":"v1","addr":"172.21.15.78:6813","nonce":15825}]},"public_addr":"172.21.15.78:6809/15825","cluster_addr":"172.21.15.78:6811/15825","heartbeat_back_addr":"172.21.15.78:6815/15825","heartbeat_front_addr":"172.21.15.78:6813/15825","state":["exists","up"]},{"osd":7,"uuid":"851aeaf3-bcdc-4ac6-b578-c42e1bf87c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":15828},{"type":"v1","addr":"172.21.15.78:6825","nonce":15828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":15828},{"type":"v1","addr":"172.21.15.78:6827","nonce":15828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":15828},{"type":"v1","addr":"172.21.15.78:6831","nonce":15828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":15828},{"type":"v1","addr":"172.21.15.78:6829","nonce":15828}]},"public_addr":"172.21.15.78:6825/15828","cluster_addr":"172.21.15.78:6827/15828","heartbeat_back_addr":"172.21.15.78:6831/15828","heartbeat_front_addr":"172.21.15.78:6829/15828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.573930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.718144+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.641838+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.551598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.374444+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.171108+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.360910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.356020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6837/1117292103":"2021-01-28T09:51:48.650615+0000","172.21.15.78:6836/1117292103":"2021-01-28T09:51:48.650615+0000","172.21.15.146:6835/1106324127":"2021-01-28T09:49:18.611057+0000","172.21.15.146:6833/1106324127":"2021-01-28T09:49:18.611057+0000","172.21.15.146:6837/745099427":"2021-01-28T09:46:58.569668+0000","172.21.15.146:6836/745099427":"2021-01-28T09:46:58.569668+0000"},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:53:16.618 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.614+0000 7efe974b3700 1 -- 172.21.15.146:0/3756060524 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7efe78056260 msgr2=0x7efe78058720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:16.619 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.614+0000 7efe974b3700 1 --2- 172.21.15.146:0/3756060524 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7efe78056260 0x7efe78058720 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7efe88007fd0 tx=0x7efe88009040).stop 2021-01-27T09:53:16.619 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.614+0000 7efe974b3700 1 -- 172.21.15.146:0/3756060524 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efe900bd190 msgr2=0x7efe9014e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:16.619 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.614+0000 7efe974b3700 1 --2- 172.21.15.146:0/3756060524 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efe900bd190 0x7efe9014e010 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7efe8c010000 tx=0x7efe8c016000).stop 2021-01-27T09:53:16.624 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.618+0000 7efe974b3700 1 -- 172.21.15.146:0/3756060524 shutdown_connections 2021-01-27T09:53:16.625 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.618+0000 7efe974b3700 1 --2- 172.21.15.146:0/3756060524 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efe900bd190 0x7efe9014e010 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:16.626 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.618+0000 7efe974b3700 1 --2- 172.21.15.146:0/3756060524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe900652e0 0x7efe9014db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:53:16.626 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.618+0000 7efe974b3700 1 --2- 172.21.15.146:0/3756060524 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7efe78056260 0x7efe78058720 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:16.627 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.618+0000 7efe974b3700 1 --2- 172.21.15.146:0/3756060524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe90064f00 0x7efe9014ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:16.627 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.618+0000 7efe974b3700 1 -- 172.21.15.146:0/3756060524 >> 172.21.15.146:0/3756060524 conn(0x7efe90060a30 msgr2=0x7efe90150900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:16.627 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.618+0000 7efe974b3700 1 -- 172.21.15.146:0/3756060524 shutdown_connections 2021-01-27T09:53:16.627 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.618+0000 7efe974b3700 1 -- 172.21.15.146:0/3756060524 wait complete. 2021-01-27T09:53:16.672 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-01-27T09:53:16.976 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.970+0000 7f3d21a24700 1 Processor -- start 2021-01-27T09:53:16.976 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.970+0000 7f3d21a24700 1 -- start start 2021-01-27T09:53:16.982 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.978+0000 7f3d21a24700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3d14050380 0x7f3d1404fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:16.983 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.978+0000 7f3d21a24700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d140df6d0 0x7f3d140dfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:16.984 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.978+0000 7f3d21a24700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d140e0050 con 0x7f3d1404f780 2021-01-27T09:53:16.985 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.978+0000 7f3d21a24700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d140359b0 con 0x7f3d14050380 2021-01-27T09:53:16.985 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.978+0000 7f3d21a24700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d140deb00 con 0x7f3d140df6d0 2021-01-27T09:53:16.985 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.978+0000 7f3d20a22700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3d1404f780 0x7f3d140dd6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:42868/0 (socket says 172.21.15.146:42868) 2021-01-27T09:53:16.986 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.978+0000 7f3d20a22700 1 -- 172.21.15.146:0/923899200 learned_addr learned my addr 172.21.15.146:0/923899200 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:53:16.986 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.978+0000 7f3d21223700 1 --2- 172.21.15.146:0/923899200 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d140df6d0 0x7f3d140dfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:16.987 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.978+0000 7f3d1bfff700 1 --2- 172.21.15.146:0/923899200 >> v2:172.21.15.78:3300/0 conn(0x7f3d14050380 0x7f3d1404fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:16.987 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.978+0000 7f3d21223700 1 -- 172.21.15.146:0/923899200 >> v2:172.21.15.78:3300/0 conn(0x7f3d14050380 msgr2=0x7f3d1404fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:53:16.987 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.978+0000 7f3d21223700 1 --2- 172.21.15.146:0/923899200 >> v2:172.21.15.78:3300/0 conn(0x7f3d14050380 0x7f3d1404fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:16.987 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.978+0000 7f3d21223700 1 -- 172.21.15.146:0/923899200 >> v1:172.21.15.78:6789/0 conn(0x7f3d1404f780 legacy=0x7f3d140dd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:16.988 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.978+0000 7f3d21223700 1 -- 172.21.15.146:0/923899200 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d140de1b0 con 0x7f3d140df6d0 2021-01-27T09:53:16.989 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.978+0000 7f3d21223700 1 --2- 172.21.15.146:0/923899200 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d140df6d0 0x7f3d140dfb60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f3d1c05edb0 tx=0x7f3d1c05f7d0).ready entity=mon.2 client_cookie=9083ffb052019a4d server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:16.993 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.982+0000 7f3d1b7fe700 1 -- 172.21.15.146:0/923899200 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c0454c0 con 0x7f3d140df6d0 2021-01-27T09:53:16.993 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.982+0000 7f3d1b7fe700 1 -- 172.21.15.146:0/923899200 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1c044c00 con 0x7f3d140df6d0 2021-01-27T09:53:16.993 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.986+0000 7f3d1b7fe700 1 -- 172.21.15.146:0/923899200 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c056ac0 con 0x7f3d140df6d0 2021-01-27T09:53:16.993 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.986+0000 7f3d21a24700 1 -- 172.21.15.146:0/923899200 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d140df6d0 msgr2=0x7f3d140dfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:16.994 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.986+0000 7f3d21a24700 1 --2- 172.21.15.146:0/923899200 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d140df6d0 0x7f3d140dfb60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f3d1c05edb0 tx=0x7f3d1c05f7d0).stop 2021-01-27T09:53:17.001 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.994+0000 7f3d21a24700 1 -- 172.21.15.146:0/923899200 shutdown_connections 2021-01-27T09:53:17.001 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.994+0000 7f3d21a24700 1 --2- 172.21.15.146:0/923899200 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d140df6d0 0x7f3d140dfb60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:17.002 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.994+0000 7f3d21a24700 1 --2- 172.21.15.146:0/923899200 >> v2:172.21.15.78:3300/0 conn(0x7f3d14050380 0x7f3d1404fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:17.002 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.994+0000 7f3d21a24700 1 -- 172.21.15.146:0/923899200 >> 172.21.15.146:0/923899200 conn(0x7f3d14006e60 msgr2=0x7f3d14007240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:17.002 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.994+0000 7f3d21a24700 1 -- 172.21.15.146:0/923899200 shutdown_connections 2021-01-27T09:53:17.002 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:16.994+0000 7f3d21a24700 1 -- 172.21.15.146:0/923899200 wait complete. 2021-01-27T09:53:17.006 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.002+0000 7f3d21a24700 1 Processor -- start 2021-01-27T09:53:17.007 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.002+0000 7f3d21a24700 1 -- start start 2021-01-27T09:53:17.008 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.002+0000 7f3d21a24700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d1404f780 0x7f3d140ddb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:17.009 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.002+0000 7f3d21a24700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d14050380 0x7f3d1404e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:17.010 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.002+0000 7f3d21a24700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d140df6d0 0x7f3d140308b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:17.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.006+0000 7f3d20a22700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d1404f780 0x7f3d140ddb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:17.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.006+0000 7f3d21a24700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d140dc9f0 con 0x7f3d140df6d0 2021-01-27T09:53:17.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.006+0000 7f3d21a24700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d140ed560 con 0x7f3d1404f780 2021-01-27T09:53:17.012 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.006+0000 7f3d20a22700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d1404f780 0x7f3d140ddb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55268/0 (socket says 172.21.15.146:55268) 2021-01-27T09:53:17.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.006+0000 7f3d20a22700 1 -- 172.21.15.146:0/4157803485 learned_addr learned my addr 172.21.15.146:0/4157803485 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:17.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.006+0000 7f3d21a24700 1 -- 172.21.15.146:0/4157803485 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d140ed800 con 0x7f3d14050380 2021-01-27T09:53:17.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.006+0000 7f3d21223700 1 --2- 172.21.15.146:0/4157803485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d140df6d0 0x7f3d140308b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:17.013 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.006+0000 7f3d21223700 1 -- 172.21.15.146:0/4157803485 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d14050380 msgr2=0x7f3d1404e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:17.014 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.006+0000 7f3d1bfff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d14050380 0x7f3d1404e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:17.014 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.010+0000 7f3d21223700 1 --2- 172.21.15.146:0/4157803485 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d14050380 0x7f3d1404e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:17.014 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.010+0000 7f3d21223700 1 -- 172.21.15.146:0/4157803485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d1404f780 msgr2=0x7f3d140ddb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:17.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.010+0000 7f3d21223700 1 --2- 172.21.15.146:0/4157803485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d1404f780 0x7f3d140ddb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:17.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.010+0000 7f3d21223700 1 -- 172.21.15.146:0/4157803485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d140dcc50 con 0x7f3d140df6d0 2021-01-27T09:53:17.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.010+0000 7f3d20a22700 1 --2- 172.21.15.146:0/4157803485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d1404f780 0x7f3d140ddb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:53:17.015 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.010+0000 7f3d21223700 1 --2- 172.21.15.146:0/4157803485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d140df6d0 0x7f3d140308b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f3d1c06fdd0 tx=0x7f3d1c085000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:17.016 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.010+0000 7f3d1bfff700 1 --2- 172.21.15.146:0/4157803485 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d14050380 0x7f3d1404e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:53:17.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.010+0000 7f3d18ff9700 1 -- 172.21.15.146:0/4157803485 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c062680 con 0x7f3d140df6d0 2021-01-27T09:53:17.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.010+0000 7f3d18ff9700 1 -- 172.21.15.146:0/4157803485 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1c08f070 con 0x7f3d140df6d0 2021-01-27T09:53:17.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.010+0000 7f3d18ff9700 1 -- 172.21.15.146:0/4157803485 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c056ac0 con 0x7f3d140df6d0 2021-01-27T09:53:17.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.014+0000 7f3d21a24700 1 -- 172.21.15.146:0/4157803485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d140314d0 con 0x7f3d140df6d0 2021-01-27T09:53:17.018 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.014+0000 7f3d21a24700 1 -- 172.21.15.146:0/4157803485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d14033810 con 0x7f3d140df6d0 2021-01-27T09:53:17.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.014+0000 7f3d21a24700 1 -- 172.21.15.146:0/4157803485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d140051a0 con 0x7f3d140df6d0 2021-01-27T09:53:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.018+0000 7f3d18ff9700 1 -- 172.21.15.146:0/4157803485 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f3d1c09b070 con 0x7f3d140df6d0 2021-01-27T09:53:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.018+0000 7f3d18ff9700 1 --2- 172.21.15.146:0/4157803485 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f3d000563e0 0x7f3d000588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.018+0000 7f3d18ff9700 1 -- 172.21.15.146:0/4157803485 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7f3d1c0e1bb0 con 0x7f3d140df6d0 2021-01-27T09:53:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.018+0000 7f3d20a22700 1 --2- 172.21.15.146:0/4157803485 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f3d000563e0 0x7f3d000588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.022+0000 7f3d20a22700 1 --2- 172.21.15.146:0/4157803485 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f3d000563e0 0x7f3d000588a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f3d08007fd0 tx=0x7f3d08009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:17.031 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.026+0000 7f3d18ff9700 1 -- 172.21.15.146:0/4157803485 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f3d1c0b7d10 con 0x7f3d140df6d0 2021-01-27T09:53:17.310 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.306+0000 7f3d21a24700 1 -- 172.21.15.146:0/4157803485 --> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d140dcde0 con 0x7f3d000563e0 2021-01-27T09:53:17.320 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.314+0000 7f3d18ff9700 1 -- 172.21.15.146:0/4157803485 <== mgr.4104 v2:172.21.15.78:6832/15486 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+125711 (secure 0 0 0) 0x7f3d140dcde0 con 0x7f3d000563e0 2021-01-27T09:53:17.323 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:53:17.324 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.318+0000 7f3d21a24700 1 -- 172.21.15.146:0/4157803485 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f3d000563e0 msgr2=0x7f3d000588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:17.325 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.318+0000 7f3d21a24700 1 --2- 172.21.15.146:0/4157803485 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f3d000563e0 0x7f3d000588a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f3d08007fd0 tx=0x7f3d08009040).stop 2021-01-27T09:53:17.325 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.318+0000 7f3d21a24700 1 -- 172.21.15.146:0/4157803485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d140df6d0 msgr2=0x7f3d140308b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:17.325 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.318+0000 7f3d21a24700 1 --2- 172.21.15.146:0/4157803485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d140df6d0 0x7f3d140308b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f3d1c06fdd0 tx=0x7f3d1c085000).stop 2021-01-27T09:53:17.325 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.318+0000 7f3d21a24700 1 -- 172.21.15.146:0/4157803485 shutdown_connections 2021-01-27T09:53:17.326 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.318+0000 7f3d21a24700 1 --2- 172.21.15.146:0/4157803485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d140df6d0 0x7f3d140308b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:17.326 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.318+0000 7f3d21a24700 1 --2- 172.21.15.146:0/4157803485 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d14050380 0x7f3d1404e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:17.326 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.318+0000 7f3d21a24700 1 --2- 172.21.15.146:0/4157803485 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f3d000563e0 0x7f3d000588a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:17.326 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.318+0000 7f3d21a24700 1 --2- 172.21.15.146:0/4157803485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d1404f780 0x7f3d140ddb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:17.326 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.318+0000 7f3d21a24700 1 -- 172.21.15.146:0/4157803485 >> 172.21.15.146:0/4157803485 conn(0x7f3d14006e60 msgr2=0x7f3d140db530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:17.327 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.322+0000 7f3d21a24700 1 -- 172.21.15.146:0/4157803485 shutdown_connections 2021-01-27T09:53:17.327 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.322+0000 7f3d21a24700 1 -- 172.21.15.146:0/4157803485 wait complete. 2021-01-27T09:53:17.328 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2021-01-27T09:53:17.356 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2021-01-27T09:53:16.596100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":13368817155,"num_objects":3358,"num_object_clones":0,"num_object_copies":13286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3358,"num_whiteouts":0,"num_read":328,"num_read_kb":6054,"num_write":732045,"num_write_kb":17294688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54099,"ondisk_log_size":54099,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":27976796,"kb_used_data":26110108,"kb_used_omap":0,"kb_used_meta":1866624,"kb_avail":726997924,"statfs":{"total":773094113280,"available":744445874176,"internally_reserved":0,"allocated":26736750592,"data_stored":26735229315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1911422976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":140,"apply_latency_ms":140,"commit_latency_ns":140000000,"apply_latency_ns":140000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-62281607,"num_objects":-15,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003932"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"19","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.715453+0000","last_change":"2021-01-27T09:44:26.437753+0000","last_active":"2021-01-27T09:49:18.715453+0000","last_peered":"2021-01-27T09:49:18.715453+0000","last_clean":"2021-01-27T09:49:18.715453+0000","last_became_active":"2021-01-27T09:44:26.437402+0000","last_became_peered":"2021-01-27T09:44:26.437402+0000","last_unstale":"2021-01-27T09:49:18.715453+0000","last_undegraded":"2021-01-27T09:49:18.715453+0000","last_fullsized":"2021-01-27T09:49:18.715453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"29'55","reported_seq":"76","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:02.032917+0000","last_change":"2021-01-27T09:44:28.931645+0000","last_active":"2021-01-27T09:53:02.032917+0000","last_peered":"2021-01-27T09:53:02.032917+0000","last_clean":"2021-01-27T09:53:02.032917+0000","last_became_active":"2021-01-27T09:44:28.931347+0000","last_became_peered":"2021-01-27T09:44:28.931347+0000","last_unstale":"2021-01-27T09:53:02.032917+0000","last_undegraded":"2021-01-27T09:53:02.032917+0000","last_fullsized":"2021-01-27T09:53:02.032917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":55,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":13,"num_write":106,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"26'26","reported_seq":"41","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.716279+0000","last_change":"2021-01-27T09:44:29.336652+0000","last_active":"2021-01-27T09:49:18.716279+0000","last_peered":"2021-01-27T09:49:18.716279+0000","last_clean":"2021-01-27T09:49:18.716279+0000","last_became_active":"2021-01-27T09:44:29.336207+0000","last_became_peered":"2021-01-27T09:44:29.336207+0000","last_unstale":"2021-01-27T09:49:18.716279+0000","last_undegraded":"2021-01-27T09:49:18.716279+0000","last_fullsized":"2021-01-27T09:49:18.716279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"29'6358","reported_seq":"6390","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:52:52.819353+0000","last_change":"2021-01-27T09:44:33.381360+0000","last_active":"2021-01-27T09:52:52.819353+0000","last_peered":"2021-01-27T09:52:52.819353+0000","last_clean":"2021-01-27T09:52:52.819353+0000","last_became_active":"2021-01-27T09:44:33.380037+0000","last_became_peered":"2021-01-27T09:44:33.380037+0000","last_unstale":"2021-01-27T09:52:52.819353+0000","last_undegraded":"2021-01-27T09:52:52.819353+0000","last_fullsized":"2021-01-27T09:52:52.819353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":6358,"ondisk_log_size":6358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1652701170,"num_objects":404,"num_object_clones":0,"num_object_copies":1616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":404,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":90006,"num_write_kb":2139720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"20","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.710175+0000","last_change":"2021-01-27T09:44:26.436242+0000","last_active":"2021-01-27T09:49:18.710175+0000","last_peered":"2021-01-27T09:49:18.710175+0000","last_clean":"2021-01-27T09:49:18.710175+0000","last_became_active":"2021-01-27T09:44:26.435467+0000","last_became_peered":"2021-01-27T09:44:26.435467+0000","last_unstale":"2021-01-27T09:49:18.710175+0000","last_undegraded":"2021-01-27T09:49:18.710175+0000","last_fullsized":"2021-01-27T09:49:18.710175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'77","reported_seq":"104","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:11.656201+0000","last_change":"2021-01-27T09:44:28.934250+0000","last_active":"2021-01-27T09:53:11.656201+0000","last_peered":"2021-01-27T09:53:11.656201+0000","last_clean":"2021-01-27T09:53:11.656201+0000","last_became_active":"2021-01-27T09:44:28.933897+0000","last_became_peered":"2021-01-27T09:44:28.933897+0000","last_unstale":"2021-01-27T09:53:11.656201+0000","last_undegraded":"2021-01-27T09:53:11.656201+0000","last_fullsized":"2021-01-27T09:53:11.656201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":666,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":24,"num_read_kb":26,"num_write":112,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"26'23","reported_seq":"39","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.710707+0000","last_change":"2021-01-27T09:44:29.341412+0000","last_active":"2021-01-27T09:49:18.710707+0000","last_peered":"2021-01-27T09:49:18.710707+0000","last_clean":"2021-01-27T09:49:18.710707+0000","last_became_active":"2021-01-27T09:44:29.341016+0000","last_became_peered":"2021-01-27T09:44:29.341016+0000","last_unstale":"2021-01-27T09:49:18.710707+0000","last_undegraded":"2021-01-27T09:49:18.710707+0000","last_fullsized":"2021-01-27T09:49:18.710707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"29'7131","reported_seq":"7179","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:15.267012+0000","last_change":"2021-01-27T09:44:33.378505+0000","last_active":"2021-01-27T09:53:15.267012+0000","last_peered":"2021-01-27T09:53:15.267012+0000","last_clean":"2021-01-27T09:53:15.267012+0000","last_became_active":"2021-01-27T09:44:33.377285+0000","last_became_peered":"2021-01-27T09:44:33.377285+0000","last_unstale":"2021-01-27T09:53:15.267012+0000","last_undegraded":"2021-01-27T09:53:15.267012+0000","last_fullsized":"2021-01-27T09:53:15.267012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":7131,"ondisk_log_size":7131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1782782609,"num_objects":435,"num_object_clones":0,"num_object_copies":1740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":435,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":100515,"num_write_kb":2356202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"19","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.715278+0000","last_change":"2021-01-27T09:44:25.841172+0000","last_active":"2021-01-27T09:49:18.715278+0000","last_peered":"2021-01-27T09:49:18.715278+0000","last_clean":"2021-01-27T09:49:18.715278+0000","last_became_active":"2021-01-27T09:44:25.840711+0000","last_became_peered":"2021-01-27T09:44:25.840711+0000","last_unstale":"2021-01-27T09:49:18.715278+0000","last_undegraded":"2021-01-27T09:49:18.715278+0000","last_fullsized":"2021-01-27T09:49:18.715278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'900","reported_seq":"926","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:52:47.031747+0000","last_change":"2021-01-27T09:44:28.932871+0000","last_active":"2021-01-27T09:52:47.031747+0000","last_peered":"2021-01-27T09:52:47.031747+0000","last_clean":"2021-01-27T09:52:47.031747+0000","last_became_active":"2021-01-27T09:44:28.932513+0000","last_became_peered":"2021-01-27T09:44:28.932513+0000","last_unstale":"2021-01-27T09:52:47.031747+0000","last_undegraded":"2021-01-27T09:52:47.031747+0000","last_fullsized":"2021-01-27T09:52:47.031747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4195502,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":17,"num_read_kb":4112,"num_write":904,"num_write_kb":4327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"26'36","reported_seq":"52","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.640563+0000","last_change":"2021-01-27T09:44:29.350508+0000","last_active":"2021-01-27T09:49:18.640563+0000","last_peered":"2021-01-27T09:49:18.640563+0000","last_clean":"2021-01-27T09:49:18.640563+0000","last_became_active":"2021-01-27T09:44:29.350179+0000","last_became_peered":"2021-01-27T09:44:29.350179+0000","last_unstale":"2021-01-27T09:49:18.640563+0000","last_undegraded":"2021-01-27T09:49:18.640563+0000","last_fullsized":"2021-01-27T09:49:18.640563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":36,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"29'6547","reported_seq":"6581","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:52:57.586442+0000","last_change":"2021-01-27T09:44:33.441051+0000","last_active":"2021-01-27T09:52:57.586442+0000","last_peered":"2021-01-27T09:52:57.586442+0000","last_clean":"2021-01-27T09:52:57.586442+0000","last_became_active":"2021-01-27T09:44:33.439809+0000","last_became_peered":"2021-01-27T09:44:33.439809+0000","last_unstale":"2021-01-27T09:52:57.586442+0000","last_undegraded":"2021-01-27T09:52:57.586442+0000","last_fullsized":"2021-01-27T09:52:57.586442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":6547,"ondisk_log_size":6547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1716278699,"num_objects":423,"num_object_clones":0,"num_object_copies":1692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":423,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":91937,"num_write_kb":2198460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"20","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.639026+0000","last_change":"2021-01-27T09:44:26.405089+0000","last_active":"2021-01-27T09:49:18.639026+0000","last_peered":"2021-01-27T09:49:18.639026+0000","last_clean":"2021-01-27T09:49:18.639026+0000","last_became_active":"2021-01-27T09:44:26.403537+0000","last_became_peered":"2021-01-27T09:44:26.403537+0000","last_unstale":"2021-01-27T09:49:18.639026+0000","last_undegraded":"2021-01-27T09:49:18.639026+0000","last_fullsized":"2021-01-27T09:49:18.639026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"29'26","reported_seq":"48","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:14.739429+0000","last_change":"2021-01-27T09:44:28.932480+0000","last_active":"2021-01-27T09:53:14.739429+0000","last_peered":"2021-01-27T09:53:14.739429+0000","last_clean":"2021-01-27T09:53:14.739429+0000","last_became_active":"2021-01-27T09:44:28.932127+0000","last_became_peered":"2021-01-27T09:44:28.932127+0000","last_unstale":"2021-01-27T09:53:14.739429+0000","last_undegraded":"2021-01-27T09:53:14.739429+0000","last_fullsized":"2021-01-27T09:53:14.739429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":736,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":14,"num_read_kb":20,"num_write":22,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"26'28","reported_seq":"44","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.640486+0000","last_change":"2021-01-27T09:44:29.338414+0000","last_active":"2021-01-27T09:49:18.640486+0000","last_peered":"2021-01-27T09:49:18.640486+0000","last_clean":"2021-01-27T09:49:18.640486+0000","last_became_active":"2021-01-27T09:44:29.337813+0000","last_became_peered":"2021-01-27T09:44:29.337813+0000","last_unstale":"2021-01-27T09:49:18.640486+0000","last_undegraded":"2021-01-27T09:49:18.640486+0000","last_fullsized":"2021-01-27T09:49:18.640486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"29'6807","reported_seq":"6844","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:52:54.495174+0000","last_change":"2021-01-27T09:44:33.442248+0000","last_active":"2021-01-27T09:52:54.495174+0000","last_peered":"2021-01-27T09:52:54.495174+0000","last_clean":"2021-01-27T09:52:54.495174+0000","last_became_active":"2021-01-27T09:44:33.440410+0000","last_became_peered":"2021-01-27T09:44:33.440410+0000","last_unstale":"2021-01-27T09:52:54.495174+0000","last_undegraded":"2021-01-27T09:52:54.495174+0000","last_fullsized":"2021-01-27T09:52:54.495174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":6807,"ondisk_log_size":6807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1736577755,"num_objects":427,"num_object_clones":0,"num_object_copies":1708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":427,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":95694,"num_write_kb":2240389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"29'6331","reported_seq":"6367","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:52:55.521976+0000","last_change":"2021-01-27T09:44:33.441395+0000","last_active":"2021-01-27T09:52:55.521976+0000","last_peered":"2021-01-27T09:52:55.521976+0000","last_clean":"2021-01-27T09:52:55.521976+0000","last_became_active":"2021-01-27T09:44:33.440377+0000","last_became_peered":"2021-01-27T09:44:33.440377+0000","last_unstale":"2021-01-27T09:52:55.521976+0000","last_undegraded":"2021-01-27T09:52:55.521976+0000","last_fullsized":"2021-01-27T09:52:55.521976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":6331,"ondisk_log_size":6331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1653024397,"num_objects":407,"num_object_clones":0,"num_object_copies":1628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":407,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":89342,"num_write_kb":2125206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"29'734","reported_seq":"759","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:12.021790+0000","last_change":"2021-01-27T09:44:28.929059+0000","last_active":"2021-01-27T09:53:12.021790+0000","last_peered":"2021-01-27T09:53:12.021790+0000","last_clean":"2021-01-27T09:53:12.021790+0000","last_became_active":"2021-01-27T09:44:28.928444+0000","last_became_peered":"2021-01-27T09:44:28.928444+0000","last_unstale":"2021-01-27T09:53:12.021790+0000","last_undegraded":"2021-01-27T09:53:12.021790+0000","last_fullsized":"2021-01-27T09:53:12.021790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":734,"ondisk_log_size":734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2784647,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":16,"num_read_kb":1577,"num_write":734,"num_write_kb":2961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"19","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.715153+0000","last_change":"2021-01-27T09:44:26.403671+0000","last_active":"2021-01-27T09:49:18.715153+0000","last_peered":"2021-01-27T09:49:18.715153+0000","last_clean":"2021-01-27T09:49:18.715153+0000","last_became_active":"2021-01-27T09:44:26.403137+0000","last_became_peered":"2021-01-27T09:44:26.403137+0000","last_unstale":"2021-01-27T09:49:18.715153+0000","last_undegraded":"2021-01-27T09:49:18.715153+0000","last_fullsized":"2021-01-27T09:49:18.715153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"26'30","reported_seq":"46","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.640560+0000","last_change":"2021-01-27T09:44:29.347824+0000","last_active":"2021-01-27T09:49:18.640560+0000","last_peered":"2021-01-27T09:49:18.640560+0000","last_clean":"2021-01-27T09:49:18.640560+0000","last_became_active":"2021-01-27T09:44:29.347463+0000","last_became_peered":"2021-01-27T09:44:29.347463+0000","last_unstale":"2021-01-27T09:49:18.640560+0000","last_undegraded":"2021-01-27T09:49:18.640560+0000","last_fullsized":"2021-01-27T09:49:18.640560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"29'6319","reported_seq":"6350","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:52:55.706597+0000","last_change":"2021-01-27T09:44:33.441988+0000","last_active":"2021-01-27T09:52:55.706597+0000","last_peered":"2021-01-27T09:52:55.706597+0000","last_clean":"2021-01-27T09:52:55.706597+0000","last_became_active":"2021-01-27T09:44:33.440172+0000","last_became_peered":"2021-01-27T09:44:33.440172+0000","last_unstale":"2021-01-27T09:52:55.706597+0000","last_undegraded":"2021-01-27T09:52:55.706597+0000","last_fullsized":"2021-01-27T09:52:55.706597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":6319,"ondisk_log_size":6319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1615171988,"num_objects":400,"num_object_clones":0,"num_object_copies":1600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":400,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":88475,"num_write_kb":2080841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"28'25","reported_seq":"54","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:51:57.710354+0000","last_change":"2021-01-27T09:44:28.930780+0000","last_active":"2021-01-27T09:51:57.710354+0000","last_peered":"2021-01-27T09:51:57.710354+0000","last_clean":"2021-01-27T09:51:57.710354+0000","last_became_active":"2021-01-27T09:44:28.930374+0000","last_became_peered":"2021-01-27T09:44:28.930374+0000","last_unstale":"2021-01-27T09:51:57.710354+0000","last_undegraded":"2021-01-27T09:51:57.710354+0000","last_fullsized":"2021-01-27T09:51:57.710354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":112,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"20","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.692844+0000","last_change":"2021-01-27T09:44:25.838965+0000","last_active":"2021-01-27T09:49:18.692844+0000","last_peered":"2021-01-27T09:49:18.692844+0000","last_clean":"2021-01-27T09:49:18.692844+0000","last_became_active":"2021-01-27T09:44:25.838635+0000","last_became_peered":"2021-01-27T09:44:25.838635+0000","last_unstale":"2021-01-27T09:49:18.692844+0000","last_undegraded":"2021-01-27T09:49:18.692844+0000","last_fullsized":"2021-01-27T09:49:18.692844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"26'28","reported_seq":"44","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.640657+0000","last_change":"2021-01-27T09:44:29.348218+0000","last_active":"2021-01-27T09:49:18.640657+0000","last_peered":"2021-01-27T09:49:18.640657+0000","last_clean":"2021-01-27T09:49:18.640657+0000","last_became_active":"2021-01-27T09:44:29.347905+0000","last_became_peered":"2021-01-27T09:44:29.347905+0000","last_unstale":"2021-01-27T09:49:18.640657+0000","last_undegraded":"2021-01-27T09:49:18.640657+0000","last_fullsized":"2021-01-27T09:49:18.640657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"29'6256","reported_seq":"6288","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:15.063294+0000","last_change":"2021-01-27T09:44:33.378828+0000","last_active":"2021-01-27T09:53:15.063294+0000","last_peered":"2021-01-27T09:53:15.063294+0000","last_clean":"2021-01-27T09:53:15.063294+0000","last_became_active":"2021-01-27T09:44:33.376984+0000","last_became_peered":"2021-01-27T09:44:33.376984+0000","last_unstale":"2021-01-27T09:53:15.063294+0000","last_undegraded":"2021-01-27T09:53:15.063294+0000","last_fullsized":"2021-01-27T09:53:15.063294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":6256,"ondisk_log_size":6256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1631747011,"num_objects":402,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":402,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":88102,"num_write_kb":2116621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'183","reported_seq":"225","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:11.679089+0000","last_change":"2021-01-27T09:44:28.933091+0000","last_active":"2021-01-27T09:53:11.679089+0000","last_peered":"2021-01-27T09:53:11.679089+0000","last_clean":"2021-01-27T09:53:11.679089+0000","last_became_active":"2021-01-27T09:44:28.932701+0000","last_became_peered":"2021-01-27T09:44:28.932701+0000","last_unstale":"2021-01-27T09:53:11.679089+0000","last_undegraded":"2021-01-27T09:53:11.679089+0000","last_fullsized":"2021-01-27T09:53:11.679089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":183,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":536343,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":35,"num_read_kb":272,"num_write":183,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"19","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.714297+0000","last_change":"2021-01-27T09:44:25.737081+0000","last_active":"2021-01-27T09:49:18.714297+0000","last_peered":"2021-01-27T09:49:18.714297+0000","last_clean":"2021-01-27T09:49:18.714297+0000","last_became_active":"2021-01-27T09:44:25.736516+0000","last_became_peered":"2021-01-27T09:44:25.736516+0000","last_unstale":"2021-01-27T09:49:18.714297+0000","last_undegraded":"2021-01-27T09:49:18.714297+0000","last_fullsized":"2021-01-27T09:49:18.714297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"26'31","reported_seq":"47","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.639085+0000","last_change":"2021-01-27T09:44:29.347815+0000","last_active":"2021-01-27T09:49:18.639085+0000","last_peered":"2021-01-27T09:49:18.639085+0000","last_clean":"2021-01-27T09:49:18.639085+0000","last_became_active":"2021-01-27T09:44:29.347415+0000","last_became_peered":"2021-01-27T09:44:29.347415+0000","last_unstale":"2021-01-27T09:49:18.639085+0000","last_undegraded":"2021-01-27T09:49:18.639085+0000","last_fullsized":"2021-01-27T09:49:18.639085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"29'6082","reported_seq":"6121","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:52:56.654691+0000","last_change":"2021-01-27T09:44:33.436705+0000","last_active":"2021-01-27T09:52:56.654691+0000","last_peered":"2021-01-27T09:52:56.654691+0000","last_clean":"2021-01-27T09:52:56.654691+0000","last_became_active":"2021-01-27T09:44:33.435975+0000","last_became_peered":"2021-01-27T09:44:33.435975+0000","last_unstale":"2021-01-27T09:52:56.654691+0000","last_undegraded":"2021-01-27T09:52:56.654691+0000","last_fullsized":"2021-01-27T09:52:56.654691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":6082,"ondisk_log_size":6082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1573015520,"num_objects":387,"num_object_clones":0,"num_object_copies":1548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":387,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":85821,"num_write_kb":2029152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'38","reported_seq":"57","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:01.246641+0000","last_change":"2021-01-27T09:44:28.930455+0000","last_active":"2021-01-27T09:53:01.246641+0000","last_peered":"2021-01-27T09:53:01.246641+0000","last_clean":"2021-01-27T09:53:01.246641+0000","last_became_active":"2021-01-27T09:44:28.930088+0000","last_became_peered":"2021-01-27T09:44:28.930088+0000","last_unstale":"2021-01-27T09:53:01.246641+0000","last_undegraded":"2021-01-27T09:53:01.246641+0000","last_fullsized":"2021-01-27T09:53:01.246641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":62,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"19","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.722361+0000","last_change":"2021-01-27T09:44:25.736301+0000","last_active":"2021-01-27T09:49:18.722361+0000","last_peered":"2021-01-27T09:49:18.722361+0000","last_clean":"2021-01-27T09:49:18.722361+0000","last_became_active":"2021-01-27T09:44:25.735741+0000","last_became_peered":"2021-01-27T09:44:25.735741+0000","last_unstale":"2021-01-27T09:49:18.722361+0000","last_undegraded":"2021-01-27T09:49:18.722361+0000","last_fullsized":"2021-01-27T09:49:18.722361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"23","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.724726+0000","last_change":"2021-01-27T09:44:24.570544+0000","last_active":"2021-01-27T09:49:18.724726+0000","last_peered":"2021-01-27T09:49:18.724726+0000","last_clean":"2021-01-27T09:49:18.724726+0000","last_became_active":"2021-01-27T09:44:24.569755+0000","last_became_peered":"2021-01-27T09:44:24.569755+0000","last_unstale":"2021-01-27T09:49:18.724726+0000","last_undegraded":"2021-01-27T09:49:18.724726+0000","last_fullsized":"2021-01-27T09:49:18.724726+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:19.429176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:19.429176+0000","last_clean_scrub_stamp":"2021-01-27T09:44:19.429176+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'26","reported_seq":"41","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:51:49.249172+0000","last_change":"2021-01-27T09:44:29.337716+0000","last_active":"2021-01-27T09:51:49.249172+0000","last_peered":"2021-01-27T09:51:49.249172+0000","last_clean":"2021-01-27T09:51:49.249172+0000","last_became_active":"2021-01-27T09:44:29.337355+0000","last_became_peered":"2021-01-27T09:44:29.337355+0000","last_unstale":"2021-01-27T09:51:49.249172+0000","last_undegraded":"2021-01-27T09:51:49.249172+0000","last_fullsized":"2021-01-27T09:51:49.249172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":8,"stat_sum":{"num_bytes":13361299149,"num_objects":3285,"num_object_clones":0,"num_object_copies":13140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3285,"num_whiteouts":0,"num_read":177,"num_read_kb":0,"num_write":729892,"num_write_kb":17286591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26547306496,"data_stored":26547306496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51831,"ondisk_log_size":51831,"up":32,"acting":32,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":7518006,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":151,"num_read_kb":6054,"num_write":2151,"num_write_kb":8087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15228928,"data_stored":15075892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2038,"ondisk_log_size":2038,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509548,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4408852,"kb_used_data":4121548,"kb_used_omap":0,"kb_used_meta":287296,"kb_avail":89962988,"statfs":{"total":96636764160,"available":92122099712,"internally_reserved":0,"allocated":4220465152,"data_stored":4220292534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":294191104},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:52:35 2021","interfaces":[{"interface":"back","average":{"1min":84.682000000000002,"5min":472.56400000000002,"15min":163.239},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":629.97500000000002,"5min":2294.9899999999998,"15min":2294.9899999999998},"last":1.829},{"interface":"front","average":{"1min":327.49400000000003,"5min":291.476,"15min":106.328},"min":{"1min":0.96899999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1240.673,"5min":1539.433,"15min":1539.433},"last":1.5860000000000001}]},{"osd":1,"last update":"Wed Jan 27 09:52:35 2021","interfaces":[{"interface":"back","average":{"1min":10.132,"5min":73.468999999999994,"15min":25.878},"min":{"1min":0.624,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":56.219000000000001,"5min":1524.269,"15min":1524.269},"last":1.7789999999999999},{"interface":"front","average":{"1min":55.095999999999997,"5min":216.88800000000001,"15min":74.480000000000004},"min":{"1min":0.70999999999999996,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":339.52100000000002,"5min":2197.2339999999999,"15min":2197.2339999999999},"last":2.9100000000000001}]},{"osd":2,"last update":"Wed Jan 27 09:52:35 2021","interfaces":[{"interface":"back","average":{"1min":54.962000000000003,"5min":212.346,"15min":72.885999999999996},"min":{"1min":0.95499999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":339.596,"5min":2294.8020000000001,"15min":2294.8020000000001},"last":2.1459999999999999},{"interface":"front","average":{"1min":10.414999999999999,"5min":76.203000000000003,"15min":27.359000000000002},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":63.506,"5min":1524.4739999999999,"15min":1524.4739999999999},"last":2.8540000000000001}]},{"osd":4,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":334.327,"5min":243.10900000000001,"15min":92.652000000000001},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1240.47,"5min":1386.115,"15min":1386.115},"last":3.585},{"interface":"front","average":{"1min":7.7119999999999997,"5min":125.717,"15min":44.113},"min":{"1min":1.0660000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":63.652999999999999,"5min":1524.7470000000001,"15min":1524.7470000000001},"last":2.6549999999999998}]},{"osd":5,"last update":"Wed Jan 27 09:52:35 2021","interfaces":[{"interface":"back","average":{"1min":10.07,"5min":75.977000000000004,"15min":27.399999999999999},"min":{"1min":1.028,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":63.901000000000003,"5min":1524.604,"15min":1524.604},"last":2.4830000000000001},{"interface":"front","average":{"1min":54.366999999999997,"5min":217.42699999999999,"15min":75.064999999999998},"min":{"1min":1.0740000000000001,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":339.96199999999999,"5min":2097.0590000000002,"15min":2097.0590000000002},"last":3.5230000000000001}]},{"osd":6,"last update":"Wed Jan 27 09:52:35 2021","interfaces":[{"interface":"back","average":{"1min":54.706000000000003,"5min":235.654,"15min":81.311999999999998},"min":{"1min":1.1930000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":340.03399999999999,"5min":2114.0410000000002,"15min":2114.0410000000002},"last":3.8199999999999998},{"interface":"front","average":{"1min":299.02999999999997,"5min":197.31899999999999,"15min":77.299999999999997},"min":{"1min":1.075,"5min":1.0549999999999999,"15min":1.0549999999999999},"max":{"1min":1240.5540000000001,"5min":1317.1679999999999,"15min":1317.1679999999999},"last":3.1960000000000002}]},{"osd":7,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":7.4909999999999997,"5min":190.19900000000001,"15min":74.959000000000003},"min":{"1min":1.2410000000000001,"5min":1.198,"15min":1.198},"max":{"1min":63.780000000000001,"5min":1801.5260000000001,"15min":1801.5260000000001},"last":3.0499999999999998},{"interface":"front","average":{"1min":7.8650000000000002,"5min":149.43000000000001,"15min":52.268999999999998},"min":{"1min":1.4750000000000001,"5min":1.427,"15min":1.427},"max":{"1min":64.024000000000001,"5min":1682.9359999999999,"15min":1682.9359999999999},"last":3.4529999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509549,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2711724,"kb_used_data":2525348,"kb_used_omap":0,"kb_used_meta":186368,"kb_avail":91660116,"statfs":{"total":96636764160,"available":93859958784,"internally_reserved":0,"allocated":2585956352,"data_stored":2585739475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":190840832},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":25.510999999999999,"5min":121.765,"15min":41.948},"min":{"1min":0.63,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":502.11900000000003,"5min":1480.2760000000001,"15min":1480.2760000000001},"last":12.869},{"interface":"front","average":{"1min":64.305999999999997,"5min":134.34800000000001,"15min":51.317},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":900.13300000000004,"5min":1730.1669999999999,"15min":1730.1669999999999},"last":2.2250000000000001}]},{"osd":1,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":2.8490000000000002,"5min":3.5899999999999999,"15min":3.0990000000000002},"min":{"1min":0.70999999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":15.544,"5min":29.736999999999998,"15min":29.736999999999998},"last":13.108000000000001},{"interface":"front","average":{"1min":3.0739999999999998,"5min":3.7989999999999999,"15min":2.891},"min":{"1min":0.79600000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":15.452999999999999,"5min":44.777999999999999,"15min":44.777999999999999},"last":12.042999999999999}]},{"osd":3,"last update":"Wed Jan 27 09:52:42 2021","interfaces":[{"interface":"back","average":{"1min":56.670000000000002,"5min":138.53700000000001,"15min":58.232999999999997},"min":{"1min":0.81699999999999995,"5min":0.753,"15min":0.753},"max":{"1min":503.72199999999998,"5min":1800.183,"15min":1800.183},"last":13.257999999999999},{"interface":"front","average":{"1min":186.88900000000001,"5min":217.07400000000001,"15min":79.460999999999999},"min":{"1min":0.93700000000000006,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":717.49800000000005,"5min":3309.5619999999999,"15min":3309.5619999999999},"last":2.1539999999999999}]},{"osd":4,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":1.9239999999999999,"5min":16.788,"15min":7.8230000000000004},"min":{"1min":1.0109999999999999,"5min":0.98099999999999998,"15min":0.88400000000000001},"max":{"1min":4.2859999999999996,"5min":291.916,"15min":291.916},"last":2.577},{"interface":"front","average":{"1min":2.2629999999999999,"5min":14.132,"15min":6.6920000000000002},"min":{"1min":1.091,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":5.3959999999999999,"5min":448.73200000000003,"15min":448.73200000000003},"last":1.8580000000000001}]},{"osd":5,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":2.2829999999999999,"5min":2.5110000000000001,"15min":2.7280000000000002},"min":{"1min":1.1679999999999999,"5min":0.94299999999999995,"15min":0.84299999999999997},"max":{"1min":4.9800000000000004,"5min":17.311,"15min":17.311},"last":2.077},{"interface":"front","average":{"1min":1.8049999999999999,"5min":2.6850000000000001,"15min":3.2589999999999999},"min":{"1min":1.016,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":3.3639999999999999,"5min":16.814,"15min":19.155999999999999},"last":17.167000000000002}]},{"osd":6,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":2.2959999999999998,"5min":2.6640000000000001,"15min":3.262},"min":{"1min":1.0649999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":5.1340000000000003,"5min":15.388999999999999,"15min":43.197000000000003},"last":11.897},{"interface":"front","average":{"1min":1.99,"5min":3.1120000000000001,"15min":3.0129999999999999},"min":{"1min":1.1839999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":3.6349999999999998,"5min":38.168999999999997,"15min":38.168999999999997},"last":17.524999999999999}]},{"osd":7,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":2.8010000000000002,"5min":98.846000000000004,"15min":35.628},"min":{"1min":1.7390000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"max":{"1min":8.3960000000000008,"5min":1464.1279999999999,"15min":1464.1279999999999},"last":12.441000000000001},{"interface":"front","average":{"1min":2.0880000000000001,"5min":89.135000000000005,"15min":32.567999999999998},"min":{"1min":1.1779999999999999,"5min":1.1659999999999999,"15min":1.123},"max":{"1min":4.7030000000000003,"5min":1081.211,"15min":1081.211},"last":17.673999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509549,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3328776,"kb_used_data":3099584,"kb_used_omap":0,"kb_used_meta":229184,"kb_avail":91043064,"statfs":{"total":96636764160,"available":93228097536,"internally_reserved":0,"allocated":3173974016,"data_stored":3173801398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":234684416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":3.4100000000000001,"5min":164.898,"15min":66.231999999999999},"min":{"1min":0.623,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":11.911,"5min":1471.8320000000001,"15min":1471.8320000000001},"last":1.4379999999999999},{"interface":"front","average":{"1min":3.2519999999999998,"5min":167.161,"15min":66.174999999999997},"min":{"1min":0.91900000000000004,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":13.644,"5min":1292.7439999999999,"15min":1292.7439999999999},"last":1.5049999999999999}]},{"osd":2,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":3.3149999999999999,"5min":7.3220000000000001,"15min":3.7250000000000001},"min":{"1min":0.68200000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":38.75,"5min":270.13200000000001,"15min":270.13200000000001},"last":1.5669999999999999},{"interface":"front","average":{"1min":4.0650000000000004,"5min":8.2029999999999994,"15min":4.5860000000000003},"min":{"1min":0.74299999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":38.798999999999999,"5min":275.97399999999999,"15min":275.97399999999999},"last":1.643}]},{"osd":3,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":54.905999999999999,"5min":202.47999999999999,"15min":76.338999999999999},"min":{"1min":1.006,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":836.53599999999994,"5min":1387.9079999999999,"15min":1387.9079999999999},"last":2.1030000000000002},{"interface":"front","average":{"1min":125.508,"5min":142.643,"15min":60.207000000000001},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79000000000000004},"max":{"1min":958.32299999999998,"5min":1852.193,"15min":1852.193},"last":1.897}]},{"osd":4,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":2.0129999999999999,"5min":33.369999999999997,"15min":12.941000000000001},"min":{"1min":0.98299999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":7.9109999999999996,"5min":1089.0440000000001,"15min":1089.0440000000001},"last":2.0409999999999999},{"interface":"front","average":{"1min":2.3839999999999999,"5min":15.292,"15min":7.5679999999999996},"min":{"1min":1.145,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":7.181,"5min":656.05499999999995,"15min":656.05499999999995},"last":2.6619999999999999}]},{"osd":5,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":2.8399999999999999,"5min":3.71,"15min":3.2530000000000001},"min":{"1min":0.95999999999999996,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":9.75,"5min":33.588000000000001,"15min":33.588000000000001},"last":2.5659999999999998},{"interface":"front","average":{"1min":2.5,"5min":3.464,"15min":3.266},"min":{"1min":1.04,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":13.391999999999999,"5min":25.948,"15min":25.948},"last":3.1379999999999999}]},{"osd":6,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":3.0830000000000002,"5min":3.8730000000000002,"15min":3.4049999999999998},"min":{"1min":1.127,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":9.8889999999999993,"5min":33.341999999999999,"15min":33.341999999999999},"last":2.6909999999999998},{"interface":"front","average":{"1min":2.609,"5min":3.5230000000000001,"15min":3.3969999999999998},"min":{"1min":1.2909999999999999,"5min":1.05,"15min":1.05},"max":{"1min":13.547000000000001,"5min":26.204999999999998,"15min":26.204999999999998},"last":3.3999999999999999}]},{"osd":7,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":3.4119999999999999,"5min":68.495999999999995,"15min":25.510000000000002},"min":{"1min":1.55,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":7.5910000000000002,"5min":1194.567,"15min":1194.567},"last":2.762},{"interface":"front","average":{"1min":3.0379999999999998,"5min":89.438999999999993,"15min":32.081000000000003},"min":{"1min":1.306,"5min":1.1499999999999999,"15min":1.1279999999999999},"max":{"1min":10.010999999999999,"5min":1655.51,"15min":1655.51},"last":3.0169999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509548,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4381740,"kb_used_data":4095716,"kb_used_omap":0,"kb_used_meta":286016,"kb_avail":89990100,"statfs":{"total":96636764160,"available":92149862400,"internally_reserved":0,"allocated":4194013184,"data_stored":4193830935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":292880384},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 27 09:52:40 2021","interfaces":[{"interface":"back","average":{"1min":22.449999999999999,"5min":141.71299999999999,"15min":48.68},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":277.43200000000002,"5min":1128.261,"15min":1128.261},"last":1.4550000000000001},{"interface":"front","average":{"1min":34.140999999999998,"5min":179.88200000000001,"15min":64.679000000000002},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":401.923,"5min":2237.944,"15min":2237.944},"last":1.383}]},{"osd":2,"last update":"Wed Jan 27 09:52:42 2021","interfaces":[{"interface":"back","average":{"1min":61.780999999999999,"5min":147.833,"15min":57.649999999999999},"min":{"1min":0.68100000000000005,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1004.691,"5min":1821.519,"15min":1821.519},"last":1.4279999999999999},{"interface":"front","average":{"1min":19.707000000000001,"5min":205.67400000000001,"15min":70.120000000000005},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":278.09699999999998,"5min":2749.7919999999999,"15min":2749.7919999999999},"last":2.0150000000000001}]},{"osd":3,"last update":"Wed Jan 27 09:52:42 2021","interfaces":[{"interface":"back","average":{"1min":4.2190000000000003,"5min":193.13800000000001,"15min":70.350999999999999},"min":{"1min":0.68999999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":16.309000000000001,"5min":2240.3739999999998,"15min":2240.3739999999998},"last":1.748},{"interface":"front","average":{"1min":4.6029999999999998,"5min":283.86399999999998,"15min":97.561000000000007},"min":{"1min":0.996,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":16.579000000000001,"5min":2588.5129999999999,"15min":2588.5129999999999},"last":2.0619999999999998}]},{"osd":4,"last update":"Wed Jan 27 09:52:42 2021","interfaces":[{"interface":"back","average":{"1min":19.523,"5min":161.06800000000001,"15min":56.033999999999999},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":277.84100000000001,"5min":1128.5070000000001,"15min":1128.5070000000001},"last":2.5870000000000002},{"interface":"front","average":{"1min":61.542000000000002,"5min":245.435,"15min":90.498999999999995},"min":{"1min":1.173,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":1004.8440000000001,"5min":2756.1100000000001,"15min":2756.1100000000001},"last":1.8109999999999999}]},{"osd":5,"last update":"Wed Jan 27 09:52:40 2021","interfaces":[{"interface":"back","average":{"1min":20.544,"5min":147.84899999999999,"15min":51.374000000000002},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":277.721,"5min":1821.7380000000001,"15min":1821.7380000000001},"last":2.7549999999999999},{"interface":"front","average":{"1min":31.109999999999999,"5min":202.053,"15min":76.144000000000005},"min":{"1min":1.2150000000000001,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":402.07600000000002,"5min":2219.1909999999998,"15min":2219.1909999999998},"last":2.8239999999999998}]},{"osd":6,"last update":"Wed Jan 27 09:52:40 2021","interfaces":[{"interface":"back","average":{"1min":33.002000000000002,"5min":142.47399999999999,"15min":56.292000000000002},"min":{"1min":1.4530000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"max":{"1min":402.32999999999998,"5min":2189.3180000000002,"15min":2189.3180000000002},"last":3.0609999999999999},{"interface":"front","average":{"1min":33.424999999999997,"5min":186.369,"15min":71.284999999999997},"min":{"1min":1.46,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":402.20699999999999,"5min":2219.4609999999998,"15min":2219.4609999999998},"last":2.4529999999999998}]},{"osd":7,"last update":"Wed Jan 27 09:52:42 2021","interfaces":[{"interface":"back","average":{"1min":65.573999999999998,"5min":231.77199999999999,"15min":79.620999999999995},"min":{"1min":1.169,"5min":1.121,"15min":1.121},"max":{"1min":1004.977,"5min":2750.0140000000001,"15min":2750.0140000000001},"last":2.496},{"interface":"front","average":{"1min":20.710000000000001,"5min":268.13099999999997,"15min":98.379999999999995},"min":{"1min":1.2430000000000001,"5min":1.228,"15min":1.228},"max":{"1min":277.96300000000002,"5min":3266.1680000000001,"15min":3266.1680000000001},"last":2.9159999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542251,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6103892,"kb_used_data":5707340,"kb_used_omap":0,"kb_used_meta":396544,"kb_avail":88267948,"statfs":{"total":96636764160,"available":90386378752,"internally_reserved":0,"allocated":5844316160,"data_stored":5844138772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":406061056},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:52:39 2021","interfaces":[{"interface":"back","average":{"1min":38.479999999999997,"5min":179.702,"15min":64.173000000000002},"min":{"1min":0.65000000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":600.43600000000004,"5min":1326.3920000000001,"15min":1326.3920000000001},"last":1.653},{"interface":"front","average":{"1min":99.135000000000005,"5min":200.47499999999999,"15min":75.792000000000002},"min":{"1min":0.61899999999999999,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":768.01300000000003,"5min":1520.595,"15min":1520.595},"last":1.7809999999999999}]},{"osd":1,"last update":"Wed Jan 27 09:52:39 2021","interfaces":[{"interface":"back","average":{"1min":1.651,"5min":37.046999999999997,"15min":14.029999999999999},"min":{"1min":0.73299999999999998,"5min":0.624,"15min":0.624},"max":{"1min":4.8559999999999999,"5min":865.298,"15min":865.298},"last":2.2029999999999998},{"interface":"front","average":{"1min":2.1579999999999999,"5min":93.390000000000001,"15min":34.822000000000003},"min":{"1min":0.77500000000000002,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":7.4619999999999997,"5min":1996.8119999999999,"15min":1996.8119999999999},"last":3.2189999999999999}]},{"osd":2,"last update":"Wed Jan 27 09:52:44 2021","interfaces":[{"interface":"back","average":{"1min":1.742,"5min":77.522999999999996,"15min":28.794},"min":{"1min":0.93300000000000005,"5min":0.78300000000000003,"15min":0.71999999999999997},"max":{"1min":4.8799999999999999,"5min":1996.9359999999999,"15min":1996.9359999999999},"last":1.7350000000000001},{"interface":"front","average":{"1min":2.085,"5min":73.248999999999995,"15min":26.899999999999999},"min":{"1min":0.94899999999999995,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":5.0030000000000001,"5min":1326.518,"15min":1326.518},"last":2.4849999999999999}]},{"osd":3,"last update":"Wed Jan 27 09:52:44 2021","interfaces":[{"interface":"back","average":{"1min":114.492,"5min":186.37100000000001,"15min":88.866},"min":{"1min":1.242,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":631.77300000000002,"5min":1632.471,"15min":1632.471},"last":2.9500000000000002},{"interface":"front","average":{"1min":39.581000000000003,"5min":340.55700000000002,"15min":125.664},"min":{"1min":1.2430000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":476.57600000000002,"5min":3452.1500000000001,"15min":3452.1500000000001},"last":4.2080000000000002}]},{"osd":4,"last update":"Wed Jan 27 09:52:44 2021","interfaces":[{"interface":"back","average":{"1min":1.9159999999999999,"5min":125.336,"15min":45.834000000000003},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.9649999999999999,"5min":2007.1610000000001,"15min":2007.1610000000001},"last":3.1640000000000001},{"interface":"front","average":{"1min":1.927,"5min":91.346999999999994,"15min":33.601999999999997},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":4.0490000000000004,"5min":1344.953,"15min":1344.953},"last":2.117}]},{"osd":5,"last update":"Wed Jan 27 09:52:44 2021","interfaces":[{"interface":"back","average":{"1min":2.2080000000000002,"5min":71.998999999999995,"15min":26.306000000000001},"min":{"1min":1.012,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":4.8570000000000002,"5min":1326.6369999999999,"15min":1326.6369999999999},"last":3.3460000000000001},{"interface":"front","average":{"1min":2.363,"5min":77.890000000000001,"15min":28.004999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":4.7210000000000001,"5min":1998.104,"15min":1998.104},"last":2.7280000000000002}]},{"osd":6,"last update":"Wed Jan 27 09:52:39 2021","interfaces":[{"interface":"back","average":{"1min":2.097,"5min":73.609999999999999,"15min":27.739999999999998},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":3.9300000000000002,"5min":1997.972,"15min":1997.972},"last":2.9009999999999998},{"interface":"front","average":{"1min":2.2469999999999999,"5min":33.520000000000003,"15min":13.202},"min":{"1min":1.1779999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":3.718,"5min":627.93899999999996,"15min":627.93899999999996},"last":3.3889999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542252,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2652440,"kb_used_data":2466960,"kb_used_omap":0,"kb_used_meta":185472,"kb_avail":91719400,"statfs":{"total":96636764160,"available":93920665600,"internally_reserved":0,"allocated":2526167040,"data_stored":2525943541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":189923328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:52:32 2021","interfaces":[{"interface":"back","average":{"1min":157.42599999999999,"5min":168.34399999999999,"15min":59.067},"min":{"1min":0.67700000000000005,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1853.4939999999999,"5min":2062.3220000000001,"15min":2062.3220000000001},"last":1.3680000000000001},{"interface":"front","average":{"1min":61.987000000000002,"5min":74.463999999999999,"15min":26.213999999999999},"min":{"1min":0.629,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":599.41499999999996,"5min":735.14300000000003,"15min":735.14300000000003},"last":1.488}]},{"osd":1,"last update":"Wed Jan 27 09:52:36 2021","interfaces":[{"interface":"back","average":{"1min":1.9279999999999999,"5min":5.0750000000000002,"15min":3.1749999999999998},"min":{"1min":0.70099999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":7.2759999999999998,"5min":202.423,"15min":202.423},"last":1.9039999999999999},{"interface":"front","average":{"1min":3.452,"5min":5.3419999999999996,"15min":3.4100000000000001},"min":{"1min":0.85399999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":17.707999999999998,"5min":188.43000000000001,"15min":188.43000000000001},"last":2.161}]},{"osd":2,"last update":"Wed Jan 27 09:52:32 2021","interfaces":[{"interface":"back","average":{"1min":4.6459999999999999,"5min":5.1600000000000001,"15min":3.3929999999999998},"min":{"1min":0.999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":53.814999999999998,"5min":182.20699999999999,"15min":182.20699999999999},"last":1.8120000000000001},{"interface":"front","average":{"1min":4,"5min":4.4880000000000004,"15min":3.1070000000000002},"min":{"1min":0.86499999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":54.156999999999996,"5min":150.04900000000001,"15min":150.04900000000001},"last":1.6339999999999999}]},{"osd":3,"last update":"Wed Jan 27 09:52:32 2021","interfaces":[{"interface":"back","average":{"1min":79.433999999999997,"5min":93.548000000000002,"15min":42.853000000000002},"min":{"1min":1.0780000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":773.70600000000002,"5min":1796.723,"15min":1796.723},"last":2.2440000000000002},{"interface":"front","average":{"1min":107.178,"5min":126.97799999999999,"15min":44.210000000000001},"min":{"1min":0.93500000000000005,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":458.67899999999997,"5min":1821.835,"15min":1821.835},"last":1.694}]},{"osd":4,"last update":"Wed Jan 27 09:52:32 2021","interfaces":[{"interface":"back","average":{"1min":1.9510000000000001,"5min":23.593,"15min":9.5060000000000002},"min":{"1min":1.2050000000000001,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":3.6240000000000001,"5min":560.41999999999996,"15min":560.41999999999996},"last":2.7080000000000002},{"interface":"front","average":{"1min":2.1749999999999998,"5min":24.751000000000001,"15min":10.162000000000001},"min":{"1min":1.4610000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":3.9159999999999999,"5min":513.15200000000004,"15min":513.15200000000004},"last":2.52}]},{"osd":5,"last update":"Wed Jan 27 09:52:32 2021","interfaces":[{"interface":"back","average":{"1min":2.4729999999999999,"5min":1.9319999999999999,"15min":2.617},"min":{"1min":1.226,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":5.5910000000000002,"5min":5.5910000000000002,"15min":5.5910000000000002},"last":2.1320000000000001},{"interface":"front","average":{"1min":2.3690000000000002,"5min":2.0499999999999998,"15min":2.7770000000000001},"min":{"1min":1.47,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":4.3200000000000003,"5min":6.194,"15min":6.194},"last":2.9020000000000001}]},{"osd":7,"last update":"Wed Jan 27 09:52:40 2021","interfaces":[{"interface":"back","average":{"1min":1.9750000000000001,"5min":20.114999999999998,"15min":8.9580000000000002},"min":{"1min":1.008,"5min":0.996,"15min":0.996},"max":{"1min":3.8130000000000002,"5min":507.45499999999998,"15min":507.45499999999998},"last":2.4729999999999999},{"interface":"front","average":{"1min":2.7240000000000002,"5min":98.575999999999993,"15min":35.030000000000001},"min":{"1min":1.2849999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":6.0919999999999996,"5min":2702.8879999999999,"15min":2702.8879999999999},"last":2.3839999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542252,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":908016,"kb_used_data":842472,"kb_used_omap":0,"kb_used_meta":65536,"kb_avail":93463824,"statfs":{"total":96636764160,"available":95706955776,"internally_reserved":0,"allocated":862691328,"data_stored":862499540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":67108864},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:52:44 2021","interfaces":[{"interface":"back","average":{"1min":51.319000000000003,"5min":115.47,"15min":39.746000000000002},"min":{"1min":0.72299999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":686.48400000000004,"5min":2305.5720000000001,"15min":2305.5720000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":74.786000000000001,"5min":174.10300000000001,"15min":66.584999999999994},"min":{"1min":0.79600000000000004,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":664.76199999999994,"5min":2556.7280000000001,"15min":2556.7280000000001},"last":1.6559999999999999}]},{"osd":1,"last update":"Wed Jan 27 09:52:39 2021","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":4.1619999999999999,"15min":3.1429999999999998},"min":{"1min":0.82799999999999996,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.7650000000000001,"5min":240.86600000000001,"15min":240.86600000000001},"last":2.0590000000000002},{"interface":"front","average":{"1min":1.4399999999999999,"5min":4.2880000000000003,"15min":2.9319999999999999},"min":{"1min":0.84599999999999997,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":4.2409999999999997,"5min":247.31299999999999,"15min":247.31299999999999},"last":2.1110000000000002}]},{"osd":2,"last update":"Wed Jan 27 09:52:39 2021","interfaces":[{"interface":"back","average":{"1min":3.7160000000000002,"5min":3.625,"15min":2.9380000000000002},"min":{"1min":0.76100000000000001,"5min":0.749,"15min":0.749},"max":{"1min":33.819000000000003,"5min":125.51000000000001,"15min":125.51000000000001},"last":1.758},{"interface":"front","average":{"1min":4.2430000000000003,"5min":3.6699999999999999,"15min":2.9169999999999998},"min":{"1min":0.86599999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":39.350999999999999,"5min":122.705,"15min":122.705},"last":2.4100000000000001}]},{"osd":3,"last update":"Wed Jan 27 09:52:44 2021","interfaces":[{"interface":"back","average":{"1min":48.682000000000002,"5min":183.256,"15min":62.790999999999997},"min":{"1min":1.1100000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":544.40800000000002,"5min":2676.6819999999998,"15min":2676.6819999999998},"last":2.4780000000000002},{"interface":"front","average":{"1min":49.439,"5min":258.351,"15min":94.745000000000005},"min":{"1min":1.603,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":544.46299999999997,"5min":2676.6190000000001,"15min":2676.6190000000001},"last":3.1880000000000002}]},{"osd":4,"last update":"Wed Jan 27 09:52:39 2021","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":19.733000000000001,"15min":8.3249999999999993},"min":{"1min":0.93300000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":3.2290000000000001,"5min":635.86400000000003,"15min":635.86400000000003},"last":2.1739999999999999},{"interface":"front","average":{"1min":2.0329999999999999,"5min":26.106999999999999,"15min":10.853999999999999},"min":{"1min":1.242,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":3.9740000000000002,"5min":525.19600000000003,"15min":525.19600000000003},"last":3.593}]},{"osd":6,"last update":"Wed Jan 27 09:52:39 2021","interfaces":[{"interface":"back","average":{"1min":1.7529999999999999,"5min":1.9770000000000001,"15min":2.6179999999999999},"min":{"1min":0.92200000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":4.407,"5min":7.5590000000000002,"15min":7.5590000000000002},"last":2.7639999999999998},{"interface":"front","average":{"1min":2.2309999999999999,"5min":2.1230000000000002,"15min":2.7749999999999999},"min":{"1min":1.2470000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":4.3780000000000001,"5min":6.3419999999999996,"15min":6.3419999999999996},"last":4.0119999999999996}]},{"osd":7,"last update":"Wed Jan 27 09:52:39 2021","interfaces":[{"interface":"back","average":{"1min":2.1019999999999999,"5min":60.780999999999999,"15min":22.518000000000001},"min":{"1min":1.1870000000000001,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":3.6699999999999999,"5min":1037.163,"15min":1037.163},"last":2.5779999999999998},{"interface":"front","average":{"1min":2.5150000000000001,"5min":102.337,"15min":36.506},"min":{"1min":1.417,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":7.3419999999999996,"5min":1580.106,"15min":1580.106},"last":2.798}]}]},{"osd":4,"up_from":14,"seq":60129542252,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3481356,"kb_used_data":3251140,"kb_used_omap":0,"kb_used_meta":230208,"kb_avail":90890484,"statfs":{"total":96636764160,"available":93071855616,"internally_reserved":0,"allocated":3329167360,"data_stored":3328983120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":235732992},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:52:38 2021","interfaces":[{"interface":"back","average":{"1min":132.995,"5min":265.90300000000002,"15min":101.357},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1374.481,"5min":1734.057,"15min":1734.057},"last":2.7770000000000001},{"interface":"front","average":{"1min":79.593000000000004,"5min":135.369,"15min":46.354999999999997},"min":{"1min":0.69399999999999995,"5min":0.67300000000000004,"15min":0.63300000000000001},"max":{"1min":952.15599999999995,"5min":1753.086,"15min":1753.086},"last":2.1669999999999998}]},{"osd":1,"last update":"Wed Jan 27 09:52:38 2021","interfaces":[{"interface":"back","average":{"1min":3.141,"5min":21.094999999999999,"15min":8.3960000000000008},"min":{"1min":0.83599999999999997,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":20.324999999999999,"5min":637.33699999999999,"15min":637.33699999999999},"last":2.0979999999999999},{"interface":"front","average":{"1min":2.8849999999999998,"5min":32.070999999999998,"15min":13.242000000000001},"min":{"1min":0.81100000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":20.195,"5min":517.21100000000001,"15min":517.21100000000001},"last":2.8610000000000002}]},{"osd":2,"last update":"Wed Jan 27 09:52:38 2021","interfaces":[{"interface":"back","average":{"1min":10.528,"5min":29.974,"15min":12.68},"min":{"1min":0.88300000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":182.86199999999999,"5min":517.07500000000005,"15min":517.07500000000005},"last":2.5739999999999998},{"interface":"front","average":{"1min":11.304,"5min":13.021000000000001,"15min":6.0759999999999996},"min":{"1min":0.86299999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":182.66,"5min":375.03399999999999,"15min":375.03399999999999},"last":3.4649999999999999}]},{"osd":3,"last update":"Wed Jan 27 09:52:38 2021","interfaces":[{"interface":"back","average":{"1min":120.029,"5min":130.02199999999999,"15min":61.021000000000001},"min":{"1min":1.1859999999999999,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":802.05700000000002,"5min":1265.72,"15min":1265.72},"last":3.2759999999999998},{"interface":"front","average":{"1min":18.762,"5min":123.413,"15min":42.933999999999997},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":178.262,"5min":1872.2360000000001,"15min":1872.2360000000001},"last":1.6339999999999999}]},{"osd":5,"last update":"Wed Jan 27 09:52:33 2021","interfaces":[{"interface":"back","average":{"1min":1.9330000000000001,"5min":17.984000000000002,"15min":7.6829999999999998},"min":{"1min":0.89400000000000002,"5min":0.86499999999999999,"15min":0.82999999999999996},"max":{"1min":3.3330000000000002,"5min":692.52700000000004,"15min":692.52700000000004},"last":2.367},{"interface":"front","average":{"1min":2.1259999999999999,"5min":30.195,"15min":12.696999999999999},"min":{"1min":1.1160000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":3.3690000000000002,"5min":516.92399999999998,"15min":516.92399999999998},"last":2.6320000000000001}]},{"osd":6,"last update":"Wed Jan 27 09:52:33 2021","interfaces":[{"interface":"back","average":{"1min":2.3399999999999999,"5min":32.018999999999998,"15min":13.260999999999999},"min":{"1min":1.0980000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":5.2279999999999998,"5min":574.76400000000001,"15min":574.76400000000001},"last":3.0830000000000002},{"interface":"front","average":{"1min":2.4550000000000001,"5min":12.504,"15min":6.1900000000000004},"min":{"1min":1.1799999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":6.3230000000000004,"5min":375.23599999999999,"15min":375.23599999999999},"last":2.9430000000000001}]},{"osd":7,"last update":"Wed Jan 27 09:52:33 2021","interfaces":[{"interface":"back","average":{"1min":2.4199999999999999,"5min":53.210000000000001,"15min":19.949000000000002},"min":{"1min":1.2250000000000001,"5min":1.103,"15min":1.103},"max":{"1min":4.0359999999999996,"5min":738.697,"15min":738.697},"last":3.0579999999999998},{"interface":"front","average":{"1min":4.3730000000000002,"5min":99.399000000000001,"15min":35.256},"min":{"1min":1.387,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":42.088999999999999,"5min":2337.453,"15min":2337.453},"last":3.306}]}]}]}} 2021-01-27T09:53:17.361 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-01-27T09:53:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.654+0000 7f278f59e700 1 Processor -- start 2021-01-27T09:53:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.654+0000 7f278f59e700 1 -- start start 2021-01-27T09:53:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.654+0000 7f278f59e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2790065000 0x7f2790067250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:17.662 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.654+0000 7f278f59e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2790067740 0x7f2790143690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:17.662 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.654+0000 7f278f59e700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2790060470 con 0x7f27900653e0 2021-01-27T09:53:17.662 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.654+0000 7f278f59e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2790060710 con 0x7f2790067740 2021-01-27T09:53:17.662 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.654+0000 7f278f59e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27900609b0 con 0x7f2790065000 2021-01-27T09:53:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.658+0000 7f278dd9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2790067740 0x7f2790143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.658+0000 7f278dd9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2790067740 0x7f2790143690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:58152/0 (socket says 172.21.15.146:58152) 2021-01-27T09:53:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.658+0000 7f278dd9b700 1 -- 172.21.15.146:0/2582806948 learned_addr learned my addr 172.21.15.146:0/2582806948 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:17.667 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.658+0000 7f278dd9b700 1 -- 172.21.15.146:0/2582806948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2790065000 msgr2=0x7f2790067250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:53:17.667 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.658+0000 7f278dd9b700 1 --2- 172.21.15.146:0/2582806948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2790065000 0x7f2790067250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:53:17.667 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.658+0000 7f278dd9b700 1 -- 172.21.15.146:0/2582806948 >> v1:172.21.15.78:6789/0 conn(0x7f27900653e0 legacy=0x7f2790149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:17.668 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.658+0000 7f278dd9b700 1 -- 172.21.15.146:0/2582806948 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2790060c50 con 0x7f2790067740 2021-01-27T09:53:17.668 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.658+0000 7f278dd9b700 1 --2- 172.21.15.146:0/2582806948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2790067740 0x7f2790143690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f2788009f00 tx=0x7f2788009b60).ready entity=mon.0 client_cookie=4aea034ce756aeb3 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:17.668 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.658+0000 7f278d59a700 1 -- 172.21.15.146:0/2582806948 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27880095d0 con 0x7f2790067740 2021-01-27T09:53:17.668 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.658+0000 7f278d59a700 1 -- 172.21.15.146:0/2582806948 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2788009730 con 0x7f2790067740 2021-01-27T09:53:17.669 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.658+0000 7f278d59a700 1 -- 172.21.15.146:0/2582806948 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27880167d0 con 0x7f2790067740 2021-01-27T09:53:17.669 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.658+0000 7f278f59e700 1 -- 172.21.15.146:0/2582806948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2790067740 msgr2=0x7f2790143690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:17.669 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.658+0000 7f278f59e700 1 --2- 172.21.15.146:0/2582806948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2790067740 0x7f2790143690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f2788009f00 tx=0x7f2788009b60).stop 2021-01-27T09:53:17.670 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.666+0000 7f278f59e700 1 -- 172.21.15.146:0/2582806948 shutdown_connections 2021-01-27T09:53:17.670 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.666+0000 7f278f59e700 1 --2- 172.21.15.146:0/2582806948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2790067740 0x7f2790143690 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:17.670 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.666+0000 7f278f59e700 1 --2- 172.21.15.146:0/2582806948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2790065000 0x7f2790067250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:53:17.670 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.666+0000 7f278f59e700 1 -- 172.21.15.146:0/2582806948 >> 172.21.15.146:0/2582806948 conn(0x7f2790067ec0 msgr2=0x7f2790069110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:17.673 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.670+0000 7f278f59e700 1 -- 172.21.15.146:0/2582806948 shutdown_connections 2021-01-27T09:53:17.673 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.670+0000 7f278f59e700 1 -- 172.21.15.146:0/2582806948 wait complete. 2021-01-27T09:53:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.670+0000 7f278f59e700 1 Processor -- start 2021-01-27T09:53:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.670+0000 7f278f59e700 1 -- start start 2021-01-27T09:53:17.679 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.674+0000 7f278f59e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2790065000 0x7f279015abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.674+0000 7f278f59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27900653e0 0x7f279015b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.674+0000 7f278f59e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2790067740 0x7f279015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.674+0000 7f278f59e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279015b5c0 con 0x7f2790067740 2021-01-27T09:53:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.674+0000 7f278f59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27900bdc50 con 0x7f27900653e0 2021-01-27T09:53:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.674+0000 7f278f59e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279015a780 con 0x7f2790065000 2021-01-27T09:53:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.674+0000 7f278dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27900653e0 0x7f279015b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.674+0000 7f278dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27900653e0 0x7f279015b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55286/0 (socket says 172.21.15.146:55286) 2021-01-27T09:53:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.674+0000 7f278dd9b700 1 -- 172.21.15.146:0/1240125644 learned_addr learned my addr 172.21.15.146:0/1240125644 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.674+0000 7f278ed9d700 1 --2- 172.21.15.146:0/1240125644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2790067740 0x7f279015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.674+0000 7f278e59c700 1 --2- 172.21.15.146:0/1240125644 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2790065000 0x7f279015abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.674+0000 7f278ed9d700 1 -- 172.21.15.146:0/1240125644 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2790065000 msgr2=0x7f279015abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.674+0000 7f278ed9d700 1 --2- 172.21.15.146:0/1240125644 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2790065000 0x7f279015abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.674+0000 7f278ed9d700 1 -- 172.21.15.146:0/1240125644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27900653e0 msgr2=0x7f279015b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:17.683 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.674+0000 7f278ed9d700 1 --2- 172.21.15.146:0/1240125644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27900653e0 0x7f279015b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:17.683 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.674+0000 7f278ed9d700 1 -- 172.21.15.146:0/1240125644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27900bba90 con 0x7f2790067740 2021-01-27T09:53:17.683 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.674+0000 7f278e59c700 1 --2- 172.21.15.146:0/1240125644 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2790065000 0x7f279015abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:53:17.683 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.674+0000 7f278ed9d700 1 --2- 172.21.15.146:0/1240125644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2790067740 0x7f279015baa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f278000c710 tx=0x7f2780007b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.686+0000 7f277e7fc700 1 -- 172.21.15.146:0/1240125644 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278000ceb0 con 0x7f2790067740 2021-01-27T09:53:17.690 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.686+0000 7f277e7fc700 1 -- 172.21.15.146:0/1240125644 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278000f470 con 0x7f2790067740 2021-01-27T09:53:17.690 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.686+0000 7f278f59e700 1 -- 172.21.15.146:0/1240125644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27900bbd30 con 0x7f2790067740 2021-01-27T09:53:17.690 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.686+0000 7f278f59e700 1 -- 172.21.15.146:0/1240125644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27900bc270 con 0x7f2790067740 2021-01-27T09:53:17.691 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.686+0000 7f277e7fc700 1 -- 172.21.15.146:0/1240125644 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278000f7f0 con 0x7f2790067740 2021-01-27T09:53:17.695 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.686+0000 7f278f59e700 1 -- 172.21.15.146:0/1240125644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2770004fa0 con 0x7f2790067740 2021-01-27T09:53:17.696 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.686+0000 7f277e7fc700 1 -- 172.21.15.146:0/1240125644 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f2780019030 con 0x7f2790067740 2021-01-27T09:53:17.696 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.690+0000 7f277e7fc700 1 --2- 172.21.15.146:0/1240125644 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f276c056260 0x7f276c058720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:17.696 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.690+0000 7f278e59c700 1 --2- 172.21.15.146:0/1240125644 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f276c056260 0x7f276c058720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:17.696 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.690+0000 7f277e7fc700 1 -- 172.21.15.146:0/1240125644 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7f278006e730 con 0x7f2790067740 2021-01-27T09:53:17.697 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.690+0000 7f278e59c700 1 --2- 172.21.15.146:0/1240125644 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f276c056260 0x7f276c058720 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f278400bd50 tx=0x7f2784008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:17.701 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:17.694+0000 7f277e7fc700 1 -- 172.21.15.146:0/1240125644 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f2780043d90 con 0x7f2790067740 2021-01-27T09:53:18.029 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:18.026+0000 7f278f59e700 1 -- 172.21.15.146:0/1240125644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2770005250 con 0x7f2790067740 2021-01-27T09:53:18.031 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:18.026+0000 7f277e7fc700 1 -- 172.21.15.146:0/1240125644 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19029 (secure 0 0 0) 0x7f2780025a70 con 0x7f2790067740 2021-01-27T09:53:18.036 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:53:18.037 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"fsid":"968a1bec-aac5-444e-b70f-7770587be945","created":"2021-01-27T09:44:13.797940+0000","modified":"2021-01-27T09:51:48.650675+0000","last_up_change":"2021-01-27T09:44:23.479967+0000","last_in_change":"2021-01-27T09:44:23.479967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T09:44:18.497521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-27T09:44:24.550303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-27T09:44:27.607542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-27T09:44:28.331389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-01-27T09:44:31.378452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25441909-a40b-4d82-828d-326685513ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":14470},{"type":"v1","addr":"172.21.15.146:6801","nonce":14470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":14470},{"type":"v1","addr":"172.21.15.146:6803","nonce":14470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":14470},{"type":"v1","addr":"172.21.15.146:6810","nonce":14470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":14470},{"type":"v1","addr":"172.21.15.146:6807","nonce":14470}]},"public_addr":"172.21.15.146:6801/14470","cluster_addr":"172.21.15.146:6803/14470","heartbeat_back_addr":"172.21.15.146:6810/14470","heartbeat_front_addr":"172.21.15.146:6807/14470","state":["exists","up"]},{"osd":1,"uuid":"825bbc51-2ffe-4612-a300-00960e48be02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":14472},{"type":"v1","addr":"172.21.15.146:6817","nonce":14472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":14472},{"type":"v1","addr":"172.21.15.146:6819","nonce":14472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":14472},{"type":"v1","addr":"172.21.15.146:6827","nonce":14472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":14472},{"type":"v1","addr":"172.21.15.146:6823","nonce":14472}]},"public_addr":"172.21.15.146:6817/14472","cluster_addr":"172.21.15.146:6819/14472","heartbeat_back_addr":"172.21.15.146:6827/14472","heartbeat_front_addr":"172.21.15.146:6823/14472","state":["exists","up"]},{"osd":2,"uuid":"e568b97a-8e71-4ab9-bd64-056892110b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":14474},{"type":"v1","addr":"172.21.15.146:6822","nonce":14474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":14474},{"type":"v1","addr":"172.21.15.146:6826","nonce":14474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":14474},{"type":"v1","addr":"172.21.15.146:6831","nonce":14474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":14474},{"type":"v1","addr":"172.21.15.146:6829","nonce":14474}]},"public_addr":"172.21.15.146:6822/14474","cluster_addr":"172.21.15.146:6826/14474","heartbeat_back_addr":"172.21.15.146:6831/14474","heartbeat_front_addr":"172.21.15.146:6829/14474","state":["exists","up"]},{"osd":3,"uuid":"f5d50f63-f74a-4aea-a62d-51c38db4d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":14471},{"type":"v1","addr":"172.21.15.146:6806","nonce":14471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":14471},{"type":"v1","addr":"172.21.15.146:6811","nonce":14471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":14471},{"type":"v1","addr":"172.21.15.146:6815","nonce":14471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":14471},{"type":"v1","addr":"172.21.15.146:6813","nonce":14471}]},"public_addr":"172.21.15.146:6806/14471","cluster_addr":"172.21.15.146:6811/14471","heartbeat_back_addr":"172.21.15.146:6815/14471","heartbeat_front_addr":"172.21.15.146:6813/14471","state":["exists","up"]},{"osd":4,"uuid":"782458d7-6f52-48f4-9466-67b61ef27016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":15826},{"type":"v1","addr":"172.21.15.78:6817","nonce":15826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":15826},{"type":"v1","addr":"172.21.15.78:6819","nonce":15826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":15826},{"type":"v1","addr":"172.21.15.78:6823","nonce":15826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":15826},{"type":"v1","addr":"172.21.15.78:6821","nonce":15826}]},"public_addr":"172.21.15.78:6817/15826","cluster_addr":"172.21.15.78:6819/15826","heartbeat_back_addr":"172.21.15.78:6823/15826","heartbeat_front_addr":"172.21.15.78:6821/15826","state":["exists","up"]},{"osd":5,"uuid":"1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":15827},{"type":"v1","addr":"172.21.15.78:6801","nonce":15827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":15827},{"type":"v1","addr":"172.21.15.78:6803","nonce":15827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":15827},{"type":"v1","addr":"172.21.15.78:6807","nonce":15827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":15827},{"type":"v1","addr":"172.21.15.78:6805","nonce":15827}]},"public_addr":"172.21.15.78:6801/15827","cluster_addr":"172.21.15.78:6803/15827","heartbeat_back_addr":"172.21.15.78:6807/15827","heartbeat_front_addr":"172.21.15.78:6805/15827","state":["exists","up"]},{"osd":6,"uuid":"4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":15825},{"type":"v1","addr":"172.21.15.78:6809","nonce":15825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":15825},{"type":"v1","addr":"172.21.15.78:6811","nonce":15825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":15825},{"type":"v1","addr":"172.21.15.78:6815","nonce":15825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":15825},{"type":"v1","addr":"172.21.15.78:6813","nonce":15825}]},"public_addr":"172.21.15.78:6809/15825","cluster_addr":"172.21.15.78:6811/15825","heartbeat_back_addr":"172.21.15.78:6815/15825","heartbeat_front_addr":"172.21.15.78:6813/15825","state":["exists","up"]},{"osd":7,"uuid":"851aeaf3-bcdc-4ac6-b578-c42e1bf87c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":15828},{"type":"v1","addr":"172.21.15.78:6825","nonce":15828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":15828},{"type":"v1","addr":"172.21.15.78:6827","nonce":15828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":15828},{"type":"v1","addr":"172.21.15.78:6831","nonce":15828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":15828},{"type":"v1","addr":"172.21.15.78:6829","nonce":15828}]},"public_addr":"172.21.15.78:6825/15828","cluster_addr":"172.21.15.78:6827/15828","heartbeat_back_addr":"172.21.15.78:6831/15828","heartbeat_front_addr":"172.21.15.78:6829/15828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.573930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.718144+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.641838+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.551598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.374444+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.171108+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.360910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.356020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6837/1117292103":"2021-01-28T09:51:48.650615+0000","172.21.15.78:6836/1117292103":"2021-01-28T09:51:48.650615+0000","172.21.15.146:6835/1106324127":"2021-01-28T09:49:18.611057+0000","172.21.15.146:6833/1106324127":"2021-01-28T09:49:18.611057+0000","172.21.15.146:6837/745099427":"2021-01-28T09:46:58.569668+0000","172.21.15.146:6836/745099427":"2021-01-28T09:46:58.569668+0000"},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:53:18.053 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:18.046+0000 7f278f59e700 1 -- 172.21.15.146:0/1240125644 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f276c056260 msgr2=0x7f276c058720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:18.053 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:18.050+0000 7f278f59e700 1 --2- 172.21.15.146:0/1240125644 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f276c056260 0x7f276c058720 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f278400bd50 tx=0x7f2784008040).stop 2021-01-27T09:53:18.054 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:18.050+0000 7f278f59e700 1 -- 172.21.15.146:0/1240125644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2790067740 msgr2=0x7f279015baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:18.054 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:18.050+0000 7f278f59e700 1 --2- 172.21.15.146:0/1240125644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2790067740 0x7f279015baa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f278000c710 tx=0x7f2780007b20).stop 2021-01-27T09:53:18.056 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:18.050+0000 7f278f59e700 1 -- 172.21.15.146:0/1240125644 shutdown_connections 2021-01-27T09:53:18.056 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:18.050+0000 7f278f59e700 1 --2- 172.21.15.146:0/1240125644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2790067740 0x7f279015baa0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:18.056 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:18.050+0000 7f278f59e700 1 --2- 172.21.15.146:0/1240125644 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f276c056260 0x7f276c058720 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:18.057 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:18.050+0000 7f278f59e700 1 --2- 172.21.15.146:0/1240125644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27900653e0 0x7f279015b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:18.057 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:18.050+0000 7f278f59e700 1 --2- 172.21.15.146:0/1240125644 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2790065000 0x7f279015abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:18.057 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:18.050+0000 7f278f59e700 1 -- 172.21.15.146:0/1240125644 >> 172.21.15.146:0/1240125644 conn(0x7f2790067ec0 msgr2=0x7f2790141000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:18.057 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:18.050+0000 7f278f59e700 1 -- 172.21.15.146:0/1240125644 shutdown_connections 2021-01-27T09:53:18.058 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:18.050+0000 7f278f59e700 1 -- 172.21.15.146:0/1240125644 wait complete. 2021-01-27T09:53:19.090 INFO:tasks.ceph:Scrubbing osd.0 2021-01-27T09:53:19.090 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2021-01-27T09:53:19.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.366+0000 7fa7e49c0700 1 Processor -- start 2021-01-27T09:53:19.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.366+0000 7fa7e49c0700 1 -- start start 2021-01-27T09:53:19.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.370+0000 7fa7e49c0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa7e0069560 0x7fa7e014dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:19.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.370+0000 7fa7e49c0700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa7e0149c20 0x7fa7e0069940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:19.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.370+0000 7fa7e49c0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e00679e0 con 0x7fa7e0066d60 2021-01-27T09:53:19.380 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.370+0000 7fa7e49c0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e014a080 con 0x7fa7e0069560 2021-01-27T09:53:19.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.370+0000 7fa7e49c0700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e00b7c60 con 0x7fa7e0149c20 2021-01-27T09:53:19.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.374+0000 7fa7dffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa7e0066d60 0x7fa7e00b7540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54878/0 (socket says 172.21.15.146:54878) 2021-01-27T09:53:19.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.374+0000 7fa7dffff700 1 -- 172.21.15.146:0/3149389624 learned_addr learned my addr 172.21.15.146:0/3149389624 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:53:19.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.374+0000 7fa7deffd700 1 --2- 172.21.15.146:0/3149389624 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa7e0149c20 0x7fa7e0069940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:19.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.374+0000 7fa7df7fe700 1 --2- 172.21.15.146:0/3149389624 >> v2:172.21.15.146:3300/0 conn(0x7fa7e0069560 0x7fa7e014dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:19.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.374+0000 7fa7deffd700 1 -- 172.21.15.146:0/3149389624 >> v2:172.21.15.146:3300/0 conn(0x7fa7e0069560 msgr2=0x7fa7e014dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:53:19.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.374+0000 7fa7deffd700 1 --2- 172.21.15.146:0/3149389624 >> v2:172.21.15.146:3300/0 conn(0x7fa7e0069560 0x7fa7e014dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:19.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.374+0000 7fa7deffd700 1 -- 172.21.15.146:0/3149389624 >> v1:172.21.15.146:6789/0 conn(0x7fa7e0066d60 legacy=0x7fa7e00b7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:19.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.374+0000 7fa7deffd700 1 -- 172.21.15.146:0/3149389624 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e00674a0 con 0x7fa7e0149c20 2021-01-27T09:53:19.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.378+0000 7fa7deffd700 1 --2- 172.21.15.146:0/3149389624 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa7e0149c20 0x7fa7e0069940 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fa7d000af50 tx=0x7fa7d000ac50).ready entity=mon.2 client_cookie=bd5fd31cc6bdacd3 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:19.385 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.378+0000 7fa7de7fc700 1 -- 172.21.15.146:0/3149389624 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0016ce0 con 0x7fa7e0149c20 2021-01-27T09:53:19.385 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.378+0000 7fa7de7fc700 1 -- 172.21.15.146:0/3149389624 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d0016e40 con 0x7fa7e0149c20 2021-01-27T09:53:19.385 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.378+0000 7fa7de7fc700 1 -- 172.21.15.146:0/3149389624 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0008b50 con 0x7fa7e0149c20 2021-01-27T09:53:19.386 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.378+0000 7fa7e49c0700 1 -- 172.21.15.146:0/3149389624 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa7e0149c20 msgr2=0x7fa7e0069940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:19.386 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.378+0000 7fa7e49c0700 1 --2- 172.21.15.146:0/3149389624 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa7e0149c20 0x7fa7e0069940 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fa7d000af50 tx=0x7fa7d000ac50).stop 2021-01-27T09:53:19.386 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.378+0000 7fa7e49c0700 1 -- 172.21.15.146:0/3149389624 shutdown_connections 2021-01-27T09:53:19.386 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.378+0000 7fa7e49c0700 1 --2- 172.21.15.146:0/3149389624 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa7e0149c20 0x7fa7e0069940 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:19.387 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.378+0000 7fa7e49c0700 1 --2- 172.21.15.146:0/3149389624 >> v2:172.21.15.146:3300/0 conn(0x7fa7e0069560 0x7fa7e014dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:19.387 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.378+0000 7fa7e49c0700 1 -- 172.21.15.146:0/3149389624 >> 172.21.15.146:0/3149389624 conn(0x7fa7e0064e60 msgr2=0x7fa7e0065240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:19.390 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.382+0000 7fa7e49c0700 1 -- 172.21.15.146:0/3149389624 shutdown_connections 2021-01-27T09:53:19.391 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.386+0000 7fa7e49c0700 1 -- 172.21.15.146:0/3149389624 wait complete. 2021-01-27T09:53:19.392 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.386+0000 7fa7e49c0700 1 Processor -- start 2021-01-27T09:53:19.393 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.386+0000 7fa7e49c0700 1 -- start start 2021-01-27T09:53:19.401 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.390+0000 7fa7e49c0700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa7e0066d60 0x7fa7e014c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:19.401 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.390+0000 7fa7e49c0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7e0069560 0x7fa7e0142c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:19.401 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.390+0000 7fa7e49c0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7e0149c20 0x7fa7e0143160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:19.401 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.390+0000 7fa7e49c0700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e0143650 con 0x7fa7e0149c20 2021-01-27T09:53:19.402 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.390+0000 7fa7e49c0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e00607d0 con 0x7fa7e0069560 2021-01-27T09:53:19.402 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.390+0000 7fa7e49c0700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e00bab20 con 0x7fa7e0066d60 2021-01-27T09:53:19.402 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.390+0000 7fa7df7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa7e0066d60 0x7fa7e014c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:19.403 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.390+0000 7fa7df7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa7e0066d60 0x7fa7e014c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:44800/0 (socket says 172.21.15.146:44800) 2021-01-27T09:53:19.403 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.390+0000 7fa7df7fe700 1 -- 172.21.15.146:0/3254236542 learned_addr learned my addr 172.21.15.146:0/3254236542 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:19.403 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.390+0000 7fa7dffff700 1 --2- 172.21.15.146:0/3254236542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7e0149c20 0x7fa7e0143160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:19.403 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.390+0000 7fa7deffd700 1 --2- 172.21.15.146:0/3254236542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7e0069560 0x7fa7e0142c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:19.403 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.390+0000 7fa7deffd700 1 -- 172.21.15.146:0/3254236542 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa7e0066d60 msgr2=0x7fa7e014c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:19.404 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.390+0000 7fa7deffd700 1 --2- 172.21.15.146:0/3254236542 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa7e0066d60 0x7fa7e014c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:19.404 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.390+0000 7fa7deffd700 1 -- 172.21.15.146:0/3254236542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7e0149c20 msgr2=0x7fa7e0143160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:19.404 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.390+0000 7fa7deffd700 1 --2- 172.21.15.146:0/3254236542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7e0149c20 0x7fa7e0143160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:19.404 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.390+0000 7fa7deffd700 1 -- 172.21.15.146:0/3254236542 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e00badc0 con 0x7fa7e0069560 2021-01-27T09:53:19.405 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.394+0000 7fa7deffd700 1 --2- 172.21.15.146:0/3254236542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7e0069560 0x7fa7e0142c70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fa7e006a1f0 tx=0x7fa7d001e000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:19.405 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.394+0000 7fa7d77fe700 1 -- 172.21.15.146:0/3254236542 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d000be80 con 0x7fa7e0069560 2021-01-27T09:53:19.405 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.394+0000 7fa7d77fe700 1 -- 172.21.15.146:0/3254236542 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d0016170 con 0x7fa7e0069560 2021-01-27T09:53:19.405 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.394+0000 7fa7d77fe700 1 -- 172.21.15.146:0/3254236542 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0016510 con 0x7fa7e0069560 2021-01-27T09:53:19.405 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.394+0000 7fa7e49c0700 1 -- 172.21.15.146:0/3254236542 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e014f240 con 0x7fa7e0069560 2021-01-27T09:53:19.406 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.394+0000 7fa7e49c0700 1 -- 172.21.15.146:0/3254236542 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e016d9e0 con 0x7fa7e0069560 2021-01-27T09:53:19.406 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.394+0000 7fa7e49c0700 1 -- 172.21.15.146:0/3254236542 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa7e0069d50 con 0x7fa7e0069560 2021-01-27T09:53:19.407 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.398+0000 7fa7d77fe700 1 -- 172.21.15.146:0/3254236542 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fa7d0026030 con 0x7fa7e0069560 2021-01-27T09:53:19.407 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.398+0000 7fa7d77fe700 1 --2- 172.21.15.146:0/3254236542 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa7c4056230 0x7fa7c40586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:19.407 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.398+0000 7fa7d77fe700 1 -- 172.21.15.146:0/3254236542 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7fa7d0070650 con 0x7fa7e0069560 2021-01-27T09:53:19.407 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.398+0000 7fa7d77fe700 1 --2- 172.21.15.146:0/3254236542 >> [v2:172.21.15.146:6800/14470,v1:172.21.15.146:6801/14470] conn(0x7fa7c405e6f0 0x7fa7c4060b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:19.408 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.398+0000 7fa7d77fe700 1 -- 172.21.15.146:0/3254236542 --> [v2:172.21.15.146:6800/14470,v1:172.21.15.146:6801/14470] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7c4061210 con 0x7fa7c405e6f0 2021-01-27T09:53:19.408 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.398+0000 7fa7d77fe700 1 -- 172.21.15.146:0/3254236542 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7d0072cc0 con 0x7fa7e0069560 2021-01-27T09:53:19.408 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.398+0000 7fa7df7fe700 1 --2- 172.21.15.146:0/3254236542 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa7c4056230 0x7fa7c40586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:19.408 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.402+0000 7fa7df7fe700 1 --2- 172.21.15.146:0/3254236542 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa7c4056230 0x7fa7c40586f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fa7c8006800 tx=0x7fa7c800f040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:19.409 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.402+0000 7fa7dffff700 1 --2- 172.21.15.146:0/3254236542 >> [v2:172.21.15.146:6800/14470,v1:172.21.15.146:6801/14470] conn(0x7fa7c405e6f0 0x7fa7c4060b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:19.409 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.402+0000 7fa7dffff700 1 --2- 172.21.15.146:0/3254236542 >> [v2:172.21.15.146:6800/14470,v1:172.21.15.146:6801/14470] conn(0x7fa7c405e6f0 0x7fa7c4060b90 crc :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:19.420 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.414+0000 7fa7d77fe700 1 -- 172.21.15.146:0/3254236542 <== osd.0 v2:172.21.15.146:6800/14470 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7fa7c4061210 con 0x7fa7c405e6f0 2021-01-27T09:53:19.445 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.438+0000 7fa7d57fa700 1 -- 172.21.15.146:0/3254236542 --> [v2:172.21.15.146:6800/14470,v1:172.21.15.146:6801/14470] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa7e0044ee0 con 0x7fa7c405e6f0 2021-01-27T09:53:19.460 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2021-01-27T09:53:19.461 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-01-27T09:53:19.461 INFO:teuthology.orchestra.run.smithi146.stdout:} 2021-01-27T09:53:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.454+0000 7fa7d77fe700 1 -- 172.21.15.146:0/3254236542 <== osd.0 v2:172.21.15.146:6800/14470 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa7e0044ee0 con 0x7fa7c405e6f0 2021-01-27T09:53:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.462+0000 7fa7d57fa700 1 -- 172.21.15.146:0/3254236542 >> [v2:172.21.15.146:6800/14470,v1:172.21.15.146:6801/14470] conn(0x7fa7c405e6f0 msgr2=0x7fa7c4060b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:19.469 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.462+0000 7fa7d57fa700 1 --2- 172.21.15.146:0/3254236542 >> [v2:172.21.15.146:6800/14470,v1:172.21.15.146:6801/14470] conn(0x7fa7c405e6f0 0x7fa7c4060b90 crc :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:19.470 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.466+0000 7fa7d57fa700 1 -- 172.21.15.146:0/3254236542 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa7c4056230 msgr2=0x7fa7c40586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:19.471 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.466+0000 7fa7d57fa700 1 --2- 172.21.15.146:0/3254236542 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa7c4056230 0x7fa7c40586f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fa7c8006800 tx=0x7fa7c800f040).stop 2021-01-27T09:53:19.471 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.466+0000 7fa7d57fa700 1 -- 172.21.15.146:0/3254236542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7e0069560 msgr2=0x7fa7e0142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:19.471 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.466+0000 7fa7d57fa700 1 --2- 172.21.15.146:0/3254236542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7e0069560 0x7fa7e0142c70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fa7e006a1f0 tx=0x7fa7d001e000).stop 2021-01-27T09:53:19.472 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.466+0000 7fa7dffff700 1 -- 172.21.15.146:0/3254236542 reap_dead start 2021-01-27T09:53:19.472 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.466+0000 7fa7d57fa700 1 -- 172.21.15.146:0/3254236542 shutdown_connections 2021-01-27T09:53:19.473 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.466+0000 7fa7d57fa700 1 -- 172.21.15.146:0/3254236542 >> 172.21.15.146:0/3254236542 conn(0x7fa7e0064e60 msgr2=0x7fa7e0060020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:19.475 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.466+0000 7fa7d57fa700 1 -- 172.21.15.146:0/3254236542 shutdown_connections 2021-01-27T09:53:19.475 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.466+0000 7fa7d57fa700 1 -- 172.21.15.146:0/3254236542 wait complete. 2021-01-27T09:53:19.499 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2021-01-27T09:53:19.751 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.746+0000 7fafa994d700 1 Processor -- start 2021-01-27T09:53:19.751 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.746+0000 7fafa994d700 1 -- start start 2021-01-27T09:53:19.753 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.746+0000 7fafa994d700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fafa40be340 0x7fafa414ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:19.753 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.746+0000 7fafa994d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fafa40683f0 0x7fafa40b8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:19.754 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.750+0000 7fafa994d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fafa40be720 0x7fafa4065e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:19.754 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.750+0000 7fafa27fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fafa40683f0 0x7fafa40b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:19.754 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.750+0000 7fafa27fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fafa40683f0 0x7fafa40b8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55326/0 (socket says 172.21.15.146:55326) 2021-01-27T09:53:19.755 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.750+0000 7fafa27fc700 1 -- 172.21.15.146:0/1030006199 learned_addr learned my addr 172.21.15.146:0/1030006199 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:19.755 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.750+0000 7fafa994d700 1 -- 172.21.15.146:0/1030006199 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa40b8b50 con 0x7fafa40be340 2021-01-27T09:53:19.755 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.750+0000 7fafa994d700 1 -- 172.21.15.146:0/1030006199 --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa4066370 con 0x7fafa40683f0 2021-01-27T09:53:19.755 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.750+0000 7fafa994d700 1 -- 172.21.15.146:0/1030006199 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa4066d80 con 0x7fafa40be720 2021-01-27T09:53:19.756 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.750+0000 7fafa2ffd700 1 --2- 172.21.15.146:0/1030006199 >> v2:172.21.15.78:3300/0 conn(0x7fafa40be340 0x7fafa414ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:19.756 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.750+0000 7fafa37fe700 1 --2- 172.21.15.146:0/1030006199 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fafa40be720 0x7fafa4065e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:19.756 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.750+0000 7fafa27fc700 1 -- 172.21.15.146:0/1030006199 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fafa40be720 msgr2=0x7fafa4065e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:53:19.757 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.750+0000 7fafa27fc700 1 --2- 172.21.15.146:0/1030006199 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fafa40be720 0x7fafa4065e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:19.757 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.750+0000 7fafa27fc700 1 -- 172.21.15.146:0/1030006199 >> v2:172.21.15.78:3300/0 conn(0x7fafa40be340 msgr2=0x7fafa414ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:53:19.757 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.750+0000 7fafa27fc700 1 --2- 172.21.15.146:0/1030006199 >> v2:172.21.15.78:3300/0 conn(0x7fafa40be340 0x7fafa414ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:19.757 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.750+0000 7fafa27fc700 1 -- 172.21.15.146:0/1030006199 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa40b9f50 con 0x7fafa40683f0 2021-01-27T09:53:19.758 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.750+0000 7fafa2ffd700 1 --2- 172.21.15.146:0/1030006199 >> v2:172.21.15.78:3300/0 conn(0x7fafa40be340 0x7fafa414ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:53:19.758 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.750+0000 7fafa27fc700 1 --2- 172.21.15.146:0/1030006199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafa40683f0 0x7fafa40b8660 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fafa40bf240 tx=0x7faf98006ee0).ready entity=mon.1 client_cookie=53e89b18489e8d7 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:19.758 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.750+0000 7fafa1ffb700 1 -- 172.21.15.146:0/1030006199 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf98009e20 con 0x7fafa40683f0 2021-01-27T09:53:19.759 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.750+0000 7fafa1ffb700 1 -- 172.21.15.146:0/1030006199 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf98012af0 con 0x7fafa40683f0 2021-01-27T09:53:19.760 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.750+0000 7fafa1ffb700 1 -- 172.21.15.146:0/1030006199 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf98012e70 con 0x7fafa40683f0 2021-01-27T09:53:19.761 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.750+0000 7fafa994d700 1 -- 172.21.15.146:0/1030006199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafa40683f0 msgr2=0x7fafa40b8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:19.761 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.750+0000 7fafa994d700 1 --2- 172.21.15.146:0/1030006199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafa40683f0 0x7fafa40b8660 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fafa40bf240 tx=0x7faf98006ee0).stop 2021-01-27T09:53:19.762 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.754+0000 7fafa994d700 1 -- 172.21.15.146:0/1030006199 shutdown_connections 2021-01-27T09:53:19.762 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.754+0000 7fafa994d700 1 --2- 172.21.15.146:0/1030006199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafa40683f0 0x7fafa40b8660 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:19.762 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.754+0000 7fafa994d700 1 --2- 172.21.15.146:0/1030006199 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fafa40be720 0x7fafa4065e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:19.762 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.754+0000 7fafa994d700 1 --2- 172.21.15.146:0/1030006199 >> v2:172.21.15.78:3300/0 conn(0x7fafa40be340 0x7fafa414ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:19.763 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.754+0000 7fafa994d700 1 -- 172.21.15.146:0/1030006199 >> 172.21.15.146:0/1030006199 conn(0x7fafa4067e10 msgr2=0x7fafa4069110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:19.763 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.754+0000 7fafa994d700 1 -- 172.21.15.146:0/1030006199 shutdown_connections 2021-01-27T09:53:19.763 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.754+0000 7fafa994d700 1 -- 172.21.15.146:0/1030006199 wait complete. 2021-01-27T09:53:19.763 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.758+0000 7fafa994d700 1 Processor -- start 2021-01-27T09:53:19.763 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.758+0000 7fafa994d700 1 -- start start 2021-01-27T09:53:19.764 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.758+0000 7fafa994d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafa40683f0 0x7fafa4159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:19.765 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.758+0000 7fafa994d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafa40be340 0x7fafa4141b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:19.765 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.758+0000 7fafa2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafa40683f0 0x7fafa4159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:19.765 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.758+0000 7fafa2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafa40683f0 0x7fafa4159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55332/0 (socket says 172.21.15.146:55332) 2021-01-27T09:53:19.765 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.758+0000 7fafa994d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fafa40be720 0x7fafa40bc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:19.766 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.762+0000 7fafa2ffd700 1 -- 172.21.15.146:0/649019582 learned_addr learned my addr 172.21.15.146:0/649019582 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:19.766 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.762+0000 7fafa27fc700 1 --2- 172.21.15.146:0/649019582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafa40be340 0x7fafa4141b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:19.766 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.762+0000 7fafa994d700 1 -- 172.21.15.146:0/649019582 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa41493d0 con 0x7fafa40be340 2021-01-27T09:53:19.766 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.762+0000 7fafa994d700 1 -- 172.21.15.146:0/649019582 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa415a100 con 0x7fafa40683f0 2021-01-27T09:53:19.767 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.762+0000 7fafa994d700 1 -- 172.21.15.146:0/649019582 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa414fc60 con 0x7fafa40be720 2021-01-27T09:53:19.767 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.762+0000 7fafa37fe700 1 --2- 172.21.15.146:0/649019582 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fafa40be720 0x7fafa40bc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:19.767 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.762+0000 7fafa37fe700 1 -- 172.21.15.146:0/649019582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafa40683f0 msgr2=0x7fafa4159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:19.768 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.762+0000 7fafa37fe700 1 --2- 172.21.15.146:0/649019582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafa40683f0 0x7fafa4159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:19.768 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.762+0000 7fafa37fe700 1 -- 172.21.15.146:0/649019582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafa40be340 msgr2=0x7fafa4141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:19.768 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.762+0000 7fafa37fe700 1 --2- 172.21.15.146:0/649019582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafa40be340 0x7fafa4141b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:19.768 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.762+0000 7fafa37fe700 1 -- 172.21.15.146:0/649019582 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa4148bf0 con 0x7fafa40be720 2021-01-27T09:53:19.768 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.762+0000 7fafa37fe700 1 --2- 172.21.15.146:0/649019582 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fafa40be720 0x7fafa40bc6a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7faf9c00cb20 tx=0x7faf9c008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:19.776 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.770+0000 7faf8affd700 1 -- 172.21.15.146:0/649019582 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c007810 con 0x7fafa40be720 2021-01-27T09:53:19.777 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.770+0000 7faf8affd700 1 -- 172.21.15.146:0/649019582 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c007970 con 0x7fafa40be720 2021-01-27T09:53:19.777 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.770+0000 7fafa994d700 1 -- 172.21.15.146:0/649019582 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa4148e90 con 0x7fafa40be720 2021-01-27T09:53:19.777 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.770+0000 7fafa994d700 1 -- 172.21.15.146:0/649019582 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa4142030 con 0x7fafa40be720 2021-01-27T09:53:19.778 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.774+0000 7fafa994d700 1 -- 172.21.15.146:0/649019582 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa40bc280 con 0x7fafa40be720 2021-01-27T09:53:19.781 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.774+0000 7faf8affd700 1 -- 172.21.15.146:0/649019582 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c007cf0 con 0x7fafa40be720 2021-01-27T09:53:19.801 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.798+0000 7faf8affd700 1 -- 172.21.15.146:0/649019582 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7faf9c011620 con 0x7fafa40be720 2021-01-27T09:53:19.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.798+0000 7faf8affd700 1 --2- 172.21.15.146:0/649019582 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7faf84056200 0x7faf840586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:19.804 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.798+0000 7faf8affd700 1 -- 172.21.15.146:0/649019582 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7faf9c070510 con 0x7fafa40be720 2021-01-27T09:53:19.804 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.798+0000 7fafa2ffd700 1 --2- 172.21.15.146:0/649019582 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7faf84056200 0x7faf840586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:19.805 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.798+0000 7faf8affd700 1 -- 172.21.15.146:0/649019582 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7faf9c0709a0 con 0x7fafa40be720 2021-01-27T09:53:19.805 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:19.798+0000 7fafa2ffd700 1 --2- 172.21.15.146:0/649019582 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7faf84056200 0x7faf840586c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7faf9400bbe0 tx=0x7faf94006f90).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:20.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.106+0000 7fafa994d700 1 -- 172.21.15.146:0/649019582 --> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fafa4044680 con 0x7faf84056200 2021-01-27T09:53:20.114 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.110+0000 7faf8affd700 1 -- 172.21.15.146:0/649019582 <== mgr.4104 v2:172.21.15.78:6832/15486 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fafa4044680 con 0x7faf84056200 2021-01-27T09:53:20.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.130+0000 7fafa994d700 1 -- 172.21.15.146:0/649019582 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7faf84056200 msgr2=0x7faf840586c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:20.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.130+0000 7fafa994d700 1 --2- 172.21.15.146:0/649019582 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7faf84056200 0x7faf840586c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7faf9400bbe0 tx=0x7faf94006f90).stop 2021-01-27T09:53:20.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.130+0000 7fafa994d700 1 -- 172.21.15.146:0/649019582 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fafa40be720 msgr2=0x7fafa40bc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:20.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.130+0000 7fafa994d700 1 --2- 172.21.15.146:0/649019582 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fafa40be720 0x7fafa40bc6a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7faf9c00cb20 tx=0x7faf9c008040).stop 2021-01-27T09:53:20.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.130+0000 7fafa994d700 1 -- 172.21.15.146:0/649019582 shutdown_connections 2021-01-27T09:53:20.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.130+0000 7fafa994d700 1 --2- 172.21.15.146:0/649019582 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fafa40be720 0x7fafa40bc6a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:20.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.130+0000 7fafa994d700 1 --2- 172.21.15.146:0/649019582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafa40be340 0x7fafa4141b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:20.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.130+0000 7fafa994d700 1 --2- 172.21.15.146:0/649019582 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7faf84056200 0x7faf840586c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:20.137 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.130+0000 7fafa994d700 1 --2- 172.21.15.146:0/649019582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafa40683f0 0x7fafa4159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:20.138 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.134+0000 7fafa994d700 1 -- 172.21.15.146:0/649019582 >> 172.21.15.146:0/649019582 conn(0x7fafa4067e10 msgr2=0x7fafa4144ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:20.149 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.142+0000 7fafa994d700 1 -- 172.21.15.146:0/649019582 shutdown_connections 2021-01-27T09:53:20.149 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.142+0000 7fafa994d700 1 -- 172.21.15.146:0/649019582 wait complete. 2021-01-27T09:53:20.151 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 0 to deep-scrub 2021-01-27T09:53:20.195 INFO:tasks.ceph:Scrubbing osd.1 2021-01-27T09:53:20.196 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2021-01-27T09:53:20.489 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.474+0000 7f19ce8f2700 1 Processor -- start 2021-01-27T09:53:20.489 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.474+0000 7f19ce8f2700 1 -- start start 2021-01-27T09:53:20.490 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.478+0000 7f19ce8f2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19c8062e20 0x7f19c814c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:20.490 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.478+0000 7f19ce8f2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19c8063200 0x7f19c8148c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:20.490 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.482+0000 7f19cd8f0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19c8062e20 0x7f19c814c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:20.490 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.482+0000 7f19cd8f0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19c8062e20 0x7f19c814c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55344/0 (socket says 172.21.15.146:55344) 2021-01-27T09:53:20.491 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.482+0000 7f19cd0ef700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f19c80bcc60 0x7f19c80bbfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54918/0 (socket says 172.21.15.146:54918) 2021-01-27T09:53:20.491 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.482+0000 7f19cd8f0700 1 -- 172.21.15.146:0/3042098636 learned_addr learned my addr 172.21.15.146:0/3042098636 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:20.491 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.482+0000 7f19ce8f2700 1 -- 172.21.15.146:0/3042098636 --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c80b9700 con 0x7f19c80bcc60 2021-01-27T09:53:20.491 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.486+0000 7f19ce0f1700 1 --2- 172.21.15.146:0/3042098636 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19c8063200 0x7f19c8148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:20.493 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.486+0000 7f19ce8f2700 1 -- 172.21.15.146:0/3042098636 --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c80bacb0 con 0x7f19c8062e20 2021-01-27T09:53:20.494 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.486+0000 7f19ce8f2700 1 -- 172.21.15.146:0/3042098636 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c814cb80 con 0x7f19c8063200 2021-01-27T09:53:20.494 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.486+0000 7f19ce0f1700 1 -- 172.21.15.146:0/3042098636 >> v2:172.21.15.146:3300/0 conn(0x7f19c8062e20 msgr2=0x7f19c814c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:53:20.494 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.486+0000 7f19ce0f1700 1 --2- 172.21.15.146:0/3042098636 >> v2:172.21.15.146:3300/0 conn(0x7f19c8062e20 0x7f19c814c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:20.494 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.486+0000 7f19ce0f1700 1 -- 172.21.15.146:0/3042098636 >> v1:172.21.15.146:6789/0 conn(0x7f19c80bcc60 legacy=0x7f19c80bbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:20.495 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.486+0000 7f19ce0f1700 1 -- 172.21.15.146:0/3042098636 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c80bc6d0 con 0x7f19c8063200 2021-01-27T09:53:20.495 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.486+0000 7f19cd8f0700 1 --2- 172.21.15.146:0/3042098636 >> v2:172.21.15.146:3300/0 conn(0x7f19c8062e20 0x7f19c814c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:53:20.495 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.486+0000 7f19ce0f1700 1 --2- 172.21.15.146:0/3042098636 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19c8063200 0x7f19c8148c40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f19c0009cc0 tx=0x7f19c0009220).ready entity=mon.2 client_cookie=f46189a48da7d7b server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:20.508 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.502+0000 7f19cc8ee700 1 -- 172.21.15.146:0/3042098636 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c000b9d0 con 0x7f19c8063200 2021-01-27T09:53:20.509 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.502+0000 7f19cc8ee700 1 -- 172.21.15.146:0/3042098636 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c000bb30 con 0x7f19c8063200 2021-01-27T09:53:20.509 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.502+0000 7f19cc8ee700 1 -- 172.21.15.146:0/3042098636 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c0011400 con 0x7f19c8063200 2021-01-27T09:53:20.510 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.502+0000 7f19ce8f2700 1 -- 172.21.15.146:0/3042098636 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19c8063200 msgr2=0x7f19c8148c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:20.510 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.502+0000 7f19ce8f2700 1 --2- 172.21.15.146:0/3042098636 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19c8063200 0x7f19c8148c40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f19c0009cc0 tx=0x7f19c0009220).stop 2021-01-27T09:53:20.511 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.502+0000 7f19ce8f2700 1 -- 172.21.15.146:0/3042098636 shutdown_connections 2021-01-27T09:53:20.511 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.502+0000 7f19ce8f2700 1 --2- 172.21.15.146:0/3042098636 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19c8063200 0x7f19c8148c40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:20.511 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.502+0000 7f19ce8f2700 1 --2- 172.21.15.146:0/3042098636 >> v2:172.21.15.146:3300/0 conn(0x7f19c8062e20 0x7f19c814c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:20.511 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.502+0000 7f19ce8f2700 1 -- 172.21.15.146:0/3042098636 >> 172.21.15.146:0/3042098636 conn(0x7f19c8064240 msgr2=0x7f19c8069110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:20.512 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.506+0000 7f19ce8f2700 1 -- 172.21.15.146:0/3042098636 shutdown_connections 2021-01-27T09:53:20.512 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.506+0000 7f19ce8f2700 1 -- 172.21.15.146:0/3042098636 wait complete. 2021-01-27T09:53:20.514 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.510+0000 7f19ce8f2700 1 Processor -- start 2021-01-27T09:53:20.514 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.510+0000 7f19ce8f2700 1 -- start start 2021-01-27T09:53:20.515 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.510+0000 7f19ce8f2700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19c8062e20 0x7f19c80be5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:20.516 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.510+0000 7f19ce8f2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19c8063200 0x7f19c8159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:20.516 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.510+0000 7f19ce8f2700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19c80bf360 0x7f19c8155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:20.517 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.510+0000 7f19cd8f0700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19c8062e20 0x7f19c80be5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:20.517 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.510+0000 7f19cd8f0700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19c8062e20 0x7f19c80be5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:44836/0 (socket says 172.21.15.146:44836) 2021-01-27T09:53:20.517 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.510+0000 7f19cd8f0700 1 -- 172.21.15.146:0/3109122292 learned_addr learned my addr 172.21.15.146:0/3109122292 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:20.517 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.510+0000 7f19cd0ef700 1 --2- 172.21.15.146:0/3109122292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19c8063200 0x7f19c8159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:20.518 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.510+0000 7f19ce0f1700 1 --2- 172.21.15.146:0/3109122292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19c80bf360 0x7f19c8155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:20.518 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.510+0000 7f19ce8f2700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c80c1e60 con 0x7f19c80bf360 2021-01-27T09:53:20.518 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.510+0000 7f19ce8f2700 1 -- 172.21.15.146:0/3109122292 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c80c2a50 con 0x7f19c8063200 2021-01-27T09:53:20.518 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.510+0000 7f19ce8f2700 1 -- 172.21.15.146:0/3109122292 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c80c20c0 con 0x7f19c8062e20 2021-01-27T09:53:20.520 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.514+0000 7f19cd0ef700 1 -- 172.21.15.146:0/3109122292 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19c8062e20 msgr2=0x7f19c80be5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:20.521 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.514+0000 7f19cd0ef700 1 --2- 172.21.15.146:0/3109122292 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19c8062e20 0x7f19c80be5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:20.521 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.514+0000 7f19cd0ef700 1 -- 172.21.15.146:0/3109122292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19c80bf360 msgr2=0x7f19c8155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:20.522 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.514+0000 7f19cd0ef700 1 --2- 172.21.15.146:0/3109122292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19c80bf360 0x7f19c8155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:20.522 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.514+0000 7f19cd0ef700 1 -- 172.21.15.146:0/3109122292 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c80c2360 con 0x7f19c8063200 2021-01-27T09:53:20.522 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.514+0000 7f19ce0f1700 1 --2- 172.21.15.146:0/3109122292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19c80bf360 0x7f19c8155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:53:20.523 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.514+0000 7f19cd8f0700 1 --2- 172.21.15.146:0/3109122292 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19c8062e20 0x7f19c80be5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:53:20.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.514+0000 7f19cd0ef700 1 --2- 172.21.15.146:0/3109122292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19c8063200 0x7f19c8159910 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f19c40096e0 tx=0x7f19c4006ce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:20.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.514+0000 7f19bdffb700 1 -- 172.21.15.146:0/3109122292 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c400f510 con 0x7f19c8063200 2021-01-27T09:53:20.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.514+0000 7f19bdffb700 1 -- 172.21.15.146:0/3109122292 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c400f690 con 0x7f19c8063200 2021-01-27T09:53:20.525 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.514+0000 7f19bdffb700 1 -- 172.21.15.146:0/3109122292 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c400fa50 con 0x7f19c8063200 2021-01-27T09:53:20.525 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.514+0000 7f19ce8f2700 1 -- 172.21.15.146:0/3109122292 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c80c2600 con 0x7f19c8063200 2021-01-27T09:53:20.525 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.514+0000 7f19ce8f2700 1 -- 172.21.15.146:0/3109122292 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c8159470 con 0x7f19c8063200 2021-01-27T09:53:20.526 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.518+0000 7f19bdffb700 1 -- 172.21.15.146:0/3109122292 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f19c400f070 con 0x7f19c8063200 2021-01-27T09:53:20.527 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.518+0000 7f19bdffb700 1 --2- 172.21.15.146:0/3109122292 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f19b00561b0 0x7f19b0058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:20.527 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.518+0000 7f19bdffb700 1 -- 172.21.15.146:0/3109122292 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7f19c406efe0 con 0x7f19c8063200 2021-01-27T09:53:20.527 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.518+0000 7f19cd8f0700 1 --2- 172.21.15.146:0/3109122292 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f19b00561b0 0x7f19b0058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:20.527 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.518+0000 7f19cd8f0700 1 --2- 172.21.15.146:0/3109122292 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f19b00561b0 0x7f19b0058670 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f19b8016ce0 tx=0x7f19b8008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:20.529 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.522+0000 7f19ab7fe700 1 --2- 172.21.15.146:0/3109122292 >> [v2:172.21.15.146:6816/14472,v1:172.21.15.146:6817/14472] conn(0x7f19c80bcc60 0x7f19c815c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:20.529 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.526+0000 7f19ab7fe700 1 -- 172.21.15.146:0/3109122292 --> [v2:172.21.15.146:6816/14472,v1:172.21.15.146:6817/14472] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f19c80bf800 con 0x7f19c80bcc60 2021-01-27T09:53:20.530 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.526+0000 7f19ce0f1700 1 --2- 172.21.15.146:0/3109122292 >> [v2:172.21.15.146:6816/14472,v1:172.21.15.146:6817/14472] conn(0x7f19c80bcc60 0x7f19c815c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:20.531 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.526+0000 7f19ce0f1700 1 --2- 172.21.15.146:0/3109122292 >> [v2:172.21.15.146:6816/14472,v1:172.21.15.146:6817/14472] conn(0x7f19c80bcc60 0x7f19c815c5d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:20.537 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.530+0000 7f19bdffb700 1 -- 172.21.15.146:0/3109122292 <== osd.1 v2:172.21.15.146:6816/14472 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f19c80bf800 con 0x7f19c80bcc60 2021-01-27T09:53:20.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.562+0000 7f19ab7fe700 1 -- 172.21.15.146:0/3109122292 --> [v2:172.21.15.146:6816/14472,v1:172.21.15.146:6817/14472] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f19c8044680 con 0x7f19c80bcc60 2021-01-27T09:53:20.569 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.566+0000 7f19bdffb700 1 -- 172.21.15.146:0/3109122292 <== osd.1 v2:172.21.15.146:6816/14472 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f19c8044680 con 0x7f19c80bcc60 2021-01-27T09:53:20.570 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2021-01-27T09:53:20.570 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-01-27T09:53:20.570 INFO:teuthology.orchestra.run.smithi146.stdout:} 2021-01-27T09:53:20.571 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.566+0000 7f19ab7fe700 1 -- 172.21.15.146:0/3109122292 >> [v2:172.21.15.146:6816/14472,v1:172.21.15.146:6817/14472] conn(0x7f19c80bcc60 msgr2=0x7f19c815c5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:20.571 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.566+0000 7f19ab7fe700 1 --2- 172.21.15.146:0/3109122292 >> [v2:172.21.15.146:6816/14472,v1:172.21.15.146:6817/14472] conn(0x7f19c80bcc60 0x7f19c815c5d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:20.571 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.566+0000 7f19ab7fe700 1 -- 172.21.15.146:0/3109122292 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f19b00561b0 msgr2=0x7f19b0058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:20.572 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.566+0000 7f19ab7fe700 1 --2- 172.21.15.146:0/3109122292 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f19b00561b0 0x7f19b0058670 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f19b8016ce0 tx=0x7f19b8008040).stop 2021-01-27T09:53:20.572 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.566+0000 7f19ab7fe700 1 -- 172.21.15.146:0/3109122292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19c8063200 msgr2=0x7f19c8159910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:20.572 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.566+0000 7f19ab7fe700 1 --2- 172.21.15.146:0/3109122292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19c8063200 0x7f19c8159910 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f19c40096e0 tx=0x7f19c4006ce0).stop 2021-01-27T09:53:20.572 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.566+0000 7f19ce0f1700 1 -- 172.21.15.146:0/3109122292 reap_dead start 2021-01-27T09:53:20.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.570+0000 7f19ab7fe700 1 -- 172.21.15.146:0/3109122292 shutdown_connections 2021-01-27T09:53:20.574 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.570+0000 7f19ab7fe700 1 -- 172.21.15.146:0/3109122292 >> 172.21.15.146:0/3109122292 conn(0x7f19c8064240 msgr2=0x7f19c80635e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:20.575 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.570+0000 7f19ab7fe700 1 -- 172.21.15.146:0/3109122292 shutdown_connections 2021-01-27T09:53:20.575 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.570+0000 7f19ab7fe700 1 -- 172.21.15.146:0/3109122292 wait complete. 2021-01-27T09:53:20.604 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2021-01-27T09:53:20.840 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.826+0000 7f8e6a9e7700 1 Processor -- start 2021-01-27T09:53:20.841 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.826+0000 7f8e6a9e7700 1 -- start start 2021-01-27T09:53:20.841 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.830+0000 7f8e6a9e7700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8e64080790 0x7f8e64064d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:20.841 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.830+0000 7f8e6a9e7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8e64068480 0x7f8e640606e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:20.842 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.830+0000 7f8e6a9e7700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e6415dfa0 con 0x7f8e64080b70 2021-01-27T09:53:20.842 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.830+0000 7f8e6a9e7700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e6415e240 con 0x7f8e64080790 2021-01-27T09:53:20.842 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.830+0000 7f8e6a9e7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e6415e4e0 con 0x7f8e64068480 2021-01-27T09:53:20.842 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.830+0000 7f8e699e5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8e64080790 0x7f8e64064d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:20.842 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.830+0000 7f8e699e5700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8e64080790 0x7f8e64064d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:58234/0 (socket says 172.21.15.146:58234) 2021-01-27T09:53:20.843 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.830+0000 7f8e699e5700 1 -- 172.21.15.146:0/1833394614 learned_addr learned my addr 172.21.15.146:0/1833394614 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:20.844 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.830+0000 7f8e699e5700 1 -- 172.21.15.146:0/1833394614 >> v2:172.21.15.146:3300/0 conn(0x7f8e64068480 msgr2=0x7f8e640606e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:53:20.844 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.830+0000 7f8e699e5700 1 --2- 172.21.15.146:0/1833394614 >> v2:172.21.15.146:3300/0 conn(0x7f8e64068480 0x7f8e640606e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:53:20.844 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.830+0000 7f8e699e5700 1 -- 172.21.15.146:0/1833394614 >> v1:172.21.15.78:6789/0 conn(0x7f8e64080b70 legacy=0x7f8e640be310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:53:20.844 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.830+0000 7f8e699e5700 1 -- 172.21.15.146:0/1833394614 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6415e780 con 0x7f8e64080790 2021-01-27T09:53:20.844 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.830+0000 7f8e699e5700 1 --2- 172.21.15.146:0/1833394614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e64080790 0x7f8e64064d00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f8e64067aa0 tx=0x7f8e60005ac0).ready entity=mon.0 client_cookie=51b66702757168a3 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:20.845 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.830+0000 7f8e689e3700 1 -- 172.21.15.146:0/1833394614 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e60011290 con 0x7f8e64080790 2021-01-27T09:53:20.845 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.830+0000 7f8e689e3700 1 -- 172.21.15.146:0/1833394614 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e60009040 con 0x7f8e64080790 2021-01-27T09:53:20.845 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.830+0000 7f8e689e3700 1 -- 172.21.15.146:0/1833394614 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e60005d40 con 0x7f8e64080790 2021-01-27T09:53:20.845 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.830+0000 7f8e6a9e7700 1 -- 172.21.15.146:0/1833394614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e64080790 msgr2=0x7f8e64064d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:20.846 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.830+0000 7f8e6a9e7700 1 --2- 172.21.15.146:0/1833394614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e64080790 0x7f8e64064d00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f8e64067aa0 tx=0x7f8e60005ac0).stop 2021-01-27T09:53:20.846 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.834+0000 7f8e6a9e7700 1 -- 172.21.15.146:0/1833394614 shutdown_connections 2021-01-27T09:53:20.846 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.834+0000 7f8e6a9e7700 1 --2- 172.21.15.146:0/1833394614 >> v2:172.21.15.146:3300/0 conn(0x7f8e64068480 0x7f8e640606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:53:20.846 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.834+0000 7f8e6a9e7700 1 --2- 172.21.15.146:0/1833394614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e64080790 0x7f8e64064d00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:20.846 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.834+0000 7f8e6a9e7700 1 -- 172.21.15.146:0/1833394614 >> 172.21.15.146:0/1833394614 conn(0x7f8e64069110 msgr2=0x7f8e640694f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:20.847 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.838+0000 7f8e6a9e7700 1 -- 172.21.15.146:0/1833394614 shutdown_connections 2021-01-27T09:53:20.847 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.838+0000 7f8e6a9e7700 1 -- 172.21.15.146:0/1833394614 wait complete. 2021-01-27T09:53:20.848 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.842+0000 7f8e6a9e7700 1 Processor -- start 2021-01-27T09:53:20.848 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.842+0000 7f8e6a9e7700 1 -- start start 2021-01-27T09:53:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.846+0000 7f8e6a9e7700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8e64080790 0x7f8e640be5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.846+0000 7f8e6a9e7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e64080b70 0x7f8e6417e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.846+0000 7f8e699e5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8e64080790 0x7f8e640be5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:20.852 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.846+0000 7f8e699e5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8e64080790 0x7f8e640be5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:44848/0 (socket says 172.21.15.146:44848) 2021-01-27T09:53:20.852 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.846+0000 7f8e691e4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e64080b70 0x7f8e6417e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:20.852 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.846+0000 7f8e691e4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e64080b70 0x7f8e6417e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55364/0 (socket says 172.21.15.146:55364) 2021-01-27T09:53:20.853 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.846+0000 7f8e699e5700 1 -- 172.21.15.146:0/3673163475 learned_addr learned my addr 172.21.15.146:0/3673163475 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:20.853 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.850+0000 7f8e6a9e7700 1 --2- 172.21.15.146:0/3673163475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e6417ecd0 0x7f8e6414c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.850+0000 7f8e6a9e7700 1 -- 172.21.15.146:0/3673163475 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e64154c90 con 0x7f8e6417ecd0 2021-01-27T09:53:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.850+0000 7f8e6a9e7700 1 -- 172.21.15.146:0/3673163475 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6415bc50 con 0x7f8e64080b70 2021-01-27T09:53:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.850+0000 7f8e6a9e7700 1 -- 172.21.15.146:0/3673163475 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e640ba5f0 con 0x7f8e64080790 2021-01-27T09:53:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.850+0000 7f8e6a1e6700 1 --2- 172.21.15.146:0/3673163475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e6417ecd0 0x7f8e6414c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.850+0000 7f8e699e5700 1 -- 172.21.15.146:0/3673163475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e64080b70 msgr2=0x7f8e6417e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.850+0000 7f8e699e5700 1 --2- 172.21.15.146:0/3673163475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e64080b70 0x7f8e6417e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.850+0000 7f8e699e5700 1 -- 172.21.15.146:0/3673163475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e6417ecd0 msgr2=0x7f8e6414c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.850+0000 7f8e699e5700 1 --2- 172.21.15.146:0/3673163475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e6417ecd0 0x7f8e6414c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.850+0000 7f8e699e5700 1 -- 172.21.15.146:0/3673163475 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e64154750 con 0x7f8e64080790 2021-01-27T09:53:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.850+0000 7f8e699e5700 1 --2- 172.21.15.146:0/3673163475 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8e64080790 0x7f8e640be5e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f8e64063d60 tx=0x7f8e6001b000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:20.872 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.862+0000 7f8e59ffb700 1 -- 172.21.15.146:0/3673163475 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e600064a0 con 0x7f8e64080790 2021-01-27T09:53:20.872 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.862+0000 7f8e59ffb700 1 -- 172.21.15.146:0/3673163475 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e60006600 con 0x7f8e64080790 2021-01-27T09:53:20.872 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.862+0000 7f8e6a9e7700 1 -- 172.21.15.146:0/3673163475 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e641549f0 con 0x7f8e64080790 2021-01-27T09:53:20.872 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.862+0000 7f8e59ffb700 1 -- 172.21.15.146:0/3673163475 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e60006980 con 0x7f8e64080790 2021-01-27T09:53:20.873 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.862+0000 7f8e6a9e7700 1 -- 172.21.15.146:0/3673163475 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6415c0e0 con 0x7f8e64080790 2021-01-27T09:53:20.873 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.866+0000 7f8e59ffb700 1 -- 172.21.15.146:0/3673163475 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f8e60028070 con 0x7f8e64080790 2021-01-27T09:53:20.874 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.866+0000 7f8e59ffb700 1 --2- 172.21.15.146:0/3673163475 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f8e4c056230 0x7f8e4c0586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:20.874 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.866+0000 7f8e59ffb700 1 -- 172.21.15.146:0/3673163475 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7f8e60010030 con 0x7f8e64080790 2021-01-27T09:53:20.874 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.870+0000 7f8e691e4700 1 --2- 172.21.15.146:0/3673163475 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f8e4c056230 0x7f8e4c0586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:20.875 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.870+0000 7f8e691e4700 1 --2- 172.21.15.146:0/3673163475 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f8e4c056230 0x7f8e4c0586f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f8e64152fb0 tx=0x7f8e54008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:20.893 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.886+0000 7f8e477fe700 1 -- 172.21.15.146:0/3673163475 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e38004fa0 con 0x7f8e64080790 2021-01-27T09:53:20.901 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:20.898+0000 7f8e59ffb700 1 -- 172.21.15.146:0/3673163475 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f8e60045e70 con 0x7f8e64080790 2021-01-27T09:53:21.196 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.190+0000 7f8e477fe700 1 -- 172.21.15.146:0/3673163475 --> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e38000bc0 con 0x7f8e4c056230 2021-01-27T09:53:21.199 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.194+0000 7f8e59ffb700 1 -- 172.21.15.146:0/3673163475 <== mgr.4104 v2:172.21.15.78:6832/15486 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8e38000bc0 con 0x7f8e4c056230 2021-01-27T09:53:21.211 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.206+0000 7f8e477fe700 1 -- 172.21.15.146:0/3673163475 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f8e4c056230 msgr2=0x7f8e4c0586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:21.211 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.206+0000 7f8e477fe700 1 --2- 172.21.15.146:0/3673163475 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f8e4c056230 0x7f8e4c0586f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f8e64152fb0 tx=0x7f8e54008040).stop 2021-01-27T09:53:21.211 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.206+0000 7f8e477fe700 1 -- 172.21.15.146:0/3673163475 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8e64080790 msgr2=0x7f8e640be5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:21.212 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.206+0000 7f8e477fe700 1 --2- 172.21.15.146:0/3673163475 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8e64080790 0x7f8e640be5e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f8e64063d60 tx=0x7f8e6001b000).stop 2021-01-27T09:53:21.212 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.206+0000 7f8e477fe700 1 -- 172.21.15.146:0/3673163475 shutdown_connections 2021-01-27T09:53:21.212 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.206+0000 7f8e477fe700 1 --2- 172.21.15.146:0/3673163475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e6417ecd0 0x7f8e6414c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:21.213 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.206+0000 7f8e477fe700 1 --2- 172.21.15.146:0/3673163475 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f8e4c056230 0x7f8e4c0586f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:21.213 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.206+0000 7f8e477fe700 1 --2- 172.21.15.146:0/3673163475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e64080b70 0x7f8e6417e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:21.213 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.206+0000 7f8e477fe700 1 --2- 172.21.15.146:0/3673163475 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8e64080790 0x7f8e640be5e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:21.213 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.206+0000 7f8e477fe700 1 -- 172.21.15.146:0/3673163475 >> 172.21.15.146:0/3673163475 conn(0x7f8e64069110 msgr2=0x7f8e64153720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:21.214 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.206+0000 7f8e477fe700 1 -- 172.21.15.146:0/3673163475 shutdown_connections 2021-01-27T09:53:21.214 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.206+0000 7f8e477fe700 1 -- 172.21.15.146:0/3673163475 wait complete. 2021-01-27T09:53:21.217 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 1 to deep-scrub 2021-01-27T09:53:21.244 INFO:tasks.ceph:Scrubbing osd.2 2021-01-27T09:53:21.244 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2021-01-27T09:53:21.540 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.534+0000 7f393dabb700 1 Processor -- start 2021-01-27T09:53:21.540 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.534+0000 7f393dabb700 1 -- start start 2021-01-27T09:53:21.541 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.534+0000 7f393dabb700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f39380692b0 0x7f39380675e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:21.541 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.534+0000 7f393dabb700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3938060c70 0x7f3938066c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:21.541 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.534+0000 7f393dabb700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39380b7230 con 0x7f3938067150 2021-01-27T09:53:21.543 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.534+0000 7f393dabb700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39381555d0 con 0x7f3938060c70 2021-01-27T09:53:21.543 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.534+0000 7f393dabb700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39380bd6a0 con 0x7f39380692b0 2021-01-27T09:53:21.543 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.534+0000 7f393cab9700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f39380692b0 0x7f39380675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:21.544 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.534+0000 7f393cab9700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f39380692b0 0x7f39380675e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:44864/0 (socket says 172.21.15.146:44864) 2021-01-27T09:53:21.544 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.534+0000 7f393cab9700 1 -- 172.21.15.146:0/157540132 learned_addr learned my addr 172.21.15.146:0/157540132 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:21.544 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.534+0000 7f393d2ba700 1 --1- 172.21.15.146:0/157540132 >> v1:172.21.15.146:6789/0 conn(0x7f3938067150 0x7f393814eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54952/0 (socket says 172.21.15.146:54952) 2021-01-27T09:53:21.544 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.534+0000 7f3937fff700 1 --2- 172.21.15.146:0/157540132 >> v2:172.21.15.78:3300/0 conn(0x7f3938060c70 0x7f3938066c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:21.544 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.534+0000 7f393cab9700 1 -- 172.21.15.146:0/157540132 >> v2:172.21.15.78:3300/0 conn(0x7f3938060c70 msgr2=0x7f3938066c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:53:21.545 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.534+0000 7f393cab9700 1 --2- 172.21.15.146:0/157540132 >> v2:172.21.15.78:3300/0 conn(0x7f3938060c70 0x7f3938066c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:21.545 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.534+0000 7f393cab9700 1 -- 172.21.15.146:0/157540132 >> v1:172.21.15.146:6789/0 conn(0x7f3938067150 legacy=0x7f393814eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:21.545 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.534+0000 7f393cab9700 1 -- 172.21.15.146:0/157540132 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39380bd940 con 0x7f39380692b0 2021-01-27T09:53:21.545 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.538+0000 7f393cab9700 1 --2- 172.21.15.146:0/157540132 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f39380692b0 0x7f39380675e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f392c00ba20 tx=0x7f392c006ee0).ready entity=mon.2 client_cookie=8e2189983f1ceb45 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:21.546 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.538+0000 7f39377fe700 1 -- 172.21.15.146:0/157540132 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c009840 con 0x7f39380692b0 2021-01-27T09:53:21.546 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.538+0000 7f39377fe700 1 -- 172.21.15.146:0/157540132 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c0099a0 con 0x7f39380692b0 2021-01-27T09:53:21.546 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.538+0000 7f39377fe700 1 -- 172.21.15.146:0/157540132 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c009d20 con 0x7f39380692b0 2021-01-27T09:53:21.546 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.538+0000 7f393dabb700 1 -- 172.21.15.146:0/157540132 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f39380692b0 msgr2=0x7f39380675e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:21.547 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.538+0000 7f393dabb700 1 --2- 172.21.15.146:0/157540132 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f39380692b0 0x7f39380675e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f392c00ba20 tx=0x7f392c006ee0).stop 2021-01-27T09:53:21.567 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.554+0000 7f393dabb700 1 -- 172.21.15.146:0/157540132 shutdown_connections 2021-01-27T09:53:21.567 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.554+0000 7f393dabb700 1 --2- 172.21.15.146:0/157540132 >> v2:172.21.15.78:3300/0 conn(0x7f3938060c70 0x7f3938066c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:21.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.554+0000 7f393dabb700 1 --2- 172.21.15.146:0/157540132 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f39380692b0 0x7f39380675e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:21.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.554+0000 7f393dabb700 1 -- 172.21.15.146:0/157540132 >> 172.21.15.146:0/157540132 conn(0x7f3938064e60 msgr2=0x7f3938065240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:21.568 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.562+0000 7f393dabb700 1 -- 172.21.15.146:0/157540132 shutdown_connections 2021-01-27T09:53:21.572 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.562+0000 7f393dabb700 1 -- 172.21.15.146:0/157540132 wait complete. 2021-01-27T09:53:21.572 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.566+0000 7f393dabb700 1 Processor -- start 2021-01-27T09:53:21.572 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.566+0000 7f393dabb700 1 -- start start 2021-01-27T09:53:21.572 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.566+0000 7f393dabb700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3938060c70 0x7f3938162670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:21.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.566+0000 7f393dabb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3938067150 0x7f3938150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:21.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.566+0000 7f393dabb700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39380692b0 0x7f39381511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:21.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.566+0000 7f393dabb700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3938162b60 con 0x7f39380692b0 2021-01-27T09:53:21.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.566+0000 7f393dabb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3938151690 con 0x7f3938067150 2021-01-27T09:53:21.573 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.566+0000 7f393dabb700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39380bf370 con 0x7f3938060c70 2021-01-27T09:53:21.574 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.566+0000 7f393cab9700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3938060c70 0x7f3938162670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:21.574 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.566+0000 7f3937fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3938067150 0x7f3938150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:21.574 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.566+0000 7f393d2ba700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39380692b0 0x7f39381511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:21.574 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.566+0000 7f393cab9700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3938060c70 0x7f3938162670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:44870/0 (socket says 172.21.15.146:44870) 2021-01-27T09:53:21.575 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.566+0000 7f393cab9700 1 -- 172.21.15.146:0/3002311352 learned_addr learned my addr 172.21.15.146:0/3002311352 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:21.576 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.566+0000 7f393cab9700 1 -- 172.21.15.146:0/3002311352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3938067150 msgr2=0x7f3938150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:21.576 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.566+0000 7f393cab9700 1 --2- 172.21.15.146:0/3002311352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3938067150 0x7f3938150cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:21.576 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.566+0000 7f393cab9700 1 -- 172.21.15.146:0/3002311352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39380692b0 msgr2=0x7f39381511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:21.576 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.566+0000 7f393cab9700 1 --2- 172.21.15.146:0/3002311352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39380692b0 0x7f39381511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:21.577 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.566+0000 7f393cab9700 1 -- 172.21.15.146:0/3002311352 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39380ae280 con 0x7f3938060c70 2021-01-27T09:53:21.577 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.566+0000 7f393d2ba700 1 --2- 172.21.15.146:0/3002311352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39380692b0 0x7f39381511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:53:21.577 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.566+0000 7f393cab9700 1 --2- 172.21.15.146:0/3002311352 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3938060c70 0x7f3938162670 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f392c0093a0 tx=0x7f392c016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:21.578 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.570+0000 7f3934ff9700 1 -- 172.21.15.146:0/3002311352 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c009840 con 0x7f3938060c70 2021-01-27T09:53:21.578 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.570+0000 7f393dabb700 1 -- 172.21.15.146:0/3002311352 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39380bf5a0 con 0x7f3938060c70 2021-01-27T09:53:21.579 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.570+0000 7f393dabb700 1 -- 172.21.15.146:0/3002311352 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39380ae4e0 con 0x7f3938060c70 2021-01-27T09:53:21.581 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.574+0000 7f393dabb700 1 -- 172.21.15.146:0/3002311352 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f39380bb510 con 0x7f3938060c70 2021-01-27T09:53:21.581 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.578+0000 7f3934ff9700 1 -- 172.21.15.146:0/3002311352 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c011d40 con 0x7f3938060c70 2021-01-27T09:53:21.583 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.578+0000 7f3934ff9700 1 -- 172.21.15.146:0/3002311352 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c01c650 con 0x7f3938060c70 2021-01-27T09:53:21.583 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.578+0000 7f3934ff9700 1 -- 172.21.15.146:0/3002311352 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f392c00f070 con 0x7f3938060c70 2021-01-27T09:53:21.583 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.578+0000 7f3934ff9700 1 --2- 172.21.15.146:0/3002311352 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f3924056400 0x7f39240588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:21.584 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.578+0000 7f3937fff700 1 --2- 172.21.15.146:0/3002311352 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f3924056400 0x7f39240588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:21.584 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.578+0000 7f3937fff700 1 --2- 172.21.15.146:0/3002311352 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f3924056400 0x7f39240588c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f39380c0010 tx=0x7f3930008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:21.585 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.578+0000 7f3934ff9700 1 -- 172.21.15.146:0/3002311352 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7f392c070c80 con 0x7f3938060c70 2021-01-27T09:53:21.586 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.578+0000 7f3934ff9700 1 --2- 172.21.15.146:0/3002311352 >> [v2:172.21.15.146:6820/14474,v1:172.21.15.146:6822/14474] conn(0x7f392405e7d0 0x7f3924060c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:21.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.578+0000 7f3934ff9700 1 -- 172.21.15.146:0/3002311352 --> [v2:172.21.15.146:6820/14474,v1:172.21.15.146:6822/14474] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f39240612f0 con 0x7f392405e7d0 2021-01-27T09:53:21.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.578+0000 7f3934ff9700 1 -- 172.21.15.146:0/3002311352 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f392c073220 con 0x7f3938060c70 2021-01-27T09:53:21.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.582+0000 7f393d2ba700 1 --2- 172.21.15.146:0/3002311352 >> [v2:172.21.15.146:6820/14474,v1:172.21.15.146:6822/14474] conn(0x7f392405e7d0 0x7f3924060c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:21.587 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.582+0000 7f393d2ba700 1 --2- 172.21.15.146:0/3002311352 >> [v2:172.21.15.146:6820/14474,v1:172.21.15.146:6822/14474] conn(0x7f392405e7d0 0x7f3924060c70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:21.588 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.582+0000 7f3934ff9700 1 -- 172.21.15.146:0/3002311352 <== osd.2 v2:172.21.15.146:6820/14474 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f39240612f0 con 0x7f392405e7d0 2021-01-27T09:53:21.634 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.630+0000 7f393dabb700 1 -- 172.21.15.146:0/3002311352 --> [v2:172.21.15.146:6820/14474,v1:172.21.15.146:6822/14474] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f39380bb510 con 0x7f392405e7d0 2021-01-27T09:53:21.636 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.630+0000 7f3934ff9700 1 -- 172.21.15.146:0/3002311352 <== osd.2 v2:172.21.15.146:6820/14474 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f39380bb510 con 0x7f392405e7d0 2021-01-27T09:53:21.637 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2021-01-27T09:53:21.637 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-01-27T09:53:21.638 INFO:teuthology.orchestra.run.smithi146.stdout:} 2021-01-27T09:53:21.643 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.638+0000 7f393dabb700 1 -- 172.21.15.146:0/3002311352 >> [v2:172.21.15.146:6820/14474,v1:172.21.15.146:6822/14474] conn(0x7f392405e7d0 msgr2=0x7f3924060c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:21.643 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.638+0000 7f393dabb700 1 --2- 172.21.15.146:0/3002311352 >> [v2:172.21.15.146:6820/14474,v1:172.21.15.146:6822/14474] conn(0x7f392405e7d0 0x7f3924060c70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:21.643 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.638+0000 7f393dabb700 1 -- 172.21.15.146:0/3002311352 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f3924056400 msgr2=0x7f39240588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:21.643 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.638+0000 7f393dabb700 1 --2- 172.21.15.146:0/3002311352 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f3924056400 0x7f39240588c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f39380c0010 tx=0x7f3930008040).stop 2021-01-27T09:53:21.644 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.638+0000 7f393dabb700 1 -- 172.21.15.146:0/3002311352 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3938060c70 msgr2=0x7f3938162670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:21.644 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.638+0000 7f393dabb700 1 --2- 172.21.15.146:0/3002311352 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3938060c70 0x7f3938162670 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f392c0093a0 tx=0x7f392c016000).stop 2021-01-27T09:53:21.644 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.638+0000 7f393d2ba700 1 -- 172.21.15.146:0/3002311352 reap_dead start 2021-01-27T09:53:21.645 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.638+0000 7f393dabb700 1 -- 172.21.15.146:0/3002311352 shutdown_connections 2021-01-27T09:53:21.645 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.638+0000 7f393dabb700 1 -- 172.21.15.146:0/3002311352 >> 172.21.15.146:0/3002311352 conn(0x7f3938064e60 msgr2=0x7f393814efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.646+0000 7f393dabb700 1 -- 172.21.15.146:0/3002311352 shutdown_connections 2021-01-27T09:53:21.653 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.650+0000 7f393dabb700 1 -- 172.21.15.146:0/3002311352 wait complete. 2021-01-27T09:53:21.684 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2021-01-27T09:53:21.901 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.894+0000 7ff3c549a700 1 Processor -- start 2021-01-27T09:53:21.902 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.898+0000 7ff3c549a700 1 -- start start 2021-01-27T09:53:21.904 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.898+0000 7ff3c549a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3c00bce70 0x7ff3c014ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:21.904 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.898+0000 7ff3beffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3c00bce70 0x7ff3c014ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:21.905 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.898+0000 7ff3beffd700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3c00bce70 0x7ff3c014ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:44882/0 (socket says 172.21.15.146:44882) 2021-01-27T09:53:21.905 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.898+0000 7ff3be7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff3c00bea30 0x7ff3c0147270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54970/0 (socket says 172.21.15.146:54970) 2021-01-27T09:53:21.905 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.898+0000 7ff3beffd700 1 -- 172.21.15.146:0/2313337652 learned_addr learned my addr 172.21.15.146:0/2313337652 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:21.906 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.898+0000 7ff3c549a700 1 -- 172.21.15.146:0/2313337652 --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c00bf090 con 0x7ff3c00bd250 2021-01-27T09:53:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.902+0000 7ff3c549a700 1 -- 172.21.15.146:0/2313337652 --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c00b9b30 con 0x7ff3c00bea30 2021-01-27T09:53:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.902+0000 7ff3bdffb700 1 -- 172.21.15.146:0/2313337652 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273160179 0 0) 0x7ff3c00bf090 con 0x7ff3c00bd250 2021-01-27T09:53:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.902+0000 7ff3c549a700 1 -- 172.21.15.146:0/2313337652 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c00b9dd0 con 0x7ff3c00bce70 2021-01-27T09:53:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.902+0000 7ff3beffd700 1 -- 172.21.15.146:0/2313337652 >> v1:172.21.15.146:6789/0 conn(0x7ff3c00bea30 legacy=0x7ff3c0147270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.902+0000 7ff3beffd700 1 -- 172.21.15.146:0/2313337652 >> v1:172.21.15.78:6789/0 conn(0x7ff3c00bd250 legacy=0x7ff3c0154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.902+0000 7ff3beffd700 1 -- 172.21.15.146:0/2313337652 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c00ba070 con 0x7ff3c00bce70 2021-01-27T09:53:21.913 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.910+0000 7ff3beffd700 1 --2- 172.21.15.146:0/2313337652 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3c00bce70 0x7ff3c014ded0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7ff3b000dce0 tx=0x7ff3b0006e70).ready entity=mon.2 client_cookie=9d9087a2013187fe server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:21.916 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.910+0000 7ff3bdffb700 1 -- 172.21.15.146:0/2313337652 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b000be00 con 0x7ff3c00bce70 2021-01-27T09:53:21.917 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.910+0000 7ff3bdffb700 1 -- 172.21.15.146:0/2313337652 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b0016440 con 0x7ff3c00bce70 2021-01-27T09:53:21.917 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.910+0000 7ff3bdffb700 1 -- 172.21.15.146:0/2313337652 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b00167c0 con 0x7ff3c00bce70 2021-01-27T09:53:21.918 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.914+0000 7ff3c549a700 1 -- 172.21.15.146:0/2313337652 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3c00bce70 msgr2=0x7ff3c014ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:21.918 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.914+0000 7ff3c549a700 1 --2- 172.21.15.146:0/2313337652 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3c00bce70 0x7ff3c014ded0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7ff3b000dce0 tx=0x7ff3b0006e70).stop 2021-01-27T09:53:21.924 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.918+0000 7ff3c549a700 1 -- 172.21.15.146:0/2313337652 shutdown_connections 2021-01-27T09:53:21.925 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.918+0000 7ff3c549a700 1 --2- 172.21.15.146:0/2313337652 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3c00bce70 0x7ff3c014ded0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:21.925 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.918+0000 7ff3c549a700 1 -- 172.21.15.146:0/2313337652 >> 172.21.15.146:0/2313337652 conn(0x7ff3c0067e10 msgr2=0x7ff3c0069110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:21.926 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.922+0000 7ff3c549a700 1 -- 172.21.15.146:0/2313337652 shutdown_connections 2021-01-27T09:53:21.926 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.922+0000 7ff3c549a700 1 -- 172.21.15.146:0/2313337652 wait complete. 2021-01-27T09:53:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.922+0000 7ff3c549a700 1 Processor -- start 2021-01-27T09:53:21.930 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.922+0000 7ff3c549a700 1 -- start start 2021-01-27T09:53:21.931 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.926+0000 7ff3c549a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c00bce70 0x7ff3c0143e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:21.931 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.926+0000 7ff3c549a700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3c00bd250 0x7ff3c015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:21.931 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.926+0000 7ff3c549a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3c00bea30 0x7ff3c015e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.926+0000 7ff3c549a700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c0148d80 con 0x7ff3c00bea30 2021-01-27T09:53:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.926+0000 7ff3c549a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c00bc2d0 con 0x7ff3c00bce70 2021-01-27T09:53:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.926+0000 7ff3c549a700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c00bc500 con 0x7ff3c00bd250 2021-01-27T09:53:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.926+0000 7ff3be7fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3c00bd250 0x7ff3c015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.926+0000 7ff3be7fc700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3c00bd250 0x7ff3c015dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:44888/0 (socket says 172.21.15.146:44888) 2021-01-27T09:53:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.926+0000 7ff3be7fc700 1 -- 172.21.15.146:0/2852338127 learned_addr learned my addr 172.21.15.146:0/2852338127 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.926+0000 7ff3bf7fe700 1 --2- 172.21.15.146:0/2852338127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3c00bea30 0x7ff3c015e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:21.935 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.926+0000 7ff3be7fc700 1 -- 172.21.15.146:0/2852338127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c00bce70 msgr2=0x7ff3c0143e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:21.935 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.926+0000 7ff3be7fc700 1 --2- 172.21.15.146:0/2852338127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c00bce70 0x7ff3c0143e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:53:21.935 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.926+0000 7ff3be7fc700 1 -- 172.21.15.146:0/2852338127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3c00bea30 msgr2=0x7ff3c015e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:21.936 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.926+0000 7ff3be7fc700 1 --2- 172.21.15.146:0/2852338127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3c00bea30 0x7ff3c015e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:21.936 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.926+0000 7ff3be7fc700 1 -- 172.21.15.146:0/2852338127 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c013e2e0 con 0x7ff3c00bd250 2021-01-27T09:53:21.936 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.926+0000 7ff3be7fc700 1 --2- 172.21.15.146:0/2852338127 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3c00bd250 0x7ff3c015dec0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7ff3b400c7c0 tx=0x7ff3b4007c00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:21.936 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.926+0000 7ff3a6ffd700 1 -- 172.21.15.146:0/2852338127 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4007170 con 0x7ff3c00bd250 2021-01-27T09:53:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.930+0000 7ff3a6ffd700 1 -- 172.21.15.146:0/2852338127 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b40072d0 con 0x7ff3c00bd250 2021-01-27T09:53:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.930+0000 7ff3c549a700 1 -- 172.21.15.146:0/2852338127 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c013e580 con 0x7ff3c00bd250 2021-01-27T09:53:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.930+0000 7ff3a6ffd700 1 -- 172.21.15.146:0/2852338127 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4004950 con 0x7ff3c00bd250 2021-01-27T09:53:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.930+0000 7ff3c549a700 1 -- 172.21.15.146:0/2852338127 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c015da20 con 0x7ff3c00bd250 2021-01-27T09:53:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.930+0000 7ff3c549a700 1 -- 172.21.15.146:0/2852338127 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c013ea20 con 0x7ff3c00bd250 2021-01-27T09:53:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.934+0000 7ff3a6ffd700 1 -- 172.21.15.146:0/2852338127 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7ff3b4010070 con 0x7ff3c00bd250 2021-01-27T09:53:21.947 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.942+0000 7ff3a6ffd700 1 --2- 172.21.15.146:0/2852338127 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff3a0056230 0x7ff3a00586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:21.948 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.942+0000 7ff3a6ffd700 1 -- 172.21.15.146:0/2852338127 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7ff3b406f2c0 con 0x7ff3c00bd250 2021-01-27T09:53:21.948 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.942+0000 7ff3beffd700 1 --2- 172.21.15.146:0/2852338127 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff3a0056230 0x7ff3a00586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:21.948 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.942+0000 7ff3beffd700 1 --2- 172.21.15.146:0/2852338127 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff3a0056230 0x7ff3a00586f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7ff3b0006eb0 tx=0x7ff3b0016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:21.949 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:21.942+0000 7ff3a6ffd700 1 -- 172.21.15.146:0/2852338127 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7ff3b4071840 con 0x7ff3c00bd250 2021-01-27T09:53:22.299 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.294+0000 7ff3c549a700 1 -- 172.21.15.146:0/2852338127 --> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3c015d8a0 con 0x7ff3a0056230 2021-01-27T09:53:22.300 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.294+0000 7ff3a6ffd700 1 -- 172.21.15.146:0/2852338127 <== mgr.4104 v2:172.21.15.78:6832/15486 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff3b000d9c0 con 0x7ff3a0056230 2021-01-27T09:53:22.303 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.298+0000 7ff3a4ff9700 1 -- 172.21.15.146:0/2852338127 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff3a0056230 msgr2=0x7ff3a00586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:22.303 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.298+0000 7ff3a4ff9700 1 --2- 172.21.15.146:0/2852338127 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff3a0056230 0x7ff3a00586f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7ff3b0006eb0 tx=0x7ff3b0016000).stop 2021-01-27T09:53:22.303 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.298+0000 7ff3a4ff9700 1 -- 172.21.15.146:0/2852338127 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3c00bd250 msgr2=0x7ff3c015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:22.304 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.298+0000 7ff3a4ff9700 1 --2- 172.21.15.146:0/2852338127 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3c00bd250 0x7ff3c015dec0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7ff3b400c7c0 tx=0x7ff3b4007c00).stop 2021-01-27T09:53:22.304 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.298+0000 7ff3a4ff9700 1 -- 172.21.15.146:0/2852338127 shutdown_connections 2021-01-27T09:53:22.304 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.298+0000 7ff3a4ff9700 1 --2- 172.21.15.146:0/2852338127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3c00bea30 0x7ff3c015e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:22.305 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.298+0000 7ff3a4ff9700 1 --2- 172.21.15.146:0/2852338127 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3c00bd250 0x7ff3c015dec0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:22.305 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.298+0000 7ff3a4ff9700 1 --2- 172.21.15.146:0/2852338127 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff3a0056230 0x7ff3a00586f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:22.305 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.298+0000 7ff3a4ff9700 1 --2- 172.21.15.146:0/2852338127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c00bce70 0x7ff3c0143e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:53:22.305 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.298+0000 7ff3a4ff9700 1 -- 172.21.15.146:0/2852338127 >> 172.21.15.146:0/2852338127 conn(0x7ff3c0067e10 msgr2=0x7ff3c0142c10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:22.306 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.298+0000 7ff3a4ff9700 1 -- 172.21.15.146:0/2852338127 shutdown_connections 2021-01-27T09:53:22.306 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.298+0000 7ff3a4ff9700 1 -- 172.21.15.146:0/2852338127 wait complete. 2021-01-27T09:53:22.311 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 2 to deep-scrub 2021-01-27T09:53:22.338 INFO:tasks.ceph:Scrubbing osd.3 2021-01-27T09:53:22.338 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2021-01-27T09:53:22.711 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.706+0000 7f5422d41700 1 Processor -- start 2021-01-27T09:53:22.711 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.706+0000 7f5422d41700 1 -- start start 2021-01-27T09:53:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.706+0000 7f5422d41700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f541c0647c0 0x7f541c0bc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.710+0000 7f5420add700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f541c0643e0 0x7f541c0bd010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:43018/0 (socket says 172.21.15.146:43018) 2021-01-27T09:53:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.710+0000 7f5422d41700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f541c0bc6d0 con 0x7f541c0643e0 2021-01-27T09:53:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.710+0000 7f5422d41700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f541c0bb920 con 0x7f541c148eb0 2021-01-27T09:53:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.710+0000 7f5422d41700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541c0bd730 con 0x7f541c0647c0 2021-01-27T09:53:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.710+0000 7f5420add700 1 -- 172.21.15.146:0/2968293173 learned_addr learned my addr 172.21.15.146:0/2968293173 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:53:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.710+0000 7f54212de700 1 --1- 172.21.15.146:0/2968293173 >> v1:172.21.15.146:6789/0 conn(0x7f541c148eb0 0x7f541c14c260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54988/0 (socket says 172.21.15.146:54988) 2021-01-27T09:53:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.710+0000 7f541bfff700 1 --2- 172.21.15.146:0/2968293173 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f541c0647c0 0x7f541c0bc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.710+0000 7f541b7fe700 1 -- 172.21.15.146:0/2968293173 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3201053665 0 0) 0x7f541c0bc6d0 con 0x7f541c0643e0 2021-01-27T09:53:22.719 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.710+0000 7f541b7fe700 1 -- 172.21.15.146:0/2968293173 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5400003270 con 0x7f541c0643e0 2021-01-27T09:53:22.719 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.710+0000 7f541b7fe700 1 -- 172.21.15.146:0/2968293173 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1674183352 0 0) 0x7f541c0bb920 con 0x7f541c148eb0 2021-01-27T09:53:22.719 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.710+0000 7f541b7fe700 1 -- 172.21.15.146:0/2968293173 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f541c0bc6d0 con 0x7f541c148eb0 2021-01-27T09:53:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.710+0000 7f541bfff700 1 -- 172.21.15.146:0/2968293173 >> v1:172.21.15.146:6789/0 conn(0x7f541c148eb0 legacy=0x7f541c14c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.710+0000 7f541bfff700 1 -- 172.21.15.146:0/2968293173 >> v1:172.21.15.78:6789/0 conn(0x7f541c0643e0 legacy=0x7f541c0bd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:22.721 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.710+0000 7f541bfff700 1 -- 172.21.15.146:0/2968293173 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c0bbbc0 con 0x7f541c0647c0 2021-01-27T09:53:22.722 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.710+0000 7f541bfff700 1 --2- 172.21.15.146:0/2968293173 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f541c0647c0 0x7f541c0bc100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f541000b9f0 tx=0x7f5410006e20).ready entity=mon.2 client_cookie=4f8a9d646c9d44bd server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:22.723 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.710+0000 7f541b7fe700 1 -- 172.21.15.146:0/2968293173 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5410009640 con 0x7f541c0647c0 2021-01-27T09:53:22.723 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.710+0000 7f541b7fe700 1 -- 172.21.15.146:0/2968293173 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54100097a0 con 0x7f541c0647c0 2021-01-27T09:53:22.723 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.710+0000 7f541b7fe700 1 -- 172.21.15.146:0/2968293173 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5410009b20 con 0x7f541c0647c0 2021-01-27T09:53:22.724 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.710+0000 7f5422d41700 1 -- 172.21.15.146:0/2968293173 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f541c0647c0 msgr2=0x7f541c0bc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:22.724 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.710+0000 7f5422d41700 1 --2- 172.21.15.146:0/2968293173 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f541c0647c0 0x7f541c0bc100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f541000b9f0 tx=0x7f5410006e20).stop 2021-01-27T09:53:22.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.710+0000 7f5422d41700 1 -- 172.21.15.146:0/2968293173 shutdown_connections 2021-01-27T09:53:22.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.710+0000 7f5422d41700 1 --2- 172.21.15.146:0/2968293173 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f541c0647c0 0x7f541c0bc100 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:22.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.710+0000 7f5422d41700 1 -- 172.21.15.146:0/2968293173 >> 172.21.15.146:0/2968293173 conn(0x7f541c067e60 msgr2=0x7f541c060020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:22.726 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.714+0000 7f5422d41700 1 -- 172.21.15.146:0/2968293173 shutdown_connections 2021-01-27T09:53:22.726 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.714+0000 7f5422d41700 1 -- 172.21.15.146:0/2968293173 wait complete. 2021-01-27T09:53:22.727 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.714+0000 7f5422d41700 1 Processor -- start 2021-01-27T09:53:22.729 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.718+0000 7f5422d41700 1 -- start start 2021-01-27T09:53:22.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.718+0000 7f5422d41700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f541c0647c0 0x7f541c066d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:22.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.718+0000 7f5422d41700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f541c148eb0 0x7f541c0beec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:22.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.718+0000 7f5422d41700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f541c0bf3b0 0x7f541c0c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:22.731 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.718+0000 7f5422d41700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c141af0 con 0x7f541c148eb0 2021-01-27T09:53:22.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.718+0000 7f5422d41700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c14bbb0 con 0x7f541c0647c0 2021-01-27T09:53:22.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.718+0000 7f5422d41700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541c0bdd00 con 0x7f541c0bf3b0 2021-01-27T09:53:22.732 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.718+0000 7f541bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f541c148eb0 0x7f541c0beec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:22.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.718+0000 7f541bfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f541c148eb0 0x7f541c0beec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:58294/0 (socket says 172.21.15.146:58294) 2021-01-27T09:53:22.733 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.718+0000 7f541bfff700 1 -- 172.21.15.146:0/1327946977 learned_addr learned my addr 172.21.15.146:0/1327946977 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:22.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.718+0000 7f5420add700 1 --2- 172.21.15.146:0/1327946977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f541c0647c0 0x7f541c066d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:22.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.718+0000 7f54212de700 1 --2- 172.21.15.146:0/1327946977 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f541c0bf3b0 0x7f541c0c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:22.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.722+0000 7f54212de700 1 -- 172.21.15.146:0/1327946977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f541c0647c0 msgr2=0x7f541c066d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:22.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.722+0000 7f54212de700 1 --2- 172.21.15.146:0/1327946977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f541c0647c0 0x7f541c066d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:22.735 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.722+0000 7f54212de700 1 -- 172.21.15.146:0/1327946977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f541c148eb0 msgr2=0x7f541c0beec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:22.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.722+0000 7f54212de700 1 --2- 172.21.15.146:0/1327946977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f541c148eb0 0x7f541c0beec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:22.736 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.722+0000 7f54212de700 1 -- 172.21.15.146:0/1327946977 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c0bdfa0 con 0x7f541c0bf3b0 2021-01-27T09:53:22.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.722+0000 7f541bfff700 1 --2- 172.21.15.146:0/1327946977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f541c148eb0 0x7f541c0beec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:53:22.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.722+0000 7f5420add700 1 --2- 172.21.15.146:0/1327946977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f541c0647c0 0x7f541c066d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:53:22.737 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.722+0000 7f54212de700 1 --2- 172.21.15.146:0/1327946977 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f541c0bf3b0 0x7f541c0c25f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f541400ca60 tx=0x7f5414007cd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:22.738 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.726+0000 7f5418ff9700 1 -- 172.21.15.146:0/1327946977 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54140058e0 con 0x7f541c0bf3b0 2021-01-27T09:53:22.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.726+0000 7f5418ff9700 1 -- 172.21.15.146:0/1327946977 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5414005a40 con 0x7f541c0bf3b0 2021-01-27T09:53:22.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.726+0000 7f5422d41700 1 -- 172.21.15.146:0/1327946977 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f541c0be240 con 0x7f541c0bf3b0 2021-01-27T09:53:22.739 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.726+0000 7f5418ff9700 1 -- 172.21.15.146:0/1327946977 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5414005de0 con 0x7f541c0bf3b0 2021-01-27T09:53:22.740 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.726+0000 7f5422d41700 1 -- 172.21.15.146:0/1327946977 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541c0be780 con 0x7f541c0bf3b0 2021-01-27T09:53:22.740 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.734+0000 7f5418ff9700 1 -- 172.21.15.146:0/1327946977 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f5414010030 con 0x7f541c0bf3b0 2021-01-27T09:53:22.741 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.738+0000 7f5418ff9700 1 --2- 172.21.15.146:0/1327946977 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f53fc0561e0 0x7f53fc0586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.738+0000 7f5418ff9700 1 -- 172.21.15.146:0/1327946977 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7f541406f4b0 con 0x7f541c0bf3b0 2021-01-27T09:53:22.745 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.738+0000 7f5420add700 1 --2- 172.21.15.146:0/1327946977 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f53fc0561e0 0x7f53fc0586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.742+0000 7f5420add700 1 --2- 172.21.15.146:0/1327946977 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f53fc0561e0 0x7f53fc0586a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f54080011e0 tx=0x7f5408007a30).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:22.750 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.746+0000 7f5422d41700 1 --2- 172.21.15.146:0/1327946977 >> [v2:172.21.15.146:6804/14471,v1:172.21.15.146:6806/14471] conn(0x7f53f40015e0 0x7f53f4003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:22.750 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.746+0000 7f5422d41700 1 -- 172.21.15.146:0/1327946977 --> [v2:172.21.15.146:6804/14471,v1:172.21.15.146:6806/14471] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53f4006840 con 0x7f53f40015e0 2021-01-27T09:53:22.752 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.746+0000 7f541bfff700 1 --2- 172.21.15.146:0/1327946977 >> [v2:172.21.15.146:6804/14471,v1:172.21.15.146:6806/14471] conn(0x7f53f40015e0 0x7f53f4003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:22.753 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.746+0000 7f541bfff700 1 --2- 172.21.15.146:0/1327946977 >> [v2:172.21.15.146:6804/14471,v1:172.21.15.146:6806/14471] conn(0x7f53f40015e0 0x7f53f4003aa0 crc :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:22.762 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.758+0000 7f5418ff9700 1 -- 172.21.15.146:0/1327946977 <== osd.3 v2:172.21.15.146:6804/14471 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f53f4006840 con 0x7f53f40015e0 2021-01-27T09:53:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.786+0000 7f5422d41700 1 -- 172.21.15.146:0/1327946977 --> [v2:172.21.15.146:6804/14471,v1:172.21.15.146:6806/14471] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f53f40058b0 con 0x7f53f40015e0 2021-01-27T09:53:22.793 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.790+0000 7f5418ff9700 1 -- 172.21.15.146:0/1327946977 <== osd.3 v2:172.21.15.146:6804/14471 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f53f40058b0 con 0x7f53f40015e0 2021-01-27T09:53:22.801 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2021-01-27T09:53:22.802 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-01-27T09:53:22.802 INFO:teuthology.orchestra.run.smithi146.stdout:} 2021-01-27T09:53:22.807 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.802+0000 7f5422d41700 1 -- 172.21.15.146:0/1327946977 >> [v2:172.21.15.146:6804/14471,v1:172.21.15.146:6806/14471] conn(0x7f53f40015e0 msgr2=0x7f53f4003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:22.808 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.802+0000 7f5422d41700 1 --2- 172.21.15.146:0/1327946977 >> [v2:172.21.15.146:6804/14471,v1:172.21.15.146:6806/14471] conn(0x7f53f40015e0 0x7f53f4003aa0 crc :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:22.809 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.802+0000 7f5422d41700 1 -- 172.21.15.146:0/1327946977 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f53fc0561e0 msgr2=0x7f53fc0586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:22.809 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.802+0000 7f5422d41700 1 --2- 172.21.15.146:0/1327946977 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f53fc0561e0 0x7f53fc0586a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f54080011e0 tx=0x7f5408007a30).stop 2021-01-27T09:53:22.810 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.806+0000 7f5422d41700 1 -- 172.21.15.146:0/1327946977 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f541c0bf3b0 msgr2=0x7f541c0c25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:22.810 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.806+0000 7f5422d41700 1 --2- 172.21.15.146:0/1327946977 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f541c0bf3b0 0x7f541c0c25f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f541400ca60 tx=0x7f5414007cd0).stop 2021-01-27T09:53:22.810 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.806+0000 7f54212de700 1 -- 172.21.15.146:0/1327946977 reap_dead start 2021-01-27T09:53:22.810 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.806+0000 7f5422d41700 1 -- 172.21.15.146:0/1327946977 shutdown_connections 2021-01-27T09:53:22.818 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.814+0000 7f5422d41700 1 -- 172.21.15.146:0/1327946977 >> 172.21.15.146:0/1327946977 conn(0x7f541c067e60 msgr2=0x7f541c143b10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:22.819 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.814+0000 7f5422d41700 1 -- 172.21.15.146:0/1327946977 shutdown_connections 2021-01-27T09:53:22.819 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:22.814+0000 7f5422d41700 1 -- 172.21.15.146:0/1327946977 wait complete. 2021-01-27T09:53:22.845 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2021-01-27T09:53:23.089 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.082+0000 7f2ded072700 1 Processor -- start 2021-01-27T09:53:23.090 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.082+0000 7f2ded072700 1 -- start start 2021-01-27T09:53:23.090 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.082+0000 7f2ded072700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2de80be340 0x7f2de80ba350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:23.090 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.082+0000 7f2ded072700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2de80be720 0x7f2de8060020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:23.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.082+0000 7f2ded072700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de8060b60 con 0x7f2de8149ec0 2021-01-27T09:53:23.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.082+0000 7f2ded072700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de80b7910 con 0x7f2de80be720 2021-01-27T09:53:23.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.082+0000 7f2ded072700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de80b7bb0 con 0x7f2de80be340 2021-01-27T09:53:23.098 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.086+0000 7f2de659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2de80be720 0x7f2de8060020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:23.098 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.086+0000 7f2de659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2de80be720 0x7f2de8060020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55438/0 (socket says 172.21.15.146:55438) 2021-01-27T09:53:23.098 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.086+0000 7f2de659c700 1 -- 172.21.15.146:0/903196168 learned_addr learned my addr 172.21.15.146:0/903196168 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:23.098 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.086+0000 7f2de6d9d700 1 --2- 172.21.15.146:0/903196168 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2de80be340 0x7f2de80ba350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:23.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.090+0000 7f2de659c700 1 -- 172.21.15.146:0/903196168 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2de80be340 msgr2=0x7f2de80ba350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:53:23.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.094+0000 7f2de659c700 1 --2- 172.21.15.146:0/903196168 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2de80be340 0x7f2de80ba350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:23.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.094+0000 7f2de659c700 1 -- 172.21.15.146:0/903196168 >> v1:172.21.15.146:6789/0 conn(0x7f2de8149ec0 legacy=0x7f2de814a340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:53:23.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.094+0000 7f2de659c700 1 -- 172.21.15.146:0/903196168 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de80b76e0 con 0x7f2de80be720 2021-01-27T09:53:23.100 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.094+0000 7f2de659c700 1 --2- 172.21.15.146:0/903196168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de80be720 0x7f2de8060020 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f2de000c3c0 tx=0x7f2de000d040).ready entity=mon.1 client_cookie=7c8bb8bfffef6f7f server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:23.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.098+0000 7f2de5d9b700 1 -- 172.21.15.146:0/903196168 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de0013400 con 0x7f2de80be720 2021-01-27T09:53:23.106 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.098+0000 7f2de5d9b700 1 -- 172.21.15.146:0/903196168 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de0013560 con 0x7f2de80be720 2021-01-27T09:53:23.106 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.102+0000 7f2de5d9b700 1 -- 172.21.15.146:0/903196168 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de00138e0 con 0x7f2de80be720 2021-01-27T09:53:23.106 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.102+0000 7f2ded072700 1 -- 172.21.15.146:0/903196168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de80be720 msgr2=0x7f2de8060020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:23.108 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.102+0000 7f2ded072700 1 --2- 172.21.15.146:0/903196168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de80be720 0x7f2de8060020 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f2de000c3c0 tx=0x7f2de000d040).stop 2021-01-27T09:53:23.110 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.102+0000 7f2ded072700 1 -- 172.21.15.146:0/903196168 shutdown_connections 2021-01-27T09:53:23.110 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.102+0000 7f2ded072700 1 --2- 172.21.15.146:0/903196168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de80be720 0x7f2de8060020 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:23.111 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.102+0000 7f2ded072700 1 --2- 172.21.15.146:0/903196168 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2de80be340 0x7f2de80ba350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:23.111 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.102+0000 7f2ded072700 1 -- 172.21.15.146:0/903196168 >> 172.21.15.146:0/903196168 conn(0x7f2de8067e10 msgr2=0x7f2de8069110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:23.111 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.106+0000 7f2ded072700 1 -- 172.21.15.146:0/903196168 shutdown_connections 2021-01-27T09:53:23.117 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.114+0000 7f2ded072700 1 -- 172.21.15.146:0/903196168 wait complete. 2021-01-27T09:53:23.120 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.114+0000 7f2ded072700 1 Processor -- start 2021-01-27T09:53:23.129 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.122+0000 7f2ded072700 1 -- start start 2021-01-27T09:53:23.130 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.126+0000 7f2ded072700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2de80be340 0x7f2de8145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:23.130 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.126+0000 7f2ded072700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de80be720 0x7f2de816e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:23.131 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.126+0000 7f2ded072700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2de8149ec0 0x7f2de816e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:23.131 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.126+0000 7f2ded072700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de814bd00 con 0x7f2de80be340 2021-01-27T09:53:23.131 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.126+0000 7f2ded072700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de815d370 con 0x7f2de80be720 2021-01-27T09:53:23.131 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.126+0000 7f2ded072700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de815d610 con 0x7f2de8149ec0 2021-01-27T09:53:23.131 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.126+0000 7f2de759e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2de8149ec0 0x7f2de816e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:23.132 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.126+0000 7f2de759e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2de8149ec0 0x7f2de816e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:44930/0 (socket says 172.21.15.146:44930) 2021-01-27T09:53:23.132 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.126+0000 7f2de759e700 1 -- 172.21.15.146:0/462354986 learned_addr learned my addr 172.21.15.146:0/462354986 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:23.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.126+0000 7f2de659c700 1 --2- 172.21.15.146:0/462354986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de80be720 0x7f2de816e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:23.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.126+0000 7f2de759e700 1 -- 172.21.15.146:0/462354986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de80be720 msgr2=0x7f2de816e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:23.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.126+0000 7f2de759e700 1 --2- 172.21.15.146:0/462354986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de80be720 0x7f2de816e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:23.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.126+0000 7f2de6d9d700 1 --2- 172.21.15.146:0/462354986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2de80be340 0x7f2de8145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:23.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.126+0000 7f2de759e700 1 -- 172.21.15.146:0/462354986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2de80be340 msgr2=0x7f2de8145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:23.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.126+0000 7f2de759e700 1 --2- 172.21.15.146:0/462354986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2de80be340 0x7f2de8145730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:23.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.126+0000 7f2de759e700 1 -- 172.21.15.146:0/462354986 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de814bf30 con 0x7f2de8149ec0 2021-01-27T09:53:23.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.126+0000 7f2de6d9d700 1 --2- 172.21.15.146:0/462354986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2de80be340 0x7f2de8145730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:53:23.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.126+0000 7f2de759e700 1 --2- 172.21.15.146:0/462354986 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2de8149ec0 0x7f2de816e520 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f2ddc0096e0 tx=0x7f2ddc006ce0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:23.137 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.134+0000 7f2dceffd700 1 -- 172.21.15.146:0/462354986 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc00d4a0 con 0x7f2de8149ec0 2021-01-27T09:53:23.138 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.134+0000 7f2ded072700 1 -- 172.21.15.146:0/462354986 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de814c1d0 con 0x7f2de8149ec0 2021-01-27T09:53:23.138 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.134+0000 7f2dceffd700 1 -- 172.21.15.146:0/462354986 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ddc00d600 con 0x7f2de8149ec0 2021-01-27T09:53:23.138 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.134+0000 7f2dceffd700 1 -- 172.21.15.146:0/462354986 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc00d4a0 con 0x7f2de8149ec0 2021-01-27T09:53:23.139 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.134+0000 7f2ded072700 1 -- 172.21.15.146:0/462354986 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de8161110 con 0x7f2de8149ec0 2021-01-27T09:53:23.139 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.134+0000 7f2ded072700 1 -- 172.21.15.146:0/462354986 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de8069940 con 0x7f2de8149ec0 2021-01-27T09:53:23.143 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.138+0000 7f2dceffd700 1 -- 172.21.15.146:0/462354986 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f2ddc00f030 con 0x7f2de8149ec0 2021-01-27T09:53:23.144 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.138+0000 7f2dceffd700 1 --2- 172.21.15.146:0/462354986 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2dc8056240 0x7f2dc8058700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:23.144 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.138+0000 7f2dceffd700 1 -- 172.21.15.146:0/462354986 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7f2ddc0487c0 con 0x7f2de8149ec0 2021-01-27T09:53:23.147 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.142+0000 7f2de6d9d700 1 --2- 172.21.15.146:0/462354986 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2dc8056240 0x7f2dc8058700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:23.147 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.142+0000 7f2de6d9d700 1 --2- 172.21.15.146:0/462354986 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2dc8056240 0x7f2dc8058700 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f2dd8008880 tx=0x7f2dd800f040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:23.151 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.146+0000 7f2dceffd700 1 -- 172.21.15.146:0/462354986 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f2ddc0452f0 con 0x7f2de8149ec0 2021-01-27T09:53:23.498 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.494+0000 7f2ded072700 1 -- 172.21.15.146:0/462354986 --> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f2de8144230 con 0x7f2dc8056240 2021-01-27T09:53:23.501 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.498+0000 7f2dceffd700 1 -- 172.21.15.146:0/462354986 <== mgr.4104 v2:172.21.15.78:6832/15486 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2de8144230 con 0x7f2dc8056240 2021-01-27T09:53:23.523 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.518+0000 7f2ded072700 1 -- 172.21.15.146:0/462354986 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2dc8056240 msgr2=0x7f2dc8058700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:23.523 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.518+0000 7f2ded072700 1 --2- 172.21.15.146:0/462354986 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2dc8056240 0x7f2dc8058700 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f2dd8008880 tx=0x7f2dd800f040).stop 2021-01-27T09:53:23.523 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.518+0000 7f2ded072700 1 -- 172.21.15.146:0/462354986 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2de8149ec0 msgr2=0x7f2de816e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:23.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.518+0000 7f2ded072700 1 --2- 172.21.15.146:0/462354986 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2de8149ec0 0x7f2de816e520 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f2ddc0096e0 tx=0x7f2ddc006ce0).stop 2021-01-27T09:53:23.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.518+0000 7f2ded072700 1 -- 172.21.15.146:0/462354986 shutdown_connections 2021-01-27T09:53:23.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.518+0000 7f2ded072700 1 --2- 172.21.15.146:0/462354986 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2de8149ec0 0x7f2de816e520 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:23.524 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.518+0000 7f2ded072700 1 --2- 172.21.15.146:0/462354986 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2dc8056240 0x7f2dc8058700 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:23.525 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.518+0000 7f2ded072700 1 --2- 172.21.15.146:0/462354986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de80be720 0x7f2de816e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:23.525 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.518+0000 7f2ded072700 1 --2- 172.21.15.146:0/462354986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2de80be340 0x7f2de8145730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:23.525 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.518+0000 7f2ded072700 1 -- 172.21.15.146:0/462354986 >> 172.21.15.146:0/462354986 conn(0x7f2de8067e10 msgr2=0x7f2de8148370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:23.525 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.518+0000 7f2ded072700 1 -- 172.21.15.146:0/462354986 shutdown_connections 2021-01-27T09:53:23.525 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.518+0000 7f2ded072700 1 -- 172.21.15.146:0/462354986 wait complete. 2021-01-27T09:53:23.526 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 3 to deep-scrub 2021-01-27T09:53:23.549 INFO:tasks.ceph:Scrubbing osd.4 2021-01-27T09:53:23.550 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2021-01-27T09:53:23.896 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.890+0000 7f1706693700 1 Processor -- start 2021-01-27T09:53:23.898 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.894+0000 7f1706693700 1 -- start start 2021-01-27T09:53:23.901 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.894+0000 7f1706693700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f17000b8260 0x7f170014a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:23.901 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.894+0000 7f1706693700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f170014da20 con 0x7f17000c0370 2021-01-27T09:53:23.901 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.894+0000 7f1706693700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1700060f30 con 0x7f17000c0750 2021-01-27T09:53:23.901 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.894+0000 7f1706693700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1700069830 con 0x7f17000b8260 2021-01-27T09:53:23.902 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.898+0000 7f1704c30700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f17000b8260 0x7f170014a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:23.903 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.898+0000 7f1704c30700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f17000b8260 0x7f170014a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:58330/0 (socket says 172.21.15.146:58330) 2021-01-27T09:53:23.903 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.898+0000 7f1704c30700 1 -- 172.21.15.146:0/2471449309 learned_addr learned my addr 172.21.15.146:0/2471449309 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:23.903 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.898+0000 7f1704c30700 1 -- 172.21.15.146:0/2471449309 >> v1:172.21.15.146:6789/0 conn(0x7f17000c0750 legacy=0x7f1700069110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:23.903 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.898+0000 7f1704c30700 1 -- 172.21.15.146:0/2471449309 >> v1:172.21.15.78:6789/0 conn(0x7f17000c0370 legacy=0x7f17000604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:53:23.903 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.898+0000 7f1704c30700 1 -- 172.21.15.146:0/2471449309 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170014dc50 con 0x7f17000b8260 2021-01-27T09:53:23.904 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.898+0000 7f1704c30700 1 --2- 172.21.15.146:0/2471449309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17000b8260 0x7f170014a4d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f17000663d0 tx=0x7f16f80092d0).ready entity=mon.0 client_cookie=d7419fe24dcc8c43 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:23.904 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.898+0000 7f16feffd700 1 -- 172.21.15.146:0/2471449309 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f800bc00 con 0x7f17000b8260 2021-01-27T09:53:23.904 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.898+0000 7f16feffd700 1 -- 172.21.15.146:0/2471449309 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f800bd60 con 0x7f17000b8260 2021-01-27T09:53:23.905 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.898+0000 7f16feffd700 1 -- 172.21.15.146:0/2471449309 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f8011610 con 0x7f17000b8260 2021-01-27T09:53:23.905 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.898+0000 7f1706693700 1 -- 172.21.15.146:0/2471449309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17000b8260 msgr2=0x7f170014a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:23.905 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.898+0000 7f1706693700 1 --2- 172.21.15.146:0/2471449309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17000b8260 0x7f170014a4d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f17000663d0 tx=0x7f16f80092d0).stop 2021-01-27T09:53:23.921 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.918+0000 7f1706693700 1 -- 172.21.15.146:0/2471449309 shutdown_connections 2021-01-27T09:53:23.922 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.918+0000 7f1706693700 1 --2- 172.21.15.146:0/2471449309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17000b8260 0x7f170014a4d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:23.922 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.918+0000 7f1706693700 1 -- 172.21.15.146:0/2471449309 >> 172.21.15.146:0/2471449309 conn(0x7f1700064240 msgr2=0x7f1700067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:23.923 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.918+0000 7f1706693700 1 -- 172.21.15.146:0/2471449309 shutdown_connections 2021-01-27T09:53:23.923 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.918+0000 7f1706693700 1 -- 172.21.15.146:0/2471449309 wait complete. 2021-01-27T09:53:23.924 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.918+0000 7f1706693700 1 Processor -- start 2021-01-27T09:53:23.929 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.922+0000 7f1706693700 1 -- start start 2021-01-27T09:53:23.929 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.922+0000 7f1706693700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17000b8260 0x7f170014c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:23.930 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.922+0000 7f1706693700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17000c0370 0x7f170014c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:23.930 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.922+0000 7f1706693700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17000c0750 0x7f17000b8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:23.930 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.922+0000 7f1706693700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170014ceb0 con 0x7f17000c0750 2021-01-27T09:53:23.930 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.922+0000 7f1706693700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1700141a10 con 0x7f17000b8260 2021-01-27T09:53:23.931 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.922+0000 7f1706693700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170014b6e0 con 0x7f17000c0370 2021-01-27T09:53:23.931 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.922+0000 7f16ff7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17000c0370 0x7f170014c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:23.931 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.922+0000 7f16fffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17000b8260 0x7f170014c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:23.931 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.922+0000 7f16ff7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17000c0370 0x7f170014c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:44950/0 (socket says 172.21.15.146:44950) 2021-01-27T09:53:23.931 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.922+0000 7f16ff7fe700 1 -- 172.21.15.146:0/4089724963 learned_addr learned my addr 172.21.15.146:0/4089724963 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:23.932 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.922+0000 7f16fffff700 1 -- 172.21.15.146:0/4089724963 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17000c0370 msgr2=0x7f170014c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:23.932 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.922+0000 7f16fffff700 1 --2- 172.21.15.146:0/4089724963 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f17000c0370 0x7f170014c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:23.932 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.922+0000 7f16fffff700 1 -- 172.21.15.146:0/4089724963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17000c0750 msgr2=0x7f17000b8640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-27T09:53:23.932 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.922+0000 7f16fffff700 1 --2- 172.21.15.146:0/4089724963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17000c0750 0x7f17000b8640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:53:23.932 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.922+0000 7f16fffff700 1 -- 172.21.15.146:0/4089724963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1700141c40 con 0x7f17000b8260 2021-01-27T09:53:23.933 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.922+0000 7f16fffff700 1 --2- 172.21.15.146:0/4089724963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17000b8260 0x7f170014c4d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f16e8009a90 tx=0x7f16e8006ce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:23.945 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.938+0000 7f16f7fff700 1 -- 172.21.15.146:0/4089724963 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e800c430 con 0x7f17000b8260 2021-01-27T09:53:23.945 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.938+0000 7f1706693700 1 -- 172.21.15.146:0/4089724963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170014b910 con 0x7f17000b8260 2021-01-27T09:53:23.945 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.942+0000 7f1706693700 1 -- 172.21.15.146:0/4089724963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1700134020 con 0x7f17000b8260 2021-01-27T09:53:23.946 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.942+0000 7f16f7fff700 1 -- 172.21.15.146:0/4089724963 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e8010070 con 0x7f17000b8260 2021-01-27T09:53:23.946 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.942+0000 7f16f7fff700 1 -- 172.21.15.146:0/4089724963 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e800c590 con 0x7f17000b8260 2021-01-27T09:53:23.947 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.942+0000 7f1706693700 1 -- 172.21.15.146:0/4089724963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1700134380 con 0x7f17000b8260 2021-01-27T09:53:23.948 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.942+0000 7f16f7fff700 1 -- 172.21.15.146:0/4089724963 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f16e801c070 con 0x7f17000b8260 2021-01-27T09:53:23.950 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.946+0000 7f16f7fff700 1 --2- 172.21.15.146:0/4089724963 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f16e40561e0 0x7f16e40586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.950+0000 7f16f7fff700 1 -- 172.21.15.146:0/4089724963 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7f16e806e650 con 0x7f17000b8260 2021-01-27T09:53:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.950+0000 7f16f7fff700 1 --2- 172.21.15.146:0/4089724963 >> [v2:172.21.15.78:6816/15826,v1:172.21.15.78:6817/15826] conn(0x7f16e405e5a0 0x7f16e4060a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.950+0000 7f16f7fff700 1 -- 172.21.15.146:0/4089724963 --> [v2:172.21.15.78:6816/15826,v1:172.21.15.78:6817/15826] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f16e40610c0 con 0x7f16e405e5a0 2021-01-27T09:53:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.950+0000 7f16f7fff700 1 -- 172.21.15.146:0/4089724963 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16e8070cc0 con 0x7f17000b8260 2021-01-27T09:53:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.950+0000 7f1704c30700 1 --2- 172.21.15.146:0/4089724963 >> [v2:172.21.15.78:6816/15826,v1:172.21.15.78:6817/15826] conn(0x7f16e405e5a0 0x7f16e4060a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:23.956 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.950+0000 7f1704c30700 1 --2- 172.21.15.146:0/4089724963 >> [v2:172.21.15.78:6816/15826,v1:172.21.15.78:6817/15826] conn(0x7f16e405e5a0 0x7f16e4060a40 crc :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:23.957 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.954+0000 7f16ff7fe700 1 --2- 172.21.15.146:0/4089724963 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f16e40561e0 0x7f16e40586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:23.958 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.954+0000 7f16f7fff700 1 -- 172.21.15.146:0/4089724963 <== osd.4 v2:172.21.15.78:6816/15826 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f16e40610c0 con 0x7f16e405e5a0 2021-01-27T09:53:23.958 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.954+0000 7f16ff7fe700 1 --2- 172.21.15.146:0/4089724963 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f16e40561e0 0x7f16e40586a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f1700144750 tx=0x7f16f0007c60).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:23.988 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.982+0000 7f1706693700 1 -- 172.21.15.146:0/4089724963 --> [v2:172.21.15.78:6816/15826,v1:172.21.15.78:6817/15826] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1700044ee0 con 0x7f16e405e5a0 2021-01-27T09:53:23.990 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.982+0000 7f16f7fff700 1 -- 172.21.15.146:0/4089724963 <== osd.4 v2:172.21.15.78:6816/15826 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1700044ee0 con 0x7f16e405e5a0 2021-01-27T09:53:23.990 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.982+0000 7f1706693700 1 -- 172.21.15.146:0/4089724963 >> [v2:172.21.15.78:6816/15826,v1:172.21.15.78:6817/15826] conn(0x7f16e405e5a0 msgr2=0x7f16e4060a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:23.990 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.982+0000 7f1706693700 1 --2- 172.21.15.146:0/4089724963 >> [v2:172.21.15.78:6816/15826,v1:172.21.15.78:6817/15826] conn(0x7f16e405e5a0 0x7f16e4060a40 crc :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:23.991 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.982+0000 7f1706693700 1 -- 172.21.15.146:0/4089724963 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f16e40561e0 msgr2=0x7f16e40586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:23.991 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.982+0000 7f1706693700 1 --2- 172.21.15.146:0/4089724963 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f16e40561e0 0x7f16e40586a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f1700144750 tx=0x7f16f0007c60).stop 2021-01-27T09:53:23.991 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.982+0000 7f1706693700 1 -- 172.21.15.146:0/4089724963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17000b8260 msgr2=0x7f170014c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:23.991 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.982+0000 7f1706693700 1 --2- 172.21.15.146:0/4089724963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17000b8260 0x7f170014c4d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f16e8009a90 tx=0x7f16e8006ce0).stop 2021-01-27T09:53:23.992 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.986+0000 7f1704c30700 1 -- 172.21.15.146:0/4089724963 reap_dead start 2021-01-27T09:53:23.992 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.986+0000 7f1706693700 1 -- 172.21.15.146:0/4089724963 shutdown_connections 2021-01-27T09:53:23.992 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.986+0000 7f1706693700 1 -- 172.21.15.146:0/4089724963 >> 172.21.15.146:0/4089724963 conn(0x7f1700064240 msgr2=0x7f17001411b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:23.993 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.986+0000 7f1706693700 1 -- 172.21.15.146:0/4089724963 shutdown_connections 2021-01-27T09:53:23.993 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:23.986+0000 7f1706693700 1 -- 172.21.15.146:0/4089724963 wait complete. 2021-01-27T09:53:23.993 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2021-01-27T09:53:23.994 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-01-27T09:53:23.994 INFO:teuthology.orchestra.run.smithi146.stdout:} 2021-01-27T09:53:24.042 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2021-01-27T09:53:24.332 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.326+0000 7f71f4720700 1 Processor -- start 2021-01-27T09:53:24.332 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.326+0000 7f71f4720700 1 -- start start 2021-01-27T09:53:24.334 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.330+0000 7f71f4720700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f71ec067610 0x7f71ec0bea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:24.334 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.330+0000 7f71f4720700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f71ec0682f0 0x7f71ec14ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:24.335 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.330+0000 7f71f1cbb700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f71ec067610 0x7f71ec0bea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:24.335 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.330+0000 7f71f1cbb700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f71ec067610 0x7f71ec0bea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:44960/0 (socket says 172.21.15.146:44960) 2021-01-27T09:53:24.336 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.330+0000 7f71f24bc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f71ec067230 0x7f71ec066620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55044/0 (socket says 172.21.15.146:55044) 2021-01-27T09:53:24.337 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.334+0000 7f71f1cbb700 1 -- 172.21.15.146:0/3027185847 learned_addr learned my addr 172.21.15.146:0/3027185847 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:24.338 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.334+0000 7f71f2cbd700 1 --2- 172.21.15.146:0/3027185847 >> v2:172.21.15.146:3300/0 conn(0x7f71ec0682f0 0x7f71ec14ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:24.338 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.334+0000 7f71f4720700 1 -- 172.21.15.146:0/3027185847 --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71ec0661d0 con 0x7f71ec067230 2021-01-27T09:53:24.339 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.334+0000 7f71f4720700 1 -- 172.21.15.146:0/3027185847 --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71ec066d40 con 0x7f71ec0682f0 2021-01-27T09:53:24.339 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.334+0000 7f71f4720700 1 -- 172.21.15.146:0/3027185847 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec0ba700 con 0x7f71ec067610 2021-01-27T09:53:24.345 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.338+0000 7f71f14ba700 1 -- 172.21.15.146:0/3027185847 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 188644846 0 0) 0x7f71ec0661d0 con 0x7f71ec067230 2021-01-27T09:53:24.345 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.338+0000 7f71f14ba700 1 -- 172.21.15.146:0/3027185847 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71d4003270 con 0x7f71ec067230 2021-01-27T09:53:24.346 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.342+0000 7f71f1cbb700 1 -- 172.21.15.146:0/3027185847 >> v2:172.21.15.146:3300/0 conn(0x7f71ec0682f0 msgr2=0x7f71ec14ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:53:24.347 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.342+0000 7f71f1cbb700 1 --2- 172.21.15.146:0/3027185847 >> v2:172.21.15.146:3300/0 conn(0x7f71ec0682f0 0x7f71ec14ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:24.347 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.342+0000 7f71f1cbb700 1 -- 172.21.15.146:0/3027185847 >> v1:172.21.15.146:6789/0 conn(0x7f71ec067230 legacy=0x7f71ec066620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:24.347 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.342+0000 7f71f1cbb700 1 -- 172.21.15.146:0/3027185847 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec14b030 con 0x7f71ec067610 2021-01-27T09:53:24.350 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.346+0000 7f71f1cbb700 1 --2- 172.21.15.146:0/3027185847 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f71ec067610 0x7f71ec0bea60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f71dc00ba20 tx=0x7f71dc006ee0).ready entity=mon.2 client_cookie=4d1251bb271fa6b5 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:24.351 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.346+0000 7f71f14ba700 1 -- 172.21.15.146:0/3027185847 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc00be60 con 0x7f71ec067610 2021-01-27T09:53:24.351 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.346+0000 7f71f14ba700 1 -- 172.21.15.146:0/3027185847 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71dc009840 con 0x7f71ec067610 2021-01-27T09:53:24.352 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.346+0000 7f71f4720700 1 -- 172.21.15.146:0/3027185847 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f71ec067610 msgr2=0x7f71ec0bea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:24.352 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.346+0000 7f71f4720700 1 --2- 172.21.15.146:0/3027185847 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f71ec067610 0x7f71ec0bea60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f71dc00ba20 tx=0x7f71dc006ee0).stop 2021-01-27T09:53:24.358 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.354+0000 7f71f4720700 1 -- 172.21.15.146:0/3027185847 shutdown_connections 2021-01-27T09:53:24.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.354+0000 7f71f4720700 1 --2- 172.21.15.146:0/3027185847 >> v2:172.21.15.146:3300/0 conn(0x7f71ec0682f0 0x7f71ec14ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:24.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.354+0000 7f71f4720700 1 --2- 172.21.15.146:0/3027185847 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f71ec067610 0x7f71ec0bea60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:24.360 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.354+0000 7f71f4720700 1 -- 172.21.15.146:0/3027185847 >> 172.21.15.146:0/3027185847 conn(0x7f71ec067e10 msgr2=0x7f71ec069110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:24.360 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.354+0000 7f71f4720700 1 -- 172.21.15.146:0/3027185847 shutdown_connections 2021-01-27T09:53:24.360 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.354+0000 7f71f4720700 1 -- 172.21.15.146:0/3027185847 wait complete. 2021-01-27T09:53:24.361 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.354+0000 7f71f4720700 1 Processor -- start 2021-01-27T09:53:24.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.358+0000 7f71f4720700 1 -- start start 2021-01-27T09:53:24.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.358+0000 7f71f4720700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71ec067230 0x7f71ec1585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:24.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.358+0000 7f71f4720700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f71ec067610 0x7f71ec062970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:24.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.358+0000 7f71f4720700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71ec0682f0 0x7f71ec156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:24.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.358+0000 7f71f1cbb700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f71ec067610 0x7f71ec062970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:24.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.358+0000 7f71f24bc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71ec067230 0x7f71ec1585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:24.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.358+0000 7f71f1cbb700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f71ec067610 0x7f71ec062970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:44966/0 (socket says 172.21.15.146:44966) 2021-01-27T09:53:24.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.358+0000 7f71f24bc700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71ec067230 0x7f71ec1585d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:58352/0 (socket says 172.21.15.146:58352) 2021-01-27T09:53:24.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.358+0000 7f71f2cbd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71ec0682f0 0x7f71ec156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:24.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.358+0000 7f71f2cbd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71ec0682f0 0x7f71ec156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55482/0 (socket says 172.21.15.146:55482) 2021-01-27T09:53:24.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.358+0000 7f71f1cbb700 1 -- 172.21.15.146:0/2002742672 learned_addr learned my addr 172.21.15.146:0/2002742672 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:24.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.358+0000 7f71f4720700 1 -- 172.21.15.146:0/2002742672 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec14a4d0 con 0x7f71ec067230 2021-01-27T09:53:24.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.358+0000 7f71f4720700 1 -- 172.21.15.146:0/2002742672 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec148a50 con 0x7f71ec0682f0 2021-01-27T09:53:24.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.358+0000 7f71f4720700 1 -- 172.21.15.146:0/2002742672 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec148cf0 con 0x7f71ec067610 2021-01-27T09:53:24.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.358+0000 7f71f2cbd700 1 -- 172.21.15.146:0/2002742672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f71ec067610 msgr2=0x7f71ec062970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:24.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.358+0000 7f71f2cbd700 1 --2- 172.21.15.146:0/2002742672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f71ec067610 0x7f71ec062970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:24.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.358+0000 7f71f2cbd700 1 -- 172.21.15.146:0/2002742672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71ec067230 msgr2=0x7f71ec1585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:24.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.358+0000 7f71f2cbd700 1 --2- 172.21.15.146:0/2002742672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71ec067230 0x7f71ec1585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:24.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.358+0000 7f71f2cbd700 1 -- 172.21.15.146:0/2002742672 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec148f90 con 0x7f71ec0682f0 2021-01-27T09:53:24.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.358+0000 7f71f24bc700 1 --2- 172.21.15.146:0/2002742672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71ec067230 0x7f71ec1585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:53:24.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.362+0000 7f71f2cbd700 1 --2- 172.21.15.146:0/2002742672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71ec0682f0 0x7f71ec156c20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f71e400ed40 tx=0x7f71e4009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:24.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.362+0000 7f71da7fc700 1 -- 172.21.15.146:0/2002742672 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e400eea0 con 0x7f71ec0682f0 2021-01-27T09:53:24.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.362+0000 7f71da7fc700 1 -- 172.21.15.146:0/2002742672 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e400cbc0 con 0x7f71ec0682f0 2021-01-27T09:53:24.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.362+0000 7f71f4720700 1 -- 172.21.15.146:0/2002742672 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ec14a730 con 0x7f71ec0682f0 2021-01-27T09:53:24.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.362+0000 7f71da7fc700 1 -- 172.21.15.146:0/2002742672 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e40123f0 con 0x7f71ec0682f0 2021-01-27T09:53:24.370 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.362+0000 7f71f4720700 1 -- 172.21.15.146:0/2002742672 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ec060f20 con 0x7f71ec0682f0 2021-01-27T09:53:24.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.362+0000 7f71f4720700 1 -- 172.21.15.146:0/2002742672 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71ec147670 con 0x7f71ec0682f0 2021-01-27T09:53:24.371 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.362+0000 7f71da7fc700 1 -- 172.21.15.146:0/2002742672 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f71e4022070 con 0x7f71ec0682f0 2021-01-27T09:53:24.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.374+0000 7f71da7fc700 1 --2- 172.21.15.146:0/2002742672 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f71cc056230 0x7f71cc0586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:24.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.374+0000 7f71da7fc700 1 -- 172.21.15.146:0/2002742672 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7f71e406fde0 con 0x7f71ec0682f0 2021-01-27T09:53:24.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.374+0000 7f71f24bc700 1 --2- 172.21.15.146:0/2002742672 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f71cc056230 0x7f71cc0586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:24.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.374+0000 7f71da7fc700 1 -- 172.21.15.146:0/2002742672 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f71e4045300 con 0x7f71ec0682f0 2021-01-27T09:53:24.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.378+0000 7f71f24bc700 1 --2- 172.21.15.146:0/2002742672 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f71cc056230 0x7f71cc0586f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f71e8007fd0 tx=0x7f71e8000bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:24.640 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.634+0000 7f71f4720700 1 -- 172.21.15.146:0/2002742672 --> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f71ec14a350 con 0x7f71cc056230 2021-01-27T09:53:24.642 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.638+0000 7f71da7fc700 1 -- 172.21.15.146:0/2002742672 <== mgr.4104 v2:172.21.15.78:6832/15486 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f71e80046b0 con 0x7f71cc056230 2021-01-27T09:53:24.646 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.642+0000 7f71f4720700 1 -- 172.21.15.146:0/2002742672 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f71cc056230 msgr2=0x7f71cc0586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:24.657 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.654+0000 7f71f4720700 1 --2- 172.21.15.146:0/2002742672 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f71cc056230 0x7f71cc0586f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f71e8007fd0 tx=0x7f71e8000bc0).stop 2021-01-27T09:53:24.657 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.654+0000 7f71f4720700 1 -- 172.21.15.146:0/2002742672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71ec0682f0 msgr2=0x7f71ec156c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:24.657 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.654+0000 7f71f4720700 1 --2- 172.21.15.146:0/2002742672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71ec0682f0 0x7f71ec156c20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f71e400ed40 tx=0x7f71e4009220).stop 2021-01-27T09:53:24.661 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.658+0000 7f71f4720700 1 -- 172.21.15.146:0/2002742672 shutdown_connections 2021-01-27T09:53:24.661 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.658+0000 7f71f4720700 1 --2- 172.21.15.146:0/2002742672 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f71cc056230 0x7f71cc0586f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:24.662 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.658+0000 7f71f4720700 1 --2- 172.21.15.146:0/2002742672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71ec0682f0 0x7f71ec156c20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:24.662 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.658+0000 7f71f4720700 1 --2- 172.21.15.146:0/2002742672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f71ec067610 0x7f71ec062970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:24.662 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.658+0000 7f71f4720700 1 --2- 172.21.15.146:0/2002742672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71ec067230 0x7f71ec1585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:24.662 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.658+0000 7f71f4720700 1 -- 172.21.15.146:0/2002742672 >> 172.21.15.146:0/2002742672 conn(0x7f71ec067e10 msgr2=0x7f71ec060800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:24.663 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.658+0000 7f71f4720700 1 -- 172.21.15.146:0/2002742672 shutdown_connections 2021-01-27T09:53:24.663 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.658+0000 7f71f4720700 1 -- 172.21.15.146:0/2002742672 wait complete. 2021-01-27T09:53:24.669 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 4 to deep-scrub 2021-01-27T09:53:24.688 INFO:tasks.ceph:Scrubbing osd.5 2021-01-27T09:53:24.689 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2021-01-27T09:53:24.944 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.938+0000 7fe362b5b700 1 Processor -- start 2021-01-27T09:53:24.944 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.938+0000 7fe362b5b700 1 -- start start 2021-01-27T09:53:24.949 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.942+0000 7fe362b5b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe35c0692b0 0x7fe35c0bd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:24.950 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.942+0000 7fe362b5b700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe35c0bb630 con 0x7fe35c060020 2021-01-27T09:53:24.951 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.942+0000 7fe362b5b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe35c0bc3d0 con 0x7fe35c069690 2021-01-27T09:53:24.951 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.942+0000 7fe362b5b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c0610f0 con 0x7fe35c0692b0 2021-01-27T09:53:24.951 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.942+0000 7fe36235a700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe35c060020 0x7fe35c14bd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:43098/0 (socket says 172.21.15.146:43098) 2021-01-27T09:53:24.952 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.942+0000 7fe36235a700 1 -- 172.21.15.146:0/2436207965 learned_addr learned my addr 172.21.15.146:0/2436207965 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:53:24.952 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.946+0000 7fe360b57700 1 -- 172.21.15.146:0/2436207965 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069325144 0 0) 0x7fe35c0bb630 con 0x7fe35c060020 2021-01-27T09:53:24.952 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.946+0000 7fe360b57700 1 -- 172.21.15.146:0/2436207965 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe344003270 con 0x7fe35c060020 2021-01-27T09:53:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.946+0000 7fe360b57700 1 -- 172.21.15.146:0/2436207965 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2601296493 0 0) 0x7fe344003270 con 0x7fe35c060020 2021-01-27T09:53:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.946+0000 7fe360b57700 1 -- 172.21.15.146:0/2436207965 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe35c0692b0 msgr2=0x7fe35c0bd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:53:24.954 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.946+0000 7fe361b59700 1 --2- 172.21.15.146:0/2436207965 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe35c0692b0 0x7fe35c0bd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:24.954 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.946+0000 7fe360b57700 1 --2- 172.21.15.146:0/2436207965 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe35c0692b0 0x7fe35c0bd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:24.954 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.946+0000 7fe360b57700 1 -- 172.21.15.146:0/2436207965 >> v1:172.21.15.146:6789/0 conn(0x7fe35c069690 legacy=0x7fe35c148b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:53:24.956 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.950+0000 7fe360b57700 1 -- 172.21.15.146:0/2436207965 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35c0bc670 con 0x7fe35c060020 2021-01-27T09:53:24.957 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.950+0000 7fe360b57700 1 -- 172.21.15.146:0/2436207965 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3890990827 0 0) 0x7fe34c001520 con 0x7fe35c060020 2021-01-27T09:53:24.957 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.950+0000 7fe360b57700 1 -- 172.21.15.146:0/2436207965 >> v1:172.21.15.78:6789/0 conn(0x7fe35c060020 legacy=0x7fe35c14bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:24.958 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.950+0000 7fe360b57700 1 --2- 172.21.15.146:0/2436207965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe344003790 0x7fe344003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:24.958 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.950+0000 7fe360b57700 1 --2- 172.21.15.146:0/2436207965 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe344004510 0x7fe344004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:24.958 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.950+0000 7fe360b57700 1 --2- 172.21.15.146:0/2436207965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe344004e80 0x7fe34400b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:24.959 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.950+0000 7fe360b57700 1 -- 172.21.15.146:0/2436207965 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c0610f0 con 0x7fe344003790 2021-01-27T09:53:24.959 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.950+0000 7fe360b57700 1 -- 172.21.15.146:0/2436207965 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe344004200 con 0x7fe344004e80 2021-01-27T09:53:24.960 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.950+0000 7fe360b57700 1 -- 172.21.15.146:0/2436207965 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe34400bc50 con 0x7fe344004510 2021-01-27T09:53:24.960 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.950+0000 7fe36235a700 1 --2- 172.21.15.146:0/2436207965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe344004e80 0x7fe34400b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:24.960 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.950+0000 7fe361b59700 1 --2- 172.21.15.146:0/2436207965 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe35c0692b0 0x7fe35c0bd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-27T09:53:24.962 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.950+0000 7fe361b59700 1 --2- 172.21.15.146:0/2436207965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe344003790 0x7fe344003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:24.962 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.954+0000 7fe36235a700 1 -- 172.21.15.146:0/2436207965 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe344004510 msgr2=0x7fe344004990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-01-27T09:53:24.963 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.954+0000 7fe36235a700 1 --2- 172.21.15.146:0/2436207965 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe344004510 0x7fe344004990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:53:24.963 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.954+0000 7fe36235a700 1 -- 172.21.15.146:0/2436207965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe344003790 msgr2=0x7fe344003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:53:24.963 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.954+0000 7fe36235a700 1 --2- 172.21.15.146:0/2436207965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe344003790 0x7fe344003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:24.964 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.954+0000 7fe36235a700 1 -- 172.21.15.146:0/2436207965 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35c0bc670 con 0x7fe344004e80 2021-01-27T09:53:24.964 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.954+0000 7fe36235a700 1 --2- 172.21.15.146:0/2436207965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe344004e80 0x7fe34400b760 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fe34c00c460 tx=0x7fe34c0078f0).ready entity=mon.1 client_cookie=60c9168f60ad5ddb server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:24.964 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.958+0000 7fe360b57700 1 -- 172.21.15.146:0/2436207965 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c00ce20 con 0x7fe344004e80 2021-01-27T09:53:24.965 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.958+0000 7fe360b57700 1 -- 172.21.15.146:0/2436207965 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34c0072e0 con 0x7fe344004e80 2021-01-27T09:53:24.965 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.958+0000 7fe360b57700 1 -- 172.21.15.146:0/2436207965 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c005830 con 0x7fe344004e80 2021-01-27T09:53:24.965 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.958+0000 7fe362b5b700 1 -- 172.21.15.146:0/2436207965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe344004e80 msgr2=0x7fe34400b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:24.966 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.958+0000 7fe362b5b700 1 --2- 172.21.15.146:0/2436207965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe344004e80 0x7fe34400b760 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fe34c00c460 tx=0x7fe34c0078f0).stop 2021-01-27T09:53:24.966 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.958+0000 7fe36235a700 1 -- 172.21.15.146:0/2436207965 reap_dead start 2021-01-27T09:53:24.968 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.958+0000 7fe362b5b700 1 -- 172.21.15.146:0/2436207965 shutdown_connections 2021-01-27T09:53:24.968 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.958+0000 7fe362b5b700 1 -- 172.21.15.146:0/2436207965 >> 172.21.15.146:0/2436207965 conn(0x7fe35c067dc0 msgr2=0x7fe35c0681a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:24.969 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.962+0000 7fe362b5b700 1 -- 172.21.15.146:0/2436207965 shutdown_connections 2021-01-27T09:53:24.969 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.962+0000 7fe362b5b700 1 -- 172.21.15.146:0/2436207965 wait complete. 2021-01-27T09:53:24.969 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.962+0000 7fe362b5b700 1 Processor -- start 2021-01-27T09:53:24.970 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.962+0000 7fe362b5b700 1 -- start start 2021-01-27T09:53:24.972 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.962+0000 7fe362b5b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe344004e80 0x7fe35c0bfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:24.972 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.962+0000 7fe362b5b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe35c0be960 0x7fe35c138ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:24.972 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.962+0000 7fe362b5b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe35c1496f0 0x7fe35c149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:24.973 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.962+0000 7fe362b5b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c1437c0 con 0x7fe35c0be960 2021-01-27T09:53:24.973 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.962+0000 7fe362b5b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c0be030 con 0x7fe35c1496f0 2021-01-27T09:53:24.974 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.962+0000 7fe362b5b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c0be2d0 con 0x7fe344004e80 2021-01-27T09:53:24.974 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.966+0000 7fe361b59700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe344004e80 0x7fe35c0bfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:24.974 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.966+0000 7fe361358700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe35c0be960 0x7fe35c138ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:24.975 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.966+0000 7fe36235a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe35c1496f0 0x7fe35c149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:24.975 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.966+0000 7fe361b59700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe344004e80 0x7fe35c0bfdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:44988/0 (socket says 172.21.15.146:44988) 2021-01-27T09:53:24.975 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.966+0000 7fe361b59700 1 -- 172.21.15.146:0/1657595414 learned_addr learned my addr 172.21.15.146:0/1657595414 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:24.976 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.966+0000 7fe361b59700 1 -- 172.21.15.146:0/1657595414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe35c1496f0 msgr2=0x7fe35c149b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:24.976 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.966+0000 7fe361b59700 1 --2- 172.21.15.146:0/1657595414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe35c1496f0 0x7fe35c149b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:24.977 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.966+0000 7fe361b59700 1 -- 172.21.15.146:0/1657595414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe35c0be960 msgr2=0x7fe35c138ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:24.977 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.966+0000 7fe361b59700 1 --2- 172.21.15.146:0/1657595414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe35c0be960 0x7fe35c138ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:24.977 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.966+0000 7fe361b59700 1 -- 172.21.15.146:0/1657595414 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35c0be570 con 0x7fe344004e80 2021-01-27T09:53:24.978 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.966+0000 7fe361b59700 1 --2- 172.21.15.146:0/1657595414 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe344004e80 0x7fe35c0bfdb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fe35400fd70 tx=0x7fe354008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:24.978 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.966+0000 7fe349ffb700 1 -- 172.21.15.146:0/1657595414 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35400fed0 con 0x7fe344004e80 2021-01-27T09:53:24.978 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.966+0000 7fe349ffb700 1 -- 172.21.15.146:0/1657595414 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35400c040 con 0x7fe344004e80 2021-01-27T09:53:24.978 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.966+0000 7fe349ffb700 1 -- 172.21.15.146:0/1657595414 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35400ddb0 con 0x7fe344004e80 2021-01-27T09:53:24.979 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.966+0000 7fe362b5b700 1 -- 172.21.15.146:0/1657595414 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe35c1439f0 con 0x7fe344004e80 2021-01-27T09:53:24.979 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.966+0000 7fe362b5b700 1 -- 172.21.15.146:0/1657595414 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe35c14a020 con 0x7fe344004e80 2021-01-27T09:53:24.979 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.970+0000 7fe362b5b700 1 -- 172.21.15.146:0/1657595414 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe35c044680 con 0x7fe344004e80 2021-01-27T09:53:24.992 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.986+0000 7fe349ffb700 1 -- 172.21.15.146:0/1657595414 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fe354023070 con 0x7fe344004e80 2021-01-27T09:53:24.992 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.986+0000 7fe349ffb700 1 --2- 172.21.15.146:0/1657595414 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe33c0561e0 0x7fe33c0586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:24.993 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.986+0000 7fe349ffb700 1 -- 172.21.15.146:0/1657595414 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7fe35406ffb0 con 0x7fe344004e80 2021-01-27T09:53:24.993 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.986+0000 7fe349ffb700 1 --2- 172.21.15.146:0/1657595414 >> [v2:172.21.15.78:6800/15827,v1:172.21.15.78:6801/15827] conn(0x7fe33c05e4b0 0x7fe33c060950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:24.993 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.986+0000 7fe349ffb700 1 -- 172.21.15.146:0/1657595414 --> [v2:172.21.15.78:6800/15827,v1:172.21.15.78:6801/15827] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe33c060fd0 con 0x7fe33c05e4b0 2021-01-27T09:53:24.995 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.986+0000 7fe349ffb700 1 -- 172.21.15.146:0/1657595414 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe35406e0a0 con 0x7fe344004e80 2021-01-27T09:53:24.995 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.986+0000 7fe36235a700 1 --2- 172.21.15.146:0/1657595414 >> [v2:172.21.15.78:6800/15827,v1:172.21.15.78:6801/15827] conn(0x7fe33c05e4b0 0x7fe33c060950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:24.995 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.990+0000 7fe361358700 1 --2- 172.21.15.146:0/1657595414 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe33c0561e0 0x7fe33c0586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:24.996 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.990+0000 7fe36235a700 1 --2- 172.21.15.146:0/1657595414 >> [v2:172.21.15.78:6800/15827,v1:172.21.15.78:6801/15827] conn(0x7fe33c05e4b0 0x7fe33c060950 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:24.996 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.990+0000 7fe349ffb700 1 -- 172.21.15.146:0/1657595414 <== osd.5 v2:172.21.15.78:6800/15827 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7fe33c060fd0 con 0x7fe33c05e4b0 2021-01-27T09:53:24.997 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:24.990+0000 7fe361358700 1 --2- 172.21.15.146:0/1657595414 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe33c0561e0 0x7fe33c0586a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fe35c1399b0 tx=0x7fe358007bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:25.022 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.018+0000 7fe362b5b700 1 -- 172.21.15.146:0/1657595414 --> [v2:172.21.15.78:6800/15827,v1:172.21.15.78:6801/15827] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe35c05d030 con 0x7fe33c05e4b0 2021-01-27T09:53:25.023 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.018+0000 7fe349ffb700 1 -- 172.21.15.146:0/1657595414 <== osd.5 v2:172.21.15.78:6800/15827 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe35c05d030 con 0x7fe33c05e4b0 2021-01-27T09:53:25.023 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2021-01-27T09:53:25.024 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-01-27T09:53:25.024 INFO:teuthology.orchestra.run.smithi146.stdout:} 2021-01-27T09:53:25.044 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.038+0000 7fe362b5b700 1 -- 172.21.15.146:0/1657595414 >> [v2:172.21.15.78:6800/15827,v1:172.21.15.78:6801/15827] conn(0x7fe33c05e4b0 msgr2=0x7fe33c060950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:25.045 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.038+0000 7fe362b5b700 1 --2- 172.21.15.146:0/1657595414 >> [v2:172.21.15.78:6800/15827,v1:172.21.15.78:6801/15827] conn(0x7fe33c05e4b0 0x7fe33c060950 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:25.045 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.038+0000 7fe362b5b700 1 -- 172.21.15.146:0/1657595414 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe33c0561e0 msgr2=0x7fe33c0586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:25.045 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.038+0000 7fe362b5b700 1 --2- 172.21.15.146:0/1657595414 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fe33c0561e0 0x7fe33c0586a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fe35c1399b0 tx=0x7fe358007bc0).stop 2021-01-27T09:53:25.045 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.038+0000 7fe362b5b700 1 -- 172.21.15.146:0/1657595414 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe344004e80 msgr2=0x7fe35c0bfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:25.046 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.038+0000 7fe362b5b700 1 --2- 172.21.15.146:0/1657595414 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe344004e80 0x7fe35c0bfdb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fe35400fd70 tx=0x7fe354008040).stop 2021-01-27T09:53:25.046 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.038+0000 7fe36235a700 1 -- 172.21.15.146:0/1657595414 reap_dead start 2021-01-27T09:53:25.046 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.038+0000 7fe362b5b700 1 -- 172.21.15.146:0/1657595414 shutdown_connections 2021-01-27T09:53:25.046 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.038+0000 7fe362b5b700 1 -- 172.21.15.146:0/1657595414 >> 172.21.15.146:0/1657595414 conn(0x7fe35c067dc0 msgr2=0x7fe35c066a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:25.046 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.038+0000 7fe362b5b700 1 -- 172.21.15.146:0/1657595414 shutdown_connections 2021-01-27T09:53:25.047 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.038+0000 7fe362b5b700 1 -- 172.21.15.146:0/1657595414 wait complete. 2021-01-27T09:53:25.068 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2021-01-27T09:53:25.325 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.318+0000 7f2a5eca7700 1 Processor -- start 2021-01-27T09:53:25.326 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.318+0000 7f2a5eca7700 1 -- start start 2021-01-27T09:53:25.326 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.318+0000 7f2a5eca7700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2a58064ea0 0x7f2a580c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:25.326 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.318+0000 7f2a5eca7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2a58065280 0x7f2a580bff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:25.327 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.318+0000 7f2a5eca7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a58069bf0 con 0x7f2a58152320 2021-01-27T09:53:25.327 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.318+0000 7f2a5eca7700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a58155760 con 0x7f2a58064ea0 2021-01-27T09:53:25.328 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.318+0000 7f2a5eca7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a58155a00 con 0x7f2a58065280 2021-01-27T09:53:25.328 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.322+0000 7f2a5d4a4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2a58065280 0x7f2a580bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:25.329 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.322+0000 7f2a5e4a6700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2a58152320 0x7f2a5814eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55090/0 (socket says 172.21.15.146:55090) 2021-01-27T09:53:25.329 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.322+0000 7f2a5e4a6700 1 -- 172.21.15.146:0/462816710 learned_addr learned my addr 172.21.15.146:0/462816710 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:53:25.329 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.322+0000 7f2a5dca5700 1 --2- 172.21.15.146:0/462816710 >> v2:172.21.15.78:3300/0 conn(0x7f2a58064ea0 0x7f2a580c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:25.329 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.322+0000 7f2a5dca5700 1 -- 172.21.15.146:0/462816710 >> v2:172.21.15.146:3300/0 conn(0x7f2a58065280 msgr2=0x7f2a580bff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:53:25.329 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.322+0000 7f2a5dca5700 1 --2- 172.21.15.146:0/462816710 >> v2:172.21.15.146:3300/0 conn(0x7f2a58065280 0x7f2a580bff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:25.330 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.322+0000 7f2a5dca5700 1 -- 172.21.15.146:0/462816710 >> v1:172.21.15.146:6789/0 conn(0x7f2a58152320 legacy=0x7f2a5814eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:25.330 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.322+0000 7f2a5dca5700 1 -- 172.21.15.146:0/462816710 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a58155ca0 con 0x7f2a58064ea0 2021-01-27T09:53:25.330 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.322+0000 7f2a5dca5700 1 --2- 172.21.15.146:0/462816710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a58064ea0 0x7f2a580c4e90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f2a580678a0 tx=0x7f2a48006e20).ready entity=mon.0 client_cookie=20c76d1006755b8c server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.326+0000 7f2a5cca3700 1 -- 172.21.15.146:0/462816710 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a480096e0 con 0x7f2a58064ea0 2021-01-27T09:53:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.326+0000 7f2a5cca3700 1 -- 172.21.15.146:0/462816710 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a48009840 con 0x7f2a58064ea0 2021-01-27T09:53:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.326+0000 7f2a5eca7700 1 -- 172.21.15.146:0/462816710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a58064ea0 msgr2=0x7f2a580c4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.326+0000 7f2a5eca7700 1 --2- 172.21.15.146:0/462816710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a58064ea0 0x7f2a580c4e90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f2a580678a0 tx=0x7f2a48006e20).stop 2021-01-27T09:53:25.338 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.330+0000 7f2a5eca7700 1 -- 172.21.15.146:0/462816710 shutdown_connections 2021-01-27T09:53:25.338 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.330+0000 7f2a5eca7700 1 --2- 172.21.15.146:0/462816710 >> v2:172.21.15.146:3300/0 conn(0x7f2a58065280 0x7f2a580bff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:25.338 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.330+0000 7f2a5eca7700 1 --2- 172.21.15.146:0/462816710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a58064ea0 0x7f2a580c4e90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:25.339 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.330+0000 7f2a5eca7700 1 -- 172.21.15.146:0/462816710 >> 172.21.15.146:0/462816710 conn(0x7f2a58067d30 msgr2=0x7f2a58068140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.346+0000 7f2a5eca7700 1 -- 172.21.15.146:0/462816710 shutdown_connections 2021-01-27T09:53:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.350+0000 7f2a5eca7700 1 -- 172.21.15.146:0/462816710 wait complete. 2021-01-27T09:53:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.350+0000 7f2a5eca7700 1 Processor -- start 2021-01-27T09:53:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.350+0000 7f2a5eca7700 1 -- start start 2021-01-27T09:53:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.354+0000 7f2a5eca7700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a58064ea0 0x7f2a58083ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.354+0000 7f2a5eca7700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a58065280 0x7f2a580be130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:25.359 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.354+0000 7f2a5eca7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a58152320 0x7f2a580816b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:25.360 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.354+0000 7f2a5eca7700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a58154380 con 0x7f2a58065280 2021-01-27T09:53:25.360 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.354+0000 7f2a5eca7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a581509d0 con 0x7f2a58152320 2021-01-27T09:53:25.360 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.354+0000 7f2a5eca7700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a58084610 con 0x7f2a58064ea0 2021-01-27T09:53:25.361 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.354+0000 7f2a5e4a6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a58152320 0x7f2a580816b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:25.361 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.354+0000 7f2a5dca5700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a58064ea0 0x7f2a58083ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:25.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.354+0000 7f2a5e4a6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a58152320 0x7f2a580816b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55524/0 (socket says 172.21.15.146:55524) 2021-01-27T09:53:25.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.354+0000 7f2a5e4a6700 1 -- 172.21.15.146:0/1499632397 learned_addr learned my addr 172.21.15.146:0/1499632397 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:25.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.354+0000 7f2a5d4a4700 1 --2- 172.21.15.146:0/1499632397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a58065280 0x7f2a580be130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:25.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.354+0000 7f2a5dca5700 1 -- 172.21.15.146:0/1499632397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a58152320 msgr2=0x7f2a580816b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:25.362 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.354+0000 7f2a5dca5700 1 --2- 172.21.15.146:0/1499632397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a58152320 0x7f2a580816b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:25.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.354+0000 7f2a5dca5700 1 -- 172.21.15.146:0/1499632397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a58065280 msgr2=0x7f2a580be130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:25.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.354+0000 7f2a5dca5700 1 --2- 172.21.15.146:0/1499632397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a58065280 0x7f2a580be130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:25.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.354+0000 7f2a5dca5700 1 -- 172.21.15.146:0/1499632397 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a580bd450 con 0x7f2a58064ea0 2021-01-27T09:53:25.363 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.354+0000 7f2a5e4a6700 1 --2- 172.21.15.146:0/1499632397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a58152320 0x7f2a580816b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:53:25.364 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.354+0000 7f2a5dca5700 1 --2- 172.21.15.146:0/1499632397 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a58064ea0 0x7f2a58083ff0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f2a48013000 tx=0x7f2a48016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:25.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.358+0000 7f2a4dffb700 1 -- 172.21.15.146:0/1499632397 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48011db0 con 0x7f2a58064ea0 2021-01-27T09:53:25.365 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.358+0000 7f2a4dffb700 1 -- 172.21.15.146:0/1499632397 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4801d430 con 0x7f2a58064ea0 2021-01-27T09:53:25.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.358+0000 7f2a4dffb700 1 -- 172.21.15.146:0/1499632397 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4801d7b0 con 0x7f2a58064ea0 2021-01-27T09:53:25.366 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.358+0000 7f2a5eca7700 1 -- 172.21.15.146:0/1499632397 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a580bd6f0 con 0x7f2a58064ea0 2021-01-27T09:53:25.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.358+0000 7f2a5eca7700 1 -- 172.21.15.146:0/1499632397 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a58150c40 con 0x7f2a58064ea0 2021-01-27T09:53:25.367 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.362+0000 7f2a4dffb700 1 -- 172.21.15.146:0/1499632397 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f2a4800f070 con 0x7f2a58064ea0 2021-01-27T09:53:25.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.362+0000 7f2a4dffb700 1 --2- 172.21.15.146:0/1499632397 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2a40056230 0x7f2a400586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:25.368 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.362+0000 7f2a4dffb700 1 -- 172.21.15.146:0/1499632397 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7f2a48071070 con 0x7f2a58064ea0 2021-01-27T09:53:25.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.362+0000 7f2a5d4a4700 1 --2- 172.21.15.146:0/1499632397 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2a40056230 0x7f2a400586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:25.369 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.362+0000 7f2a5d4a4700 1 --2- 172.21.15.146:0/1499632397 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2a40056230 0x7f2a400586f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f2a580beed0 tx=0x7f2a50008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:25.373 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.370+0000 7f2a5eca7700 1 -- 172.21.15.146:0/1499632397 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a580bdb90 con 0x7f2a58064ea0 2021-01-27T09:53:25.388 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.378+0000 7f2a4dffb700 1 -- 172.21.15.146:0/1499632397 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f2a48046590 con 0x7f2a58064ea0 2021-01-27T09:53:25.673 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.670+0000 7f2a5eca7700 1 -- 172.21.15.146:0/1499632397 --> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a58081330 con 0x7f2a40056230 2021-01-27T09:53:25.674 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.670+0000 7f2a4dffb700 1 -- 172.21.15.146:0/1499632397 <== mgr.4104 v2:172.21.15.78:6832/15486 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2a5000c040 con 0x7f2a40056230 2021-01-27T09:53:25.678 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.674+0000 7f2a5eca7700 1 -- 172.21.15.146:0/1499632397 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2a40056230 msgr2=0x7f2a400586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:25.678 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.674+0000 7f2a5eca7700 1 --2- 172.21.15.146:0/1499632397 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2a40056230 0x7f2a400586f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f2a580beed0 tx=0x7f2a50008040).stop 2021-01-27T09:53:25.678 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.674+0000 7f2a5eca7700 1 -- 172.21.15.146:0/1499632397 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a58064ea0 msgr2=0x7f2a58083ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:25.678 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.674+0000 7f2a5eca7700 1 --2- 172.21.15.146:0/1499632397 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a58064ea0 0x7f2a58083ff0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f2a48013000 tx=0x7f2a48016000).stop 2021-01-27T09:53:25.679 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.674+0000 7f2a5eca7700 1 -- 172.21.15.146:0/1499632397 shutdown_connections 2021-01-27T09:53:25.679 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.674+0000 7f2a5eca7700 1 --2- 172.21.15.146:0/1499632397 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2a40056230 0x7f2a400586f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:25.679 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.674+0000 7f2a5eca7700 1 --2- 172.21.15.146:0/1499632397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a58152320 0x7f2a580816b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:25.679 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.674+0000 7f2a5eca7700 1 --2- 172.21.15.146:0/1499632397 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a58065280 0x7f2a580be130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:25.679 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.674+0000 7f2a5eca7700 1 --2- 172.21.15.146:0/1499632397 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a58064ea0 0x7f2a58083ff0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:25.680 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.674+0000 7f2a5eca7700 1 -- 172.21.15.146:0/1499632397 >> 172.21.15.146:0/1499632397 conn(0x7f2a58067d30 msgr2=0x7f2a5814edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:25.680 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.674+0000 7f2a5eca7700 1 -- 172.21.15.146:0/1499632397 shutdown_connections 2021-01-27T09:53:25.680 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.674+0000 7f2a5eca7700 1 -- 172.21.15.146:0/1499632397 wait complete. 2021-01-27T09:53:25.681 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 5 to deep-scrub 2021-01-27T09:53:25.707 INFO:tasks.ceph:Scrubbing osd.6 2021-01-27T09:53:25.707 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2021-01-27T09:53:25.994 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.982+0000 7ff78ffff700 1 Processor -- start 2021-01-27T09:53:25.994 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.982+0000 7ff78ffff700 1 -- start start 2021-01-27T09:53:25.995 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.986+0000 7ff78ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff790062e20 0x7ff790069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:25.995 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.986+0000 7ff78ffff700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff790065fd0 0x7ff790153730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:25.995 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.986+0000 7ff78ffff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff790063200 0x7ff79014f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:25.995 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.986+0000 7ff78ffff700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff790066410 con 0x7ff790065fd0 2021-01-27T09:53:26.000 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.986+0000 7ff78ffff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff790152ee0 con 0x7ff790062e20 2021-01-27T09:53:26.001 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.986+0000 7ff78ffff700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff790067810 con 0x7ff790063200 2021-01-27T09:53:26.001 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.990+0000 7ff78f7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff790063200 0x7ff79014f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:26.002 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.990+0000 7ff78f7fe700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff790063200 0x7ff79014f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:45022/0 (socket says 172.21.15.146:45022) 2021-01-27T09:53:26.002 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.990+0000 7ff78f7fe700 1 -- 172.21.15.146:0/1769878890 learned_addr learned my addr 172.21.15.146:0/1769878890 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:26.003 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.990+0000 7ff78effd700 1 --2- 172.21.15.146:0/1769878890 >> v2:172.21.15.146:3300/0 conn(0x7ff790062e20 0x7ff790069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:26.003 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.990+0000 7ff78f7fe700 1 -- 172.21.15.146:0/1769878890 >> v2:172.21.15.146:3300/0 conn(0x7ff790062e20 msgr2=0x7ff790069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:53:26.003 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.990+0000 7ff78f7fe700 1 --2- 172.21.15.146:0/1769878890 >> v2:172.21.15.146:3300/0 conn(0x7ff790062e20 0x7ff790069bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:26.004 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.990+0000 7ff78f7fe700 1 -- 172.21.15.146:0/1769878890 >> v2:172.21.15.78:3300/0 conn(0x7ff790065fd0 msgr2=0x7ff790153730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:53:26.005 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.990+0000 7ff78f7fe700 1 --2- 172.21.15.146:0/1769878890 >> v2:172.21.15.78:3300/0 conn(0x7ff790065fd0 0x7ff790153730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:53:26.005 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.990+0000 7ff78f7fe700 1 -- 172.21.15.146:0/1769878890 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff790067ab0 con 0x7ff790063200 2021-01-27T09:53:26.005 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.990+0000 7ff78f7fe700 1 --2- 172.21.15.146:0/1769878890 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff790063200 0x7ff79014f160 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7ff790064e70 tx=0x7ff7880092d0).ready entity=mon.2 client_cookie=b306113e5a96bc64 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:26.005 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.990+0000 7ff78dffb700 1 -- 172.21.15.146:0/1769878890 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78800bbf0 con 0x7ff790063200 2021-01-27T09:53:26.005 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.990+0000 7ff78dffb700 1 -- 172.21.15.146:0/1769878890 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78800bd50 con 0x7ff790063200 2021-01-27T09:53:26.006 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.990+0000 7ff78dffb700 1 -- 172.21.15.146:0/1769878890 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff788011610 con 0x7ff790063200 2021-01-27T09:53:26.006 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.994+0000 7ff78ffff700 1 -- 172.21.15.146:0/1769878890 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff790063200 msgr2=0x7ff79014f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:26.006 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.994+0000 7ff78ffff700 1 --2- 172.21.15.146:0/1769878890 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff790063200 0x7ff79014f160 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7ff790064e70 tx=0x7ff7880092d0).stop 2021-01-27T09:53:26.006 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.994+0000 7ff78ffff700 1 -- 172.21.15.146:0/1769878890 shutdown_connections 2021-01-27T09:53:26.007 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.994+0000 7ff78ffff700 1 --2- 172.21.15.146:0/1769878890 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff790063200 0x7ff79014f160 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:26.007 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.994+0000 7ff78ffff700 1 --2- 172.21.15.146:0/1769878890 >> v2:172.21.15.78:3300/0 conn(0x7ff790065fd0 0x7ff790153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:53:26.007 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.994+0000 7ff78ffff700 1 --2- 172.21.15.146:0/1769878890 >> v2:172.21.15.146:3300/0 conn(0x7ff790062e20 0x7ff790069bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:26.007 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.994+0000 7ff78ffff700 1 -- 172.21.15.146:0/1769878890 >> 172.21.15.146:0/1769878890 conn(0x7ff790064240 msgr2=0x7ff790069110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:26.007 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:25.994+0000 7ff78ffff700 1 -- 172.21.15.146:0/1769878890 shutdown_connections 2021-01-27T09:53:26.017 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.010+0000 7ff78ffff700 1 -- 172.21.15.146:0/1769878890 wait complete. 2021-01-27T09:53:26.019 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.014+0000 7ff78ffff700 1 Processor -- start 2021-01-27T09:53:26.020 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.014+0000 7ff78ffff700 1 -- start start 2021-01-27T09:53:26.026 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.018+0000 7ff78ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff790062e20 0x7ff79013b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:26.026 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.018+0000 7ff78ffff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff790063200 0x7ff790155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:26.026 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.018+0000 7ff78ffff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff790065fd0 0x7ff7900b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:26.026 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.018+0000 7ff78ffff700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7900b68f0 con 0x7ff790065fd0 2021-01-27T09:53:26.027 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.018+0000 7ff78ffff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7900b6b90 con 0x7ff790062e20 2021-01-27T09:53:26.027 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.018+0000 7ff78ffff700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff790154e80 con 0x7ff790063200 2021-01-27T09:53:26.027 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.018+0000 7ff78f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff790065fd0 0x7ff7900b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:26.027 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.018+0000 7ff78f7fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff790065fd0 0x7ff7900b60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:58412/0 (socket says 172.21.15.146:58412) 2021-01-27T09:53:26.028 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.018+0000 7ff78f7fe700 1 -- 172.21.15.146:0/107472690 learned_addr learned my addr 172.21.15.146:0/107472690 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:26.028 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.018+0000 7ff78f7fe700 1 -- 172.21.15.146:0/107472690 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff790063200 msgr2=0x7ff790155b00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-27T09:53:26.028 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.018+0000 7ff78f7fe700 1 --2- 172.21.15.146:0/107472690 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff790063200 0x7ff790155b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:53:26.028 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.018+0000 7ff78f7fe700 1 -- 172.21.15.146:0/107472690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff790062e20 msgr2=0x7ff79013b7f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-27T09:53:26.028 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.018+0000 7ff78f7fe700 1 --2- 172.21.15.146:0/107472690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff790062e20 0x7ff79013b7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:53:26.029 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.018+0000 7ff78f7fe700 1 -- 172.21.15.146:0/107472690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff790155120 con 0x7ff790065fd0 2021-01-27T09:53:26.029 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.018+0000 7ff78f7fe700 1 --2- 172.21.15.146:0/107472690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff790065fd0 0x7ff7900b60d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7ff788009130 tx=0x7ff788017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:26.029 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.018+0000 7ff786ffd700 1 -- 172.21.15.146:0/107472690 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff788010630 con 0x7ff790065fd0 2021-01-27T09:53:26.029 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.018+0000 7ff786ffd700 1 -- 172.21.15.146:0/107472690 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff788010790 con 0x7ff790065fd0 2021-01-27T09:53:26.030 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.018+0000 7ff786ffd700 1 -- 172.21.15.146:0/107472690 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff788010b10 con 0x7ff790065fd0 2021-01-27T09:53:26.030 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.018+0000 7ff78ffff700 1 -- 172.21.15.146:0/107472690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7901553c0 con 0x7ff790065fd0 2021-01-27T09:53:26.030 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.018+0000 7ff78ffff700 1 -- 172.21.15.146:0/107472690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7900b65c0 con 0x7ff790065fd0 2021-01-27T09:53:26.031 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.022+0000 7ff786ffd700 1 -- 172.21.15.146:0/107472690 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7ff78800f070 con 0x7ff790065fd0 2021-01-27T09:53:26.031 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.022+0000 7ff78ffff700 1 -- 172.21.15.146:0/107472690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff790062a10 con 0x7ff790065fd0 2021-01-27T09:53:26.032 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.026+0000 7ff786ffd700 1 --2- 172.21.15.146:0/107472690 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff774056230 0x7ff7740586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:26.032 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.026+0000 7ff786ffd700 1 -- 172.21.15.146:0/107472690 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7ff788071770 con 0x7ff790065fd0 2021-01-27T09:53:26.032 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.026+0000 7ff78effd700 1 --2- 172.21.15.146:0/107472690 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff774056230 0x7ff7740586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:26.032 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.026+0000 7ff786ffd700 1 --2- 172.21.15.146:0/107472690 >> [v2:172.21.15.78:6808/15825,v1:172.21.15.78:6809/15825] conn(0x7ff77405e6f0 0x7ff774060b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:26.032 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.026+0000 7ff786ffd700 1 -- 172.21.15.146:0/107472690 --> [v2:172.21.15.78:6808/15825,v1:172.21.15.78:6809/15825] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff774061210 con 0x7ff77405e6f0 2021-01-27T09:53:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.026+0000 7ff786ffd700 1 -- 172.21.15.146:0/107472690 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff788046c90 con 0x7ff790065fd0 2021-01-27T09:53:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.026+0000 7ff78effd700 1 --2- 172.21.15.146:0/107472690 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff774056230 0x7ff7740586f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7ff77800b980 tx=0x7ff778006dc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.026+0000 7ff78e7fc700 1 --2- 172.21.15.146:0/107472690 >> [v2:172.21.15.78:6808/15825,v1:172.21.15.78:6809/15825] conn(0x7ff77405e6f0 0x7ff774060b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:26.045 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.042+0000 7ff78e7fc700 1 --2- 172.21.15.146:0/107472690 >> [v2:172.21.15.78:6808/15825,v1:172.21.15.78:6809/15825] conn(0x7ff77405e6f0 0x7ff774060b90 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:26.049 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.046+0000 7ff786ffd700 1 -- 172.21.15.146:0/107472690 <== osd.6 v2:172.21.15.78:6808/15825 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7ff774061210 con 0x7ff77405e6f0 2021-01-27T09:53:26.083 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.078+0000 7ff78ffff700 1 -- 172.21.15.146:0/107472690 --> [v2:172.21.15.78:6808/15825,v1:172.21.15.78:6809/15825] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff790044680 con 0x7ff77405e6f0 2021-01-27T09:53:26.087 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.082+0000 7ff786ffd700 1 -- 172.21.15.146:0/107472690 <== osd.6 v2:172.21.15.78:6808/15825 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff790044680 con 0x7ff77405e6f0 2021-01-27T09:53:26.093 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2021-01-27T09:53:26.094 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-01-27T09:53:26.094 INFO:teuthology.orchestra.run.smithi146.stdout:} 2021-01-27T09:53:26.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.094+0000 7ff78ffff700 1 -- 172.21.15.146:0/107472690 >> [v2:172.21.15.78:6808/15825,v1:172.21.15.78:6809/15825] conn(0x7ff77405e6f0 msgr2=0x7ff774060b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:26.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.098+0000 7ff78ffff700 1 --2- 172.21.15.146:0/107472690 >> [v2:172.21.15.78:6808/15825,v1:172.21.15.78:6809/15825] conn(0x7ff77405e6f0 0x7ff774060b90 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:26.107 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.098+0000 7ff78ffff700 1 -- 172.21.15.146:0/107472690 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff774056230 msgr2=0x7ff7740586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:26.108 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.102+0000 7ff78ffff700 1 --2- 172.21.15.146:0/107472690 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff774056230 0x7ff7740586f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7ff77800b980 tx=0x7ff778006dc0).stop 2021-01-27T09:53:26.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.102+0000 7ff78ffff700 1 -- 172.21.15.146:0/107472690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff790065fd0 msgr2=0x7ff7900b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:26.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.102+0000 7ff78ffff700 1 --2- 172.21.15.146:0/107472690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff790065fd0 0x7ff7900b60d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7ff788009130 tx=0x7ff788017000).stop 2021-01-27T09:53:26.109 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.102+0000 7ff78f7fe700 1 -- 172.21.15.146:0/107472690 reap_dead start 2021-01-27T09:53:26.115 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.110+0000 7ff78ffff700 1 -- 172.21.15.146:0/107472690 shutdown_connections 2021-01-27T09:53:26.116 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.110+0000 7ff78ffff700 1 -- 172.21.15.146:0/107472690 >> 172.21.15.146:0/107472690 conn(0x7ff790064240 msgr2=0x7ff7900bcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:26.116 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.110+0000 7ff78ffff700 1 -- 172.21.15.146:0/107472690 shutdown_connections 2021-01-27T09:53:26.116 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.110+0000 7ff78ffff700 1 -- 172.21.15.146:0/107472690 wait complete. 2021-01-27T09:53:26.148 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2021-01-27T09:53:26.398 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.394+0000 7f8da80f0700 1 Processor -- start 2021-01-27T09:53:26.414 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.406+0000 7f8da80f0700 1 -- start start 2021-01-27T09:53:26.414 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.406+0000 7f8da80f0700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8da0061d10 0x7f8da0152d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:26.414 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.406+0000 7f8da80f0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8da00baf80 0x7f8da014ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:26.414 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.406+0000 7f8da80f0700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8da00bb430 con 0x7f8da0061930 2021-01-27T09:53:26.415 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.406+0000 7f8da80f0700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8da0153220 con 0x7f8da0061d10 2021-01-27T09:53:26.415 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.406+0000 7f8da80f0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8da00bb6c0 con 0x7f8da00baf80 2021-01-27T09:53:26.416 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.410+0000 7f8da5e8c700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8da0061930 0x7f8da0062810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:43156/0 (socket says 172.21.15.146:43156) 2021-01-27T09:53:26.416 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.410+0000 7f8da5e8c700 1 -- 172.21.15.146:0/175125666 learned_addr learned my addr 172.21.15.146:0/175125666 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:53:26.416 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.410+0000 7f8da568b700 1 --2- 172.21.15.146:0/175125666 >> v2:172.21.15.78:3300/0 conn(0x7f8da0061d10 0x7f8da0152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:26.416 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.410+0000 7f8da568b700 1 -- 172.21.15.146:0/175125666 >> v2:172.21.15.146:3300/0 conn(0x7f8da00baf80 msgr2=0x7f8da014ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:53:26.417 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.410+0000 7f8da568b700 1 --2- 172.21.15.146:0/175125666 >> v2:172.21.15.146:3300/0 conn(0x7f8da00baf80 0x7f8da014ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:53:26.417 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.410+0000 7f8da568b700 1 -- 172.21.15.146:0/175125666 >> v1:172.21.15.78:6789/0 conn(0x7f8da0061930 legacy=0x7f8da0062810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:26.417 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.410+0000 7f8da568b700 1 -- 172.21.15.146:0/175125666 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da0067000 con 0x7f8da0061d10 2021-01-27T09:53:26.417 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.410+0000 7f8da568b700 1 --2- 172.21.15.146:0/175125666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da0061d10 0x7f8da0152d30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f8d9400b9c0 tx=0x7f8d94006e20).ready entity=mon.0 client_cookie=cbd4ec6a608a37db server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:26.418 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.414+0000 7f8da4e8a700 1 -- 172.21.15.146:0/175125666 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d94009830 con 0x7f8da0061d10 2021-01-27T09:53:26.419 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.414+0000 7f8da4e8a700 1 -- 172.21.15.146:0/175125666 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d94009990 con 0x7f8da0061d10 2021-01-27T09:53:26.419 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.414+0000 7f8da80f0700 1 -- 172.21.15.146:0/175125666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da0061d10 msgr2=0x7f8da0152d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:26.419 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.414+0000 7f8da80f0700 1 --2- 172.21.15.146:0/175125666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da0061d10 0x7f8da0152d30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f8d9400b9c0 tx=0x7f8d94006e20).stop 2021-01-27T09:53:26.420 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.414+0000 7f8da80f0700 1 -- 172.21.15.146:0/175125666 shutdown_connections 2021-01-27T09:53:26.420 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.414+0000 7f8da80f0700 1 --2- 172.21.15.146:0/175125666 >> v2:172.21.15.146:3300/0 conn(0x7f8da00baf80 0x7f8da014ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:53:26.420 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.414+0000 7f8da80f0700 1 --2- 172.21.15.146:0/175125666 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da0061d10 0x7f8da0152d30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:26.421 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.414+0000 7f8da80f0700 1 -- 172.21.15.146:0/175125666 >> 172.21.15.146:0/175125666 conn(0x7f8da00bdcc0 msgr2=0x7f8da00be0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:26.421 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.414+0000 7f8da80f0700 1 -- 172.21.15.146:0/175125666 shutdown_connections 2021-01-27T09:53:26.424 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.418+0000 7f8da80f0700 1 -- 172.21.15.146:0/175125666 wait complete. 2021-01-27T09:53:26.425 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.418+0000 7f8da80f0700 1 Processor -- start 2021-01-27T09:53:26.429 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.426+0000 7f8da80f0700 1 -- start start 2021-01-27T09:53:26.433 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.430+0000 7f8da80f0700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da0061930 0x7f8da0132270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:26.434 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.430+0000 7f8da80f0700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8da0061d10 0x7f8da013b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:26.434 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.430+0000 7f8da80f0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8da00baf80 0x7f8da013b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:26.434 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.430+0000 7f8da568b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8da0061d10 0x7f8da013b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:26.435 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.430+0000 7f8da568b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8da0061d10 0x7f8da013b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:45040/0 (socket says 172.21.15.146:45040) 2021-01-27T09:53:26.436 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.430+0000 7f8da5e8c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da0061930 0x7f8da0132270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:26.437 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.430+0000 7f8da5e8c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da0061930 0x7f8da0132270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:58430/0 (socket says 172.21.15.146:58430) 2021-01-27T09:53:26.438 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.434+0000 7f8da568b700 1 -- 172.21.15.146:0/1131604600 learned_addr learned my addr 172.21.15.146:0/1131604600 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.434+0000 7f8da80f0700 1 -- 172.21.15.146:0/1131604600 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da014ef70 con 0x7f8da0061930 2021-01-27T09:53:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.434+0000 7f8da668d700 1 --2- 172.21.15.146:0/1131604600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8da00baf80 0x7f8da013b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.434+0000 7f8da80f0700 1 -- 172.21.15.146:0/1131604600 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da014f210 con 0x7f8da00baf80 2021-01-27T09:53:26.440 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.434+0000 7f8da80f0700 1 -- 172.21.15.146:0/1131604600 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da014f4b0 con 0x7f8da0061d10 2021-01-27T09:53:26.440 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.434+0000 7f8da568b700 1 -- 172.21.15.146:0/1131604600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8da00baf80 msgr2=0x7f8da013b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:26.441 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.434+0000 7f8da568b700 1 --2- 172.21.15.146:0/1131604600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8da00baf80 0x7f8da013b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:26.441 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.434+0000 7f8da568b700 1 -- 172.21.15.146:0/1131604600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da0061930 msgr2=0x7f8da0132270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:26.441 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.434+0000 7f8da568b700 1 --2- 172.21.15.146:0/1131604600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da0061930 0x7f8da0132270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:26.441 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.434+0000 7f8da568b700 1 -- 172.21.15.146:0/1131604600 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da014f750 con 0x7f8da0061d10 2021-01-27T09:53:26.442 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.434+0000 7f8da568b700 1 --2- 172.21.15.146:0/1131604600 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8da0061d10 0x7f8da013b430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f8d9400b150 tx=0x7f8d94016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:26.443 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.438+0000 7f8d9dffb700 1 -- 172.21.15.146:0/1131604600 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9401f070 con 0x7f8da0061d10 2021-01-27T09:53:26.443 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.438+0000 7f8d9dffb700 1 -- 172.21.15.146:0/1131604600 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d94012e80 con 0x7f8da0061d10 2021-01-27T09:53:26.443 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.438+0000 7f8d9dffb700 1 -- 172.21.15.146:0/1131604600 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9401b830 con 0x7f8da0061d10 2021-01-27T09:53:26.443 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.438+0000 7f8da80f0700 1 -- 172.21.15.146:0/1131604600 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da00bceb0 con 0x7f8da0061d10 2021-01-27T09:53:26.444 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.438+0000 7f8da80f0700 1 -- 172.21.15.146:0/1131604600 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da01536f0 con 0x7f8da0061d10 2021-01-27T09:53:26.445 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.438+0000 7f8d9dffb700 1 -- 172.21.15.146:0/1131604600 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f8d9400f070 con 0x7f8da0061d10 2021-01-27T09:53:26.446 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.442+0000 7f8d9dffb700 1 --2- 172.21.15.146:0/1131604600 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f8d80056260 0x7f8d80058720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:26.447 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.442+0000 7f8d9dffb700 1 -- 172.21.15.146:0/1131604600 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7f8d94070ac0 con 0x7f8da0061d10 2021-01-27T09:53:26.450 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.446+0000 7f8da5e8c700 1 --2- 172.21.15.146:0/1131604600 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f8d80056260 0x7f8d80058720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:26.451 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.446+0000 7f8da80f0700 1 -- 172.21.15.146:0/1131604600 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8da0153940 con 0x7f8da0061d10 2021-01-27T09:53:26.452 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.446+0000 7f8da5e8c700 1 --2- 172.21.15.146:0/1131604600 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f8d80056260 0x7f8d80058720 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f8d98001530 tx=0x7f8d98009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:26.457 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.454+0000 7f8d9dffb700 1 -- 172.21.15.146:0/1131604600 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f8d94045fe0 con 0x7f8da0061d10 2021-01-27T09:53:26.794 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.790+0000 7f8da80f0700 1 -- 172.21.15.146:0/1131604600 --> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f8da0044680 con 0x7f8d80056260 2021-01-27T09:53:26.794 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.790+0000 7f8d9dffb700 1 -- 172.21.15.146:0/1131604600 <== mgr.4104 v2:172.21.15.78:6832/15486 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8da0044680 con 0x7f8d80056260 2021-01-27T09:53:26.800 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.794+0000 7f8da80f0700 1 -- 172.21.15.146:0/1131604600 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f8d80056260 msgr2=0x7f8d80058720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:26.800 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.794+0000 7f8da80f0700 1 --2- 172.21.15.146:0/1131604600 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f8d80056260 0x7f8d80058720 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f8d98001530 tx=0x7f8d98009040).stop 2021-01-27T09:53:26.801 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.794+0000 7f8da80f0700 1 -- 172.21.15.146:0/1131604600 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8da0061d10 msgr2=0x7f8da013b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:26.801 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.794+0000 7f8da80f0700 1 --2- 172.21.15.146:0/1131604600 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8da0061d10 0x7f8da013b430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f8d9400b150 tx=0x7f8d94016000).stop 2021-01-27T09:53:26.802 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.794+0000 7f8da80f0700 1 -- 172.21.15.146:0/1131604600 shutdown_connections 2021-01-27T09:53:26.802 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.794+0000 7f8da80f0700 1 --2- 172.21.15.146:0/1131604600 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f8d80056260 0x7f8d80058720 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:26.802 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.794+0000 7f8da80f0700 1 --2- 172.21.15.146:0/1131604600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8da00baf80 0x7f8da013b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:26.802 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.794+0000 7f8da80f0700 1 --2- 172.21.15.146:0/1131604600 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8da0061d10 0x7f8da013b430 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:26.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.794+0000 7f8da80f0700 1 --2- 172.21.15.146:0/1131604600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8da0061930 0x7f8da0132270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:26.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.794+0000 7f8da80f0700 1 -- 172.21.15.146:0/1131604600 >> 172.21.15.146:0/1131604600 conn(0x7f8da00bdcc0 msgr2=0x7f8da00bd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:26.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.794+0000 7f8da80f0700 1 -- 172.21.15.146:0/1131604600 shutdown_connections 2021-01-27T09:53:26.803 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:26.794+0000 7f8da80f0700 1 -- 172.21.15.146:0/1131604600 wait complete. 2021-01-27T09:53:26.804 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 6 to deep-scrub 2021-01-27T09:53:26.837 INFO:tasks.ceph:Scrubbing osd.7 2021-01-27T09:53:26.837 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2021-01-27T09:53:27.156 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.146+0000 7f4693ea6700 1 Processor -- start 2021-01-27T09:53:27.156 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.150+0000 7f4693ea6700 1 -- start start 2021-01-27T09:53:27.157 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.150+0000 7f4693ea6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f468c152de0 0x7f468c0bd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:27.157 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.150+0000 7f4693ea6700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f468c069690 0x7f468c13add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:27.157 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.150+0000 7f4693ea6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468c1558a0 con 0x7f468c0692b0 2021-01-27T09:53:27.157 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.150+0000 7f4693ea6700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f468c1522d0 con 0x7f468c069690 2021-01-27T09:53:27.158 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.150+0000 7f4693ea6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f468c0bdb90 con 0x7f468c152de0 2021-01-27T09:53:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.150+0000 7f4691c42700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f468c0692b0 0x7f468c1526c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55134/0 (socket says 172.21.15.146:55134) 2021-01-27T09:53:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.150+0000 7f4691c42700 1 -- 172.21.15.146:0/3223100586 learned_addr learned my addr 172.21.15.146:0/3223100586 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:53:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.154+0000 7f4690c40700 1 -- 172.21.15.146:0/3223100586 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240164996 0 0) 0x7f468c1558a0 con 0x7f468c0692b0 2021-01-27T09:53:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.154+0000 7f4692443700 1 --2- 172.21.15.146:0/3223100586 >> v2:172.21.15.78:3300/0 conn(0x7f468c069690 0x7f468c13add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:27.161 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.154+0000 7f4690c40700 1 -- 172.21.15.146:0/3223100586 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4670003270 con 0x7f468c0692b0 2021-01-27T09:53:27.161 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.154+0000 7f4692443700 1 -- 172.21.15.146:0/3223100586 >> v2:172.21.15.146:3300/0 conn(0x7f468c152de0 msgr2=0x7f468c0bd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:53:27.161 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.154+0000 7f4692443700 1 --2- 172.21.15.146:0/3223100586 >> v2:172.21.15.146:3300/0 conn(0x7f468c152de0 0x7f468c0bd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:53:27.161 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.154+0000 7f4692443700 1 -- 172.21.15.146:0/3223100586 >> v1:172.21.15.146:6789/0 conn(0x7f468c0692b0 legacy=0x7f468c1526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:27.161 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.154+0000 7f4692443700 1 -- 172.21.15.146:0/3223100586 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c155b40 con 0x7f468c069690 2021-01-27T09:53:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.154+0000 7f4692443700 1 --2- 172.21.15.146:0/3223100586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f468c069690 0x7f468c13add0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f4684009cc0 tx=0x7f4684009220).ready entity=mon.0 client_cookie=7deb41564871efe9 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.162+0000 7f4690c40700 1 -- 172.21.15.146:0/3223100586 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468400ba20 con 0x7f468c069690 2021-01-27T09:53:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.162+0000 7f4690c40700 1 -- 172.21.15.146:0/3223100586 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468400bb80 con 0x7f468c069690 2021-01-27T09:53:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.162+0000 7f4690c40700 1 -- 172.21.15.146:0/3223100586 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4684011400 con 0x7f468c069690 2021-01-27T09:53:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.162+0000 7f4693ea6700 1 -- 172.21.15.146:0/3223100586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f468c069690 msgr2=0x7f468c13add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.162+0000 7f4693ea6700 1 --2- 172.21.15.146:0/3223100586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f468c069690 0x7f468c13add0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f4684009cc0 tx=0x7f4684009220).stop 2021-01-27T09:53:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.162+0000 7f4693ea6700 1 -- 172.21.15.146:0/3223100586 shutdown_connections 2021-01-27T09:53:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.162+0000 7f4693ea6700 1 --2- 172.21.15.146:0/3223100586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f468c069690 0x7f468c13add0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.162+0000 7f4693ea6700 1 --2- 172.21.15.146:0/3223100586 >> v2:172.21.15.146:3300/0 conn(0x7f468c152de0 0x7f468c0bd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:53:27.168 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.162+0000 7f4693ea6700 1 -- 172.21.15.146:0/3223100586 >> 172.21.15.146:0/3223100586 conn(0x7f468c064240 msgr2=0x7f468c067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:27.171 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.162+0000 7f4693ea6700 1 -- 172.21.15.146:0/3223100586 shutdown_connections 2021-01-27T09:53:27.171 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.162+0000 7f4693ea6700 1 -- 172.21.15.146:0/3223100586 wait complete. 2021-01-27T09:53:27.171 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.166+0000 7f4693ea6700 1 Processor -- start 2021-01-27T09:53:27.172 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.166+0000 7f4693ea6700 1 -- start start 2021-01-27T09:53:27.172 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.166+0000 7f4693ea6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f468c069690 0x7f468c14df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:27.173 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.166+0000 7f4693ea6700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f468c152de0 0x7f468c15d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:27.173 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.166+0000 7f4693ea6700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f468c14eac0 0x7f468c15d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:27.173 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.166+0000 7f4693ea6700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c0c10a0 con 0x7f468c152de0 2021-01-27T09:53:27.173 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.166+0000 7f4693ea6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c137610 con 0x7f468c069690 2021-01-27T09:53:27.174 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.166+0000 7f4693ea6700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468c1569e0 con 0x7f468c14eac0 2021-01-27T09:53:27.174 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.166+0000 7f4691c42700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f468c069690 0x7f468c14df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:27.174 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.166+0000 7f4691441700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f468c152de0 0x7f468c15d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:27.174 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.166+0000 7f4691441700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f468c152de0 0x7f468c15d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:58444/0 (socket says 172.21.15.146:58444) 2021-01-27T09:53:27.175 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.166+0000 7f4691441700 1 -- 172.21.15.146:0/3140250632 learned_addr learned my addr 172.21.15.146:0/3140250632 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:27.176 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.170+0000 7f4691441700 1 -- 172.21.15.146:0/3140250632 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f468c14eac0 msgr2=0x7f468c15d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:27.176 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.170+0000 7f4691441700 1 --2- 172.21.15.146:0/3140250632 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f468c14eac0 0x7f468c15d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-27T09:53:27.176 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.170+0000 7f4691441700 1 -- 172.21.15.146:0/3140250632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f468c069690 msgr2=0x7f468c14df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:27.176 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.170+0000 7f4691441700 1 --2- 172.21.15.146:0/3140250632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f468c069690 0x7f468c14df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:27.177 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.170+0000 7f4691441700 1 -- 172.21.15.146:0/3140250632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c156c80 con 0x7f468c152de0 2021-01-27T09:53:27.177 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.170+0000 7f4691441700 1 --2- 172.21.15.146:0/3140250632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f468c152de0 0x7f468c15d210 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f467c0096e0 tx=0x7f467c006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:27.177 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.170+0000 7f4681ffb700 1 -- 172.21.15.146:0/3140250632 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c00d4a0 con 0x7f468c152de0 2021-01-27T09:53:27.177 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.170+0000 7f4693ea6700 1 -- 172.21.15.146:0/3140250632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f468c1378b0 con 0x7f468c152de0 2021-01-27T09:53:27.177 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.170+0000 7f4693ea6700 1 -- 172.21.15.146:0/3140250632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f468c14e440 con 0x7f468c152de0 2021-01-27T09:53:27.178 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.170+0000 7f466f7fe700 1 -- 172.21.15.146:0/3140250632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4668000fc0 con 0x7f468c152de0 2021-01-27T09:53:27.178 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.174+0000 7f4681ffb700 1 -- 172.21.15.146:0/3140250632 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c00d600 con 0x7f468c152de0 2021-01-27T09:53:27.179 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.174+0000 7f4681ffb700 1 -- 172.21.15.146:0/3140250632 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c00d9c0 con 0x7f468c152de0 2021-01-27T09:53:27.179 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.174+0000 7f4681ffb700 1 -- 172.21.15.146:0/3140250632 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f467c00f070 con 0x7f468c152de0 2021-01-27T09:53:27.179 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.174+0000 7f4681ffb700 1 --2- 172.21.15.146:0/3140250632 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4674056230 0x7f46740586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:27.180 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.174+0000 7f4681ffb700 1 -- 172.21.15.146:0/3140250632 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7f467c06f210 con 0x7f468c152de0 2021-01-27T09:53:27.180 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.174+0000 7f4691c42700 1 --2- 172.21.15.146:0/3140250632 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4674056230 0x7f46740586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:27.181 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.174+0000 7f4691c42700 1 --2- 172.21.15.146:0/3140250632 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4674056230 0x7f46740586f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f468c151bf0 tx=0x7f4688007a30).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:27.181 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.174+0000 7f4681ffb700 1 --2- 172.21.15.146:0/3140250632 >> [v2:172.21.15.78:6824/15828,v1:172.21.15.78:6825/15828] conn(0x7f467405e670 0x7f4674060b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:27.181 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.174+0000 7f4681ffb700 1 -- 172.21.15.146:0/3140250632 --> [v2:172.21.15.78:6824/15828,v1:172.21.15.78:6825/15828] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4674061190 con 0x7f467405e670 2021-01-27T09:53:27.182 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.178+0000 7f4692443700 1 --2- 172.21.15.146:0/3140250632 >> [v2:172.21.15.78:6824/15828,v1:172.21.15.78:6825/15828] conn(0x7f467405e670 0x7f4674060b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:27.182 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.178+0000 7f4681ffb700 1 -- 172.21.15.146:0/3140250632 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f467c044850 con 0x7f468c152de0 2021-01-27T09:53:27.182 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.178+0000 7f4692443700 1 --2- 172.21.15.146:0/3140250632 >> [v2:172.21.15.78:6824/15828,v1:172.21.15.78:6825/15828] conn(0x7f467405e670 0x7f4674060b10 crc :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:27.183 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.178+0000 7f4681ffb700 1 -- 172.21.15.146:0/3140250632 <== osd.7 v2:172.21.15.78:6824/15828 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f4674061190 con 0x7f467405e670 2021-01-27T09:53:27.231 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.226+0000 7f466f7fe700 1 -- 172.21.15.146:0/3140250632 --> [v2:172.21.15.78:6824/15828,v1:172.21.15.78:6825/15828] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4668002a20 con 0x7f467405e670 2021-01-27T09:53:27.240 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.234+0000 7f4681ffb700 1 -- 172.21.15.146:0/3140250632 <== osd.7 v2:172.21.15.78:6824/15828 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4668002a20 con 0x7f467405e670 2021-01-27T09:53:27.241 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2021-01-27T09:53:27.242 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-01-27T09:53:27.242 INFO:teuthology.orchestra.run.smithi146.stdout:} 2021-01-27T09:53:27.254 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.250+0000 7f466f7fe700 1 -- 172.21.15.146:0/3140250632 >> [v2:172.21.15.78:6824/15828,v1:172.21.15.78:6825/15828] conn(0x7f467405e670 msgr2=0x7f4674060b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:27.254 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.250+0000 7f466f7fe700 1 --2- 172.21.15.146:0/3140250632 >> [v2:172.21.15.78:6824/15828,v1:172.21.15.78:6825/15828] conn(0x7f467405e670 0x7f4674060b10 crc :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.254+0000 7f466f7fe700 1 -- 172.21.15.146:0/3140250632 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4674056230 msgr2=0x7f46740586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.254+0000 7f466f7fe700 1 --2- 172.21.15.146:0/3140250632 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f4674056230 0x7f46740586f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f468c151bf0 tx=0x7f4688007a30).stop 2021-01-27T09:53:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.254+0000 7f466f7fe700 1 -- 172.21.15.146:0/3140250632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f468c152de0 msgr2=0x7f468c15d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.254+0000 7f466f7fe700 1 --2- 172.21.15.146:0/3140250632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f468c152de0 0x7f468c15d210 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f467c0096e0 tx=0x7f467c006e20).stop 2021-01-27T09:53:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.254+0000 7f4692443700 1 -- 172.21.15.146:0/3140250632 reap_dead start 2021-01-27T09:53:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.254+0000 7f466f7fe700 1 -- 172.21.15.146:0/3140250632 shutdown_connections 2021-01-27T09:53:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.254+0000 7f466f7fe700 1 -- 172.21.15.146:0/3140250632 >> 172.21.15.146:0/3140250632 conn(0x7f468c064240 msgr2=0x7f468c155280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.258+0000 7f466f7fe700 1 -- 172.21.15.146:0/3140250632 shutdown_connections 2021-01-27T09:53:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.258+0000 7f466f7fe700 1 -- 172.21.15.146:0/3140250632 wait complete. 2021-01-27T09:53:27.292 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2021-01-27T09:53:27.693 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.686+0000 7f285759e700 1 Processor -- start 2021-01-27T09:53:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.690+0000 7f285759e700 1 -- start start 2021-01-27T09:53:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.710+0000 7f285759e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f28580664c0 0x7f285814e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:27.722 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.710+0000 7f285759e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2858063200 0x7f28580baa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:27.722 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.710+0000 7f285759e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28580b6300 con 0x7f2858062e20 2021-01-27T09:53:27.722 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.710+0000 7f285759e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28580b6530 con 0x7f28580664c0 2021-01-27T09:53:27.722 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.710+0000 7f285759e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28580b67d0 con 0x7f2858063200 2021-01-27T09:53:27.723 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.710+0000 7f2855d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f28580664c0 0x7f285814e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:27.723 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.710+0000 7f2855d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f28580664c0 0x7f285814e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:58454/0 (socket says 172.21.15.146:58454) 2021-01-27T09:53:27.723 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.710+0000 7f2855d9b700 1 -- 172.21.15.146:0/3463162374 learned_addr learned my addr 172.21.15.146:0/3463162374 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:27.723 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.710+0000 7f2855d9b700 1 -- 172.21.15.146:0/3463162374 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2858063200 msgr2=0x7f28580baa90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:53:27.724 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.710+0000 7f2855d9b700 1 --2- 172.21.15.146:0/3463162374 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2858063200 0x7f28580baa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:53:27.724 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.710+0000 7f2855d9b700 1 -- 172.21.15.146:0/3463162374 >> v1:172.21.15.146:6789/0 conn(0x7f2858062e20 legacy=0x7f2858065da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-27T09:53:27.724 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.710+0000 7f2855d9b700 1 -- 172.21.15.146:0/3463162374 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2858063880 con 0x7f28580664c0 2021-01-27T09:53:27.724 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.714+0000 7f2855d9b700 1 --2- 172.21.15.146:0/3463162374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28580664c0 0x7f285814e960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f2858061a00 tx=0x7f284c006ee0).ready entity=mon.0 client_cookie=cdc02f6d51d621b1 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:27.724 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.714+0000 7f285559a700 1 -- 172.21.15.146:0/3463162374 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c009890 con 0x7f28580664c0 2021-01-27T09:53:27.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.714+0000 7f285559a700 1 -- 172.21.15.146:0/3463162374 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284c0099f0 con 0x7f28580664c0 2021-01-27T09:53:27.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.714+0000 7f285559a700 1 -- 172.21.15.146:0/3463162374 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c009d70 con 0x7f28580664c0 2021-01-27T09:53:27.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.714+0000 7f285759e700 1 -- 172.21.15.146:0/3463162374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28580664c0 msgr2=0x7f285814e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:27.725 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.714+0000 7f285759e700 1 --2- 172.21.15.146:0/3463162374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28580664c0 0x7f285814e960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f2858061a00 tx=0x7f284c006ee0).stop 2021-01-27T09:53:27.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.726+0000 7f285759e700 1 -- 172.21.15.146:0/3463162374 shutdown_connections 2021-01-27T09:53:27.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.726+0000 7f285759e700 1 --2- 172.21.15.146:0/3463162374 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2858063200 0x7f28580baa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-27T09:53:27.730 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.726+0000 7f285759e700 1 --2- 172.21.15.146:0/3463162374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28580664c0 0x7f285814e960 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:27.734 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.726+0000 7f285759e700 1 -- 172.21.15.146:0/3463162374 >> 172.21.15.146:0/3463162374 conn(0x7f2858067e60 msgr2=0x7f2858064240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:27.755 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.742+0000 7f285759e700 1 -- 172.21.15.146:0/3463162374 shutdown_connections 2021-01-27T09:53:27.755 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.750+0000 7f285759e700 1 -- 172.21.15.146:0/3463162374 wait complete. 2021-01-27T09:53:27.759 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.754+0000 7f285759e700 1 Processor -- start 2021-01-27T09:53:27.759 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.754+0000 7f285759e700 1 -- start start 2021-01-27T09:53:27.760 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.754+0000 7f285759e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2858062e20 0x7f28580baec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:27.760 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.754+0000 7f285759e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2858063200 0x7f2858141d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:27.760 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.754+0000 7f285759e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28580664c0 0x7f28580b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:27.760 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.754+0000 7f285759e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28580b8b20 con 0x7f2858063200 2021-01-27T09:53:27.761 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.754+0000 7f285759e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285813b970 con 0x7f28580664c0 2021-01-27T09:53:27.761 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.754+0000 7f285759e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285813bbd0 con 0x7f2858062e20 2021-01-27T09:53:27.761 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.754+0000 7f285659c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2858062e20 0x7f28580baec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:27.761 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.754+0000 7f2855d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2858063200 0x7f2858141d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:27.761 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.754+0000 7f2855d9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2858063200 0x7f2858141d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:58456/0 (socket says 172.21.15.146:58456) 2021-01-27T09:53:27.762 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.754+0000 7f285659c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2858062e20 0x7f28580baec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:45070/0 (socket says 172.21.15.146:45070) 2021-01-27T09:53:27.762 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.754+0000 7f2855d9b700 1 -- 172.21.15.146:0/709316026 learned_addr learned my addr 172.21.15.146:0/709316026 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:27.763 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.754+0000 7f2856d9d700 1 --2- 172.21.15.146:0/709316026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28580664c0 0x7f28580b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:27.763 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.754+0000 7f2856d9d700 1 -- 172.21.15.146:0/709316026 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2858062e20 msgr2=0x7f28580baec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:27.763 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.754+0000 7f2856d9d700 1 --2- 172.21.15.146:0/709316026 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2858062e20 0x7f28580baec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:27.763 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.754+0000 7f2856d9d700 1 -- 172.21.15.146:0/709316026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2858063200 msgr2=0x7f2858141d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:27.764 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.754+0000 7f2856d9d700 1 --2- 172.21.15.146:0/709316026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2858063200 0x7f2858141d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:27.764 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.754+0000 7f2856d9d700 1 -- 172.21.15.146:0/709316026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285813be70 con 0x7f28580664c0 2021-01-27T09:53:27.764 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.758+0000 7f2856d9d700 1 --2- 172.21.15.146:0/709316026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28580664c0 0x7f28580b79f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f2858063650 tx=0x7f28500090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:27.765 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.758+0000 7f28467fc700 1 -- 172.21.15.146:0/709316026 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285000c740 con 0x7f28580664c0 2021-01-27T09:53:27.765 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.758+0000 7f285759e700 1 -- 172.21.15.146:0/709316026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285813c110 con 0x7f28580664c0 2021-01-27T09:53:27.765 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.758+0000 7f285759e700 1 -- 172.21.15.146:0/709316026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285813c650 con 0x7f28580664c0 2021-01-27T09:53:27.766 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.758+0000 7f28467fc700 1 -- 172.21.15.146:0/709316026 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285000c8a0 con 0x7f28580664c0 2021-01-27T09:53:27.766 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.762+0000 7f28467fc700 1 -- 172.21.15.146:0/709316026 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285000ca50 con 0x7f28580664c0 2021-01-27T09:53:27.769 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.766+0000 7f28467fc700 1 -- 172.21.15.146:0/709316026 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f285001c070 con 0x7f28580664c0 2021-01-27T09:53:27.771 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.766+0000 7f28467fc700 1 --2- 172.21.15.146:0/709316026 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2834056260 0x7f2834058720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:27.772 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.766+0000 7f28467fc700 1 -- 172.21.15.146:0/709316026 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7f285006ec30 con 0x7f28580664c0 2021-01-27T09:53:27.772 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.766+0000 7f285659c700 1 --2- 172.21.15.146:0/709316026 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2834056260 0x7f2834058720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:27.772 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.766+0000 7f285659c700 1 --2- 172.21.15.146:0/709316026 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2834056260 0x7f2834058720 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f284800b660 tx=0x7f2848008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:27.777 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.770+0000 7f285759e700 1 -- 172.21.15.146:0/709316026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2838004fa0 con 0x7f28580664c0 2021-01-27T09:53:27.783 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:27.778+0000 7f28467fc700 1 -- 172.21.15.146:0/709316026 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f2850044150 con 0x7f28580664c0 2021-01-27T09:53:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.070+0000 7f285759e700 1 -- 172.21.15.146:0/709316026 --> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f2838002a40 con 0x7f2834056260 2021-01-27T09:53:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.078+0000 7f28467fc700 1 -- 172.21.15.146:0/709316026 <== mgr.4104 v2:172.21.15.78:6832/15486 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2838002a40 con 0x7f2834056260 2021-01-27T09:53:28.089 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.082+0000 7f285759e700 1 -- 172.21.15.146:0/709316026 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2834056260 msgr2=0x7f2834058720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:28.089 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.086+0000 7f285759e700 1 --2- 172.21.15.146:0/709316026 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2834056260 0x7f2834058720 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f284800b660 tx=0x7f2848008040).stop 2021-01-27T09:53:28.090 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.086+0000 7f285759e700 1 -- 172.21.15.146:0/709316026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28580664c0 msgr2=0x7f28580b79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:28.090 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.086+0000 7f285759e700 1 --2- 172.21.15.146:0/709316026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28580664c0 0x7f28580b79f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f2858063650 tx=0x7f28500090f0).stop 2021-01-27T09:53:28.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.086+0000 7f285759e700 1 -- 172.21.15.146:0/709316026 shutdown_connections 2021-01-27T09:53:28.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.086+0000 7f285759e700 1 --2- 172.21.15.146:0/709316026 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f2834056260 0x7f2834058720 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:28.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.086+0000 7f285759e700 1 --2- 172.21.15.146:0/709316026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28580664c0 0x7f28580b79f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:28.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.086+0000 7f285759e700 1 --2- 172.21.15.146:0/709316026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2858063200 0x7f2858141d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:28.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.086+0000 7f285759e700 1 --2- 172.21.15.146:0/709316026 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2858062e20 0x7f28580baec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:28.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.086+0000 7f285759e700 1 -- 172.21.15.146:0/709316026 >> 172.21.15.146:0/709316026 conn(0x7f2858067e60 msgr2=0x7f2858064400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:28.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.086+0000 7f285759e700 1 -- 172.21.15.146:0/709316026 shutdown_connections 2021-01-27T09:53:28.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.086+0000 7f285759e700 1 -- 172.21.15.146:0/709316026 wait complete. 2021-01-27T09:53:28.095 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 7 to deep-scrub 2021-01-27T09:53:28.120 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-01-27T09:53:28.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.366+0000 7f6d0dc85700 1 Processor -- start 2021-01-27T09:53:28.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.366+0000 7f6d0dc85700 1 -- start start 2021-01-27T09:53:28.374 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.366+0000 7f6d0dc85700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d08143ea0 0x7f6d08067500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:28.374 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.370+0000 7f6d0dc85700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d08069710 con 0x7f6d08143ac0 2021-01-27T09:53:28.374 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.370+0000 7f6d0dc85700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d080ad280 con 0x7f6d080bf560 2021-01-27T09:53:28.374 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.370+0000 7f6d0dc85700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d08149bf0 con 0x7f6d08143ea0 2021-01-27T09:53:28.374 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.370+0000 7f6d07fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d08143ea0 0x7f6d08067500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:28.375 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.370+0000 7f6d07fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d08143ea0 0x7f6d08067500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:45086/0 (socket says 172.21.15.146:45086) 2021-01-27T09:53:28.375 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.370+0000 7f6d07fff700 1 -- 172.21.15.146:0/3428147374 learned_addr learned my addr 172.21.15.146:0/3428147374 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.370+0000 7f6d07fff700 1 -- 172.21.15.146:0/3428147374 >> v1:172.21.15.146:6789/0 conn(0x7f6d080bf560 legacy=0x7f6d0814a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:53:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.370+0000 7f6d07fff700 1 -- 172.21.15.146:0/3428147374 >> v1:172.21.15.78:6789/0 conn(0x7f6d08143ac0 legacy=0x7f6d08064d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.370+0000 7f6d07fff700 1 -- 172.21.15.146:0/3428147374 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d08069940 con 0x7f6d08143ea0 2021-01-27T09:53:28.377 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.370+0000 7f6d07fff700 1 --2- 172.21.15.146:0/3428147374 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d08143ea0 0x7f6d08067500 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f6cf800ba50 tx=0x7f6cf8006ee0).ready entity=mon.2 client_cookie=a58cc69be455b273 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.370+0000 7f6d077fe700 1 -- 172.21.15.146:0/3428147374 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8009740 con 0x7f6d08143ea0 2021-01-27T09:53:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.370+0000 7f6d077fe700 1 -- 172.21.15.146:0/3428147374 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf80098a0 con 0x7f6d08143ea0 2021-01-27T09:53:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.370+0000 7f6d077fe700 1 -- 172.21.15.146:0/3428147374 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8009c20 con 0x7f6d08143ea0 2021-01-27T09:53:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.370+0000 7f6d0dc85700 1 -- 172.21.15.146:0/3428147374 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d08143ea0 msgr2=0x7f6d08067500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.370+0000 7f6d0dc85700 1 --2- 172.21.15.146:0/3428147374 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d08143ea0 0x7f6d08067500 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f6cf800ba50 tx=0x7f6cf8006ee0).stop 2021-01-27T09:53:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.370+0000 7f6d0dc85700 1 -- 172.21.15.146:0/3428147374 shutdown_connections 2021-01-27T09:53:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.370+0000 7f6d0dc85700 1 --2- 172.21.15.146:0/3428147374 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d08143ea0 0x7f6d08067500 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.370+0000 7f6d0dc85700 1 -- 172.21.15.146:0/3428147374 >> 172.21.15.146:0/3428147374 conn(0x7f6d08060a30 msgr2=0x7f6d08065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.370+0000 7f6d0dc85700 1 -- 172.21.15.146:0/3428147374 shutdown_connections 2021-01-27T09:53:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.374+0000 7f6d0dc85700 1 -- 172.21.15.146:0/3428147374 wait complete. 2021-01-27T09:53:28.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.374+0000 7f6d0dc85700 1 Processor -- start 2021-01-27T09:53:28.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.374+0000 7f6d0dc85700 1 -- start start 2021-01-27T09:53:28.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.374+0000 7f6d0dc85700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d080bf560 0x7f6d08066a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:28.382 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.374+0000 7f6d0dc85700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d08143ac0 0x7f6d08066f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:28.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.374+0000 7f6d0dc85700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d08143ea0 0x7f6d0814b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:28.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.378+0000 7f6d0dc85700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d08144300 con 0x7f6d08143ac0 2021-01-27T09:53:28.383 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.378+0000 7f6d0dc85700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d08132a80 con 0x7f6d080bf560 2021-01-27T09:53:28.384 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.378+0000 7f6d0dc85700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d08132580 con 0x7f6d08143ea0 2021-01-27T09:53:28.384 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.378+0000 7f6d07fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d08143ac0 0x7f6d08066f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:28.384 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.378+0000 7f6d0d484700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d08143ea0 0x7f6d0814b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:28.384 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.378+0000 7f6d07fff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d08143ac0 0x7f6d08066f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:58478/0 (socket says 172.21.15.146:58478) 2021-01-27T09:53:28.384 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.378+0000 7f6d07fff700 1 -- 172.21.15.146:0/3761679526 learned_addr learned my addr 172.21.15.146:0/3761679526 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:28.385 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.378+0000 7f6d0cc83700 1 --2- 172.21.15.146:0/3761679526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d080bf560 0x7f6d08066a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:28.385 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.378+0000 7f6d0d484700 1 -- 172.21.15.146:0/3761679526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d080bf560 msgr2=0x7f6d08066a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:28.386 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.378+0000 7f6d0d484700 1 --2- 172.21.15.146:0/3761679526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d080bf560 0x7f6d08066a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:28.386 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.378+0000 7f6d0d484700 1 -- 172.21.15.146:0/3761679526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d08143ac0 msgr2=0x7f6d08066f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:28.386 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.378+0000 7f6d0d484700 1 --2- 172.21.15.146:0/3761679526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d08143ac0 0x7f6d08066f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:28.386 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.378+0000 7f6d0d484700 1 -- 172.21.15.146:0/3761679526 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d08144530 con 0x7f6d08143ea0 2021-01-27T09:53:28.387 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.378+0000 7f6d0d484700 1 --2- 172.21.15.146:0/3761679526 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d08143ea0 0x7f6d0814b5a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f6d0000cae0 tx=0x7f6d00007df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:28.387 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.378+0000 7f6d04ff9700 1 -- 172.21.15.146:0/3761679526 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0000a7f0 con 0x7f6d08143ea0 2021-01-27T09:53:28.387 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.378+0000 7f6d04ff9700 1 -- 172.21.15.146:0/3761679526 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0000a950 con 0x7f6d08143ea0 2021-01-27T09:53:28.387 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.378+0000 7f6d04ff9700 1 -- 172.21.15.146:0/3761679526 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0000acf0 con 0x7f6d08143ea0 2021-01-27T09:53:28.388 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.378+0000 7f6d0dc85700 1 -- 172.21.15.146:0/3761679526 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d081327e0 con 0x7f6d08143ea0 2021-01-27T09:53:28.388 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.378+0000 7f6d0dc85700 1 -- 172.21.15.146:0/3761679526 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d08154370 con 0x7f6d08143ea0 2021-01-27T09:53:28.389 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.378+0000 7f6d0dc85700 1 -- 172.21.15.146:0/3761679526 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d08069b20 con 0x7f6d08143ea0 2021-01-27T09:53:28.389 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.382+0000 7f6d04ff9700 1 -- 172.21.15.146:0/3761679526 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f6d00019030 con 0x7f6d08143ea0 2021-01-27T09:53:28.389 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.382+0000 7f6d04ff9700 1 --2- 172.21.15.146:0/3761679526 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6ce8056200 0x7f6ce80586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:28.389 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.382+0000 7f6d04ff9700 1 -- 172.21.15.146:0/3761679526 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7f6d0006f0e0 con 0x7f6d08143ea0 2021-01-27T09:53:28.392 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.386+0000 7f6d0cc83700 1 --2- 172.21.15.146:0/3761679526 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6ce8056200 0x7f6ce80586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:28.392 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.386+0000 7f6d0cc83700 1 --2- 172.21.15.146:0/3761679526 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6ce8056200 0x7f6ce80586c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f6d080bdc50 tx=0x7f6cfc009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:28.396 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.390+0000 7f6d04ff9700 1 -- 172.21.15.146:0/3761679526 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f6d00044690 con 0x7f6d08143ea0 2021-01-27T09:53:28.673 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.670+0000 7f6d0dc85700 1 -- 172.21.15.146:0/3761679526 --> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d08044680 con 0x7f6ce8056200 2021-01-27T09:53:28.682 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.678+0000 7f6d04ff9700 1 -- 172.21.15.146:0/3761679526 <== mgr.4104 v2:172.21.15.78:6832/15486 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+125870 (secure 0 0 0) 0x7f6d08044680 con 0x7f6ce8056200 2021-01-27T09:53:28.683 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:53:28.689 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.682+0000 7f6d0dc85700 1 -- 172.21.15.146:0/3761679526 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6ce8056200 msgr2=0x7f6ce80586c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:28.690 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.682+0000 7f6d0dc85700 1 --2- 172.21.15.146:0/3761679526 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6ce8056200 0x7f6ce80586c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f6d080bdc50 tx=0x7f6cfc009040).stop 2021-01-27T09:53:28.690 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.682+0000 7f6d0dc85700 1 -- 172.21.15.146:0/3761679526 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d08143ea0 msgr2=0x7f6d0814b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:28.690 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.682+0000 7f6d0dc85700 1 --2- 172.21.15.146:0/3761679526 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d08143ea0 0x7f6d0814b5a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f6d0000cae0 tx=0x7f6d00007df0).stop 2021-01-27T09:53:28.690 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.682+0000 7f6d0dc85700 1 -- 172.21.15.146:0/3761679526 shutdown_connections 2021-01-27T09:53:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.682+0000 7f6d0dc85700 1 --2- 172.21.15.146:0/3761679526 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d08143ea0 0x7f6d0814b5a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.682+0000 7f6d0dc85700 1 --2- 172.21.15.146:0/3761679526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d08143ac0 0x7f6d08066f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.682+0000 7f6d0dc85700 1 --2- 172.21.15.146:0/3761679526 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f6ce8056200 0x7f6ce80586c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.682+0000 7f6d0dc85700 1 --2- 172.21.15.146:0/3761679526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d080bf560 0x7f6d08066a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.686+0000 7f6d0dc85700 1 -- 172.21.15.146:0/3761679526 >> 172.21.15.146:0/3761679526 conn(0x7f6d08060a30 msgr2=0x7f6d0813d910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:28.694 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.690+0000 7f6d0dc85700 1 -- 172.21.15.146:0/3761679526 shutdown_connections 2021-01-27T09:53:28.694 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:28.690+0000 7f6d0dc85700 1 -- 172.21.15.146:0/3761679526 wait complete. 2021-01-27T09:53:28.699 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2021-01-27T09:53:28.729 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2021-01-27T09:53:28.598803+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7639605806,"num_objects":1994,"num_object_clones":0,"num_object_copies":7826,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1994,"num_whiteouts":0,"num_read":335,"num_read_kb":6083,"num_write":733453,"num_write_kb":17294914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35942,"num_omap_keys":54,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55593,"ondisk_log_size":55593,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":17275148,"kb_used_data":15299276,"kb_used_omap":0,"kb_used_meta":1935104,"kb_avail":737699572,"statfs":{"total":773094113280,"available":755404361728,"internally_reserved":0,"allocated":15666458624,"data_stored":15664933692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1981546496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,5,2,2,8,10,6,3],"upper_bound":1024},"perf_stat":{"commit_latency_ms":470,"apply_latency_ms":470,"commit_latency_ns":470000000,"apply_latency_ns":470000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5729211349,"num_objects":-1364,"num_object_clones":0,"num_object_copies":-5460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1364,"num_whiteouts":0,"num_read":7,"num_read_kb":29,"num_write":1408,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35942,"num_omap_keys":54,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002702"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"19","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.715453+0000","last_change":"2021-01-27T09:44:26.437753+0000","last_active":"2021-01-27T09:49:18.715453+0000","last_peered":"2021-01-27T09:49:18.715453+0000","last_clean":"2021-01-27T09:49:18.715453+0000","last_became_active":"2021-01-27T09:44:26.437402+0000","last_became_peered":"2021-01-27T09:44:26.437402+0000","last_unstale":"2021-01-27T09:49:18.715453+0000","last_undegraded":"2021-01-27T09:49:18.715453+0000","last_fullsized":"2021-01-27T09:49:18.715453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"29'59","reported_seq":"80","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:14.756690+0000","last_change":"2021-01-27T09:44:28.931645+0000","last_active":"2021-01-27T09:53:14.756690+0000","last_peered":"2021-01-27T09:53:14.756690+0000","last_clean":"2021-01-27T09:53:14.756690+0000","last_became_active":"2021-01-27T09:44:28.931347+0000","last_became_peered":"2021-01-27T09:44:28.931347+0000","last_unstale":"2021-01-27T09:53:14.756690+0000","last_undegraded":"2021-01-27T09:53:14.756690+0000","last_fullsized":"2021-01-27T09:53:14.756690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":59,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":13,"num_write":108,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"29'33","reported_seq":"48","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:23.147650+0000","last_change":"2021-01-27T09:44:29.336652+0000","last_active":"2021-01-27T09:53:23.147650+0000","last_peered":"2021-01-27T09:53:23.147650+0000","last_clean":"2021-01-27T09:53:23.147650+0000","last_became_active":"2021-01-27T09:44:29.336207+0000","last_became_peered":"2021-01-27T09:44:29.336207+0000","last_unstale":"2021-01-27T09:53:23.147650+0000","last_undegraded":"2021-01-27T09:53:23.147650+0000","last_fullsized":"2021-01-27T09:53:23.147650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"29'6520","reported_seq":"6552","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:23.853388+0000","last_change":"2021-01-27T09:44:33.381360+0000","last_active":"2021-01-27T09:53:23.853388+0000","last_peered":"2021-01-27T09:53:23.853388+0000","last_clean":"2021-01-27T09:53:23.853388+0000","last_became_active":"2021-01-27T09:44:33.380037+0000","last_became_peered":"2021-01-27T09:44:33.380037+0000","last_unstale":"2021-01-27T09:53:23.853388+0000","last_undegraded":"2021-01-27T09:53:23.853388+0000","last_fullsized":"2021-01-27T09:53:23.853388+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":6520,"ondisk_log_size":6520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":973223922,"num_objects":242,"num_object_clones":0,"num_object_copies":968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":242,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":90168,"num_write_kb":2139720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"20","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.710175+0000","last_change":"2021-01-27T09:44:26.436242+0000","last_active":"2021-01-27T09:49:18.710175+0000","last_peered":"2021-01-27T09:49:18.710175+0000","last_clean":"2021-01-27T09:49:18.710175+0000","last_became_active":"2021-01-27T09:44:26.435467+0000","last_became_peered":"2021-01-27T09:44:26.435467+0000","last_unstale":"2021-01-27T09:49:18.710175+0000","last_undegraded":"2021-01-27T09:49:18.710175+0000","last_fullsized":"2021-01-27T09:49:18.710175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'80","reported_seq":"107","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:14.756812+0000","last_change":"2021-01-27T09:44:28.934250+0000","last_active":"2021-01-27T09:53:14.756812+0000","last_peered":"2021-01-27T09:53:14.756812+0000","last_clean":"2021-01-27T09:53:14.756812+0000","last_became_active":"2021-01-27T09:44:28.933897+0000","last_became_peered":"2021-01-27T09:44:28.933897+0000","last_unstale":"2021-01-27T09:53:14.756812+0000","last_undegraded":"2021-01-27T09:53:14.756812+0000","last_fullsized":"2021-01-27T09:53:14.756812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":80,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":666,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":24,"num_read_kb":26,"num_write":114,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'31","reported_seq":"47","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:18.751206+0000","last_change":"2021-01-27T09:44:29.341412+0000","last_active":"2021-01-27T09:53:18.751206+0000","last_peered":"2021-01-27T09:53:18.751206+0000","last_clean":"2021-01-27T09:53:18.751206+0000","last_became_active":"2021-01-27T09:44:29.341016+0000","last_became_peered":"2021-01-27T09:44:29.341016+0000","last_unstale":"2021-01-27T09:53:18.751206+0000","last_undegraded":"2021-01-27T09:53:18.751206+0000","last_fullsized":"2021-01-27T09:53:18.751206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"29'7286","reported_seq":"7330","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:25.375211+0000","last_change":"2021-01-27T09:44:33.378505+0000","last_active":"2021-01-27T09:53:25.375211+0000","last_peered":"2021-01-27T09:53:25.375211+0000","last_clean":"2021-01-27T09:53:25.375211+0000","last_became_active":"2021-01-27T09:44:33.377285+0000","last_became_peered":"2021-01-27T09:44:33.377285+0000","last_unstale":"2021-01-27T09:53:25.375211+0000","last_undegraded":"2021-01-27T09:53:25.375211+0000","last_fullsized":"2021-01-27T09:53:25.375211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":7286,"ondisk_log_size":7286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1132665489,"num_objects":280,"num_object_clones":0,"num_object_copies":1120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":100670,"num_write_kb":2356202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"19","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.715278+0000","last_change":"2021-01-27T09:44:25.841172+0000","last_active":"2021-01-27T09:49:18.715278+0000","last_peered":"2021-01-27T09:49:18.715278+0000","last_clean":"2021-01-27T09:49:18.715278+0000","last_became_active":"2021-01-27T09:44:25.840711+0000","last_became_peered":"2021-01-27T09:44:25.840711+0000","last_unstale":"2021-01-27T09:49:18.715278+0000","last_undegraded":"2021-01-27T09:49:18.715278+0000","last_fullsized":"2021-01-27T09:49:18.715278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'904","reported_seq":"930","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:14.738584+0000","last_change":"2021-01-27T09:44:28.932871+0000","last_active":"2021-01-27T09:53:14.738584+0000","last_peered":"2021-01-27T09:53:14.738584+0000","last_clean":"2021-01-27T09:53:14.738584+0000","last_became_active":"2021-01-27T09:44:28.932513+0000","last_became_peered":"2021-01-27T09:44:28.932513+0000","last_unstale":"2021-01-27T09:53:14.738584+0000","last_undegraded":"2021-01-27T09:53:14.738584+0000","last_fullsized":"2021-01-27T09:53:14.738584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":904,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4195502,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":17,"num_read_kb":4112,"num_write":905,"num_write_kb":4328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"29'40","reported_seq":"56","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:26.832828+0000","last_change":"2021-01-27T09:44:29.350508+0000","last_active":"2021-01-27T09:53:26.832828+0000","last_peered":"2021-01-27T09:53:26.832828+0000","last_clean":"2021-01-27T09:53:26.832828+0000","last_became_active":"2021-01-27T09:44:29.350179+0000","last_became_peered":"2021-01-27T09:44:29.350179+0000","last_unstale":"2021-01-27T09:53:26.832828+0000","last_undegraded":"2021-01-27T09:53:26.832828+0000","last_fullsized":"2021-01-27T09:53:26.832828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":40,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"29'6755","reported_seq":"6788","reported_epoch":"29","state":"active+clean+scrubbing+deep","last_fresh":"2021-01-27T09:53:27.910561+0000","last_change":"2021-01-27T09:53:22.246418+0000","last_active":"2021-01-27T09:53:27.910561+0000","last_peered":"2021-01-27T09:53:27.910561+0000","last_clean":"2021-01-27T09:53:27.910561+0000","last_became_active":"2021-01-27T09:44:33.439809+0000","last_became_peered":"2021-01-27T09:44:33.439809+0000","last_unstale":"2021-01-27T09:53:27.910561+0000","last_undegraded":"2021-01-27T09:53:27.910561+0000","last_fullsized":"2021-01-27T09:53:27.910561+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":6755,"ondisk_log_size":6755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":843863467,"num_objects":215,"num_object_clones":0,"num_object_copies":860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":92145,"num_write_kb":2198460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"20","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.639026+0000","last_change":"2021-01-27T09:44:26.405089+0000","last_active":"2021-01-27T09:49:18.639026+0000","last_peered":"2021-01-27T09:49:18.639026+0000","last_clean":"2021-01-27T09:49:18.639026+0000","last_became_active":"2021-01-27T09:44:26.403537+0000","last_became_peered":"2021-01-27T09:44:26.403537+0000","last_unstale":"2021-01-27T09:49:18.639026+0000","last_undegraded":"2021-01-27T09:49:18.639026+0000","last_fullsized":"2021-01-27T09:49:18.639026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"29'26","reported_seq":"48","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:14.739429+0000","last_change":"2021-01-27T09:44:28.932480+0000","last_active":"2021-01-27T09:53:14.739429+0000","last_peered":"2021-01-27T09:53:14.739429+0000","last_clean":"2021-01-27T09:53:14.739429+0000","last_became_active":"2021-01-27T09:44:28.932127+0000","last_became_peered":"2021-01-27T09:44:28.932127+0000","last_unstale":"2021-01-27T09:53:14.739429+0000","last_undegraded":"2021-01-27T09:53:14.739429+0000","last_fullsized":"2021-01-27T09:53:14.739429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":736,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":14,"num_read_kb":20,"num_write":22,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"29'34","reported_seq":"50","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:20.429785+0000","last_change":"2021-01-27T09:44:29.338414+0000","last_active":"2021-01-27T09:53:20.429785+0000","last_peered":"2021-01-27T09:53:20.429785+0000","last_clean":"2021-01-27T09:53:20.429785+0000","last_became_active":"2021-01-27T09:44:29.337813+0000","last_became_peered":"2021-01-27T09:44:29.337813+0000","last_unstale":"2021-01-27T09:53:20.429785+0000","last_undegraded":"2021-01-27T09:53:20.429785+0000","last_fullsized":"2021-01-27T09:53:20.429785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"29'6943","reported_seq":"6980","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:23.903967+0000","last_change":"2021-01-27T09:44:33.442248+0000","last_active":"2021-01-27T09:53:23.903967+0000","last_peered":"2021-01-27T09:53:23.903967+0000","last_clean":"2021-01-27T09:53:23.903967+0000","last_became_active":"2021-01-27T09:44:33.440410+0000","last_became_peered":"2021-01-27T09:44:33.440410+0000","last_unstale":"2021-01-27T09:53:23.903967+0000","last_undegraded":"2021-01-27T09:53:23.903967+0000","last_fullsized":"2021-01-27T09:53:23.903967+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":6943,"ondisk_log_size":6943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1166152411,"num_objects":291,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":291,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":95830,"num_write_kb":2240389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"29'6519","reported_seq":"6552","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:26.857001+0000","last_change":"2021-01-27T09:44:33.441395+0000","last_active":"2021-01-27T09:53:26.857001+0000","last_peered":"2021-01-27T09:53:26.857001+0000","last_clean":"2021-01-27T09:53:26.857001+0000","last_became_active":"2021-01-27T09:44:33.440377+0000","last_became_peered":"2021-01-27T09:44:33.440377+0000","last_unstale":"2021-01-27T09:53:26.857001+0000","last_undegraded":"2021-01-27T09:53:26.857001+0000","last_fullsized":"2021-01-27T09:53:26.857001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":6519,"ondisk_log_size":6519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":864495245,"num_objects":219,"num_object_clones":0,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":219,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":89530,"num_write_kb":2125206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"29'771","reported_seq":"801","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:22.138005+0000","last_change":"2021-01-27T09:53:20.555476+0000","last_active":"2021-01-27T09:53:22.138005+0000","last_peered":"2021-01-27T09:53:22.138005+0000","last_clean":"2021-01-27T09:53:22.138005+0000","last_became_active":"2021-01-27T09:44:28.928444+0000","last_became_peered":"2021-01-27T09:44:28.928444+0000","last_unstale":"2021-01-27T09:53:22.138005+0000","last_undegraded":"2021-01-27T09:53:22.138005+0000","last_fullsized":"2021-01-27T09:53:22.138005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'769","last_scrub_stamp":"2021-01-27T09:53:20.555294+0000","last_deep_scrub":"29'769","last_deep_scrub_stamp":"2021-01-27T09:53:20.555294+0000","last_clean_scrub_stamp":"2021-01-27T09:53:20.555294+0000","log_size":771,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2924759,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":16,"num_read_kb":1577,"num_write":755,"num_write_kb":3111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":26088,"num_omap_keys":52,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"19","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.715153+0000","last_change":"2021-01-27T09:44:26.403671+0000","last_active":"2021-01-27T09:49:18.715153+0000","last_peered":"2021-01-27T09:49:18.715153+0000","last_clean":"2021-01-27T09:49:18.715153+0000","last_became_active":"2021-01-27T09:44:26.403137+0000","last_became_peered":"2021-01-27T09:44:26.403137+0000","last_unstale":"2021-01-27T09:49:18.715153+0000","last_undegraded":"2021-01-27T09:49:18.715153+0000","last_fullsized":"2021-01-27T09:49:18.715153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'38","reported_seq":"54","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:22.491459+0000","last_change":"2021-01-27T09:44:29.347824+0000","last_active":"2021-01-27T09:53:22.491459+0000","last_peered":"2021-01-27T09:53:22.491459+0000","last_clean":"2021-01-27T09:53:22.491459+0000","last_became_active":"2021-01-27T09:44:29.347463+0000","last_became_peered":"2021-01-27T09:44:29.347463+0000","last_unstale":"2021-01-27T09:53:22.491459+0000","last_undegraded":"2021-01-27T09:53:22.491459+0000","last_fullsized":"2021-01-27T09:53:22.491459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"29'6504","reported_seq":"6532","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:26.958586+0000","last_change":"2021-01-27T09:44:33.441988+0000","last_active":"2021-01-27T09:53:26.958586+0000","last_peered":"2021-01-27T09:53:26.958586+0000","last_clean":"2021-01-27T09:53:26.958586+0000","last_became_active":"2021-01-27T09:44:33.440172+0000","last_became_peered":"2021-01-27T09:44:33.440172+0000","last_unstale":"2021-01-27T09:53:26.958586+0000","last_undegraded":"2021-01-27T09:53:26.958586+0000","last_fullsized":"2021-01-27T09:53:26.958586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":6504,"ondisk_log_size":6504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":839225748,"num_objects":215,"num_object_clones":0,"num_object_copies":860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":88660,"num_write_kb":2080841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"29'26","reported_seq":"55","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:51:57.711366+0000","last_change":"2021-01-27T09:44:28.930780+0000","last_active":"2021-01-27T09:51:57.711366+0000","last_peered":"2021-01-27T09:51:57.711366+0000","last_clean":"2021-01-27T09:51:57.711366+0000","last_became_active":"2021-01-27T09:44:28.930374+0000","last_became_peered":"2021-01-27T09:44:28.930374+0000","last_unstale":"2021-01-27T09:51:57.711366+0000","last_undegraded":"2021-01-27T09:51:57.711366+0000","last_fullsized":"2021-01-27T09:51:57.711366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":112,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"20","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.692844+0000","last_change":"2021-01-27T09:44:25.838965+0000","last_active":"2021-01-27T09:49:18.692844+0000","last_peered":"2021-01-27T09:49:18.692844+0000","last_clean":"2021-01-27T09:49:18.692844+0000","last_became_active":"2021-01-27T09:44:25.838635+0000","last_became_peered":"2021-01-27T09:44:25.838635+0000","last_unstale":"2021-01-27T09:49:18.692844+0000","last_undegraded":"2021-01-27T09:49:18.692844+0000","last_fullsized":"2021-01-27T09:49:18.692844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'37","reported_seq":"53","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:27.104636+0000","last_change":"2021-01-27T09:44:29.348218+0000","last_active":"2021-01-27T09:53:27.104636+0000","last_peered":"2021-01-27T09:53:27.104636+0000","last_clean":"2021-01-27T09:53:27.104636+0000","last_became_active":"2021-01-27T09:44:29.347905+0000","last_became_peered":"2021-01-27T09:44:29.347905+0000","last_unstale":"2021-01-27T09:53:27.104636+0000","last_undegraded":"2021-01-27T09:53:27.104636+0000","last_fullsized":"2021-01-27T09:53:27.104636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":37,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"29'6417","reported_seq":"6448","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:25.525201+0000","last_change":"2021-01-27T09:44:33.378828+0000","last_active":"2021-01-27T09:53:25.525201+0000","last_peered":"2021-01-27T09:53:25.525201+0000","last_clean":"2021-01-27T09:53:25.525201+0000","last_became_active":"2021-01-27T09:44:33.376984+0000","last_became_peered":"2021-01-27T09:44:33.376984+0000","last_unstale":"2021-01-27T09:53:25.525201+0000","last_undegraded":"2021-01-27T09:53:25.525201+0000","last_fullsized":"2021-01-27T09:53:25.525201+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":6417,"ondisk_log_size":6417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":956464067,"num_objects":241,"num_object_clones":0,"num_object_copies":964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":241,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":88263,"num_write_kb":2116621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'199","reported_seq":"249","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:27.365435+0000","last_change":"2021-01-27T09:53:27.366448+0000","last_active":"2021-01-27T09:53:27.365435+0000","last_peered":"2021-01-27T09:53:27.365435+0000","last_clean":"2021-01-27T09:53:27.365435+0000","last_became_active":"2021-01-27T09:44:28.932701+0000","last_became_peered":"2021-01-27T09:44:28.932701+0000","last_unstale":"2021-01-27T09:53:27.365435+0000","last_undegraded":"2021-01-27T09:53:27.365435+0000","last_fullsized":"2021-01-27T09:53:27.365435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":199,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":598042,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":41,"num_read_kb":295,"num_write":195,"num_write_kb":720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"19","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.714297+0000","last_change":"2021-01-27T09:44:25.737081+0000","last_active":"2021-01-27T09:49:18.714297+0000","last_peered":"2021-01-27T09:49:18.714297+0000","last_clean":"2021-01-27T09:49:18.714297+0000","last_became_active":"2021-01-27T09:44:25.736516+0000","last_became_peered":"2021-01-27T09:44:25.736516+0000","last_unstale":"2021-01-27T09:49:18.714297+0000","last_undegraded":"2021-01-27T09:49:18.714297+0000","last_fullsized":"2021-01-27T09:49:18.714297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'40","reported_seq":"56","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:24.851884+0000","last_change":"2021-01-27T09:44:29.347815+0000","last_active":"2021-01-27T09:53:24.851884+0000","last_peered":"2021-01-27T09:53:24.851884+0000","last_clean":"2021-01-27T09:53:24.851884+0000","last_became_active":"2021-01-27T09:44:29.347415+0000","last_became_peered":"2021-01-27T09:44:29.347415+0000","last_unstale":"2021-01-27T09:53:24.851884+0000","last_undegraded":"2021-01-27T09:53:24.851884+0000","last_fullsized":"2021-01-27T09:53:24.851884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":40,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"29'6253","reported_seq":"6292","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:27.489559+0000","last_change":"2021-01-27T09:44:33.436705+0000","last_active":"2021-01-27T09:53:27.489559+0000","last_peered":"2021-01-27T09:53:27.489559+0000","last_clean":"2021-01-27T09:53:27.489559+0000","last_became_active":"2021-01-27T09:44:33.435975+0000","last_became_peered":"2021-01-27T09:44:33.435975+0000","last_unstale":"2021-01-27T09:53:27.489559+0000","last_undegraded":"2021-01-27T09:53:27.489559+0000","last_fullsized":"2021-01-27T09:53:27.489559+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":6253,"ondisk_log_size":6253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":855789536,"num_objects":216,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":216,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":85992,"num_write_kb":2029152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'43","reported_seq":"63","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:15.463302+0000","last_change":"2021-01-27T09:44:28.930455+0000","last_active":"2021-01-27T09:53:15.463302+0000","last_peered":"2021-01-27T09:53:15.463302+0000","last_clean":"2021-01-27T09:53:15.463302+0000","last_became_active":"2021-01-27T09:44:28.930088+0000","last_became_peered":"2021-01-27T09:44:28.930088+0000","last_unstale":"2021-01-27T09:53:15.463302+0000","last_undegraded":"2021-01-27T09:53:15.463302+0000","last_fullsized":"2021-01-27T09:53:15.463302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":43,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6104,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":12,"num_write":65,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"19","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.722361+0000","last_change":"2021-01-27T09:44:25.736301+0000","last_active":"2021-01-27T09:49:18.722361+0000","last_peered":"2021-01-27T09:49:18.722361+0000","last_clean":"2021-01-27T09:49:18.722361+0000","last_became_active":"2021-01-27T09:44:25.735741+0000","last_became_peered":"2021-01-27T09:44:25.735741+0000","last_unstale":"2021-01-27T09:49:18.722361+0000","last_undegraded":"2021-01-27T09:49:18.722361+0000","last_fullsized":"2021-01-27T09:49:18.722361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'4","reported_seq":"30","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:21.816315+0000","last_change":"2021-01-27T09:53:21.816315+0000","last_active":"2021-01-27T09:53:21.816315+0000","last_peered":"2021-01-27T09:53:21.816315+0000","last_clean":"2021-01-27T09:53:21.816315+0000","last_became_active":"2021-01-27T09:44:24.569755+0000","last_became_peered":"2021-01-27T09:44:24.569755+0000","last_unstale":"2021-01-27T09:53:21.816315+0000","last_undegraded":"2021-01-27T09:53:21.816315+0000","last_fullsized":"2021-01-27T09:53:21.816315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2021-01-27T09:53:21.816187+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2021-01-27T09:53:21.816187+0000","last_clean_scrub_stamp":"2021-01-27T09:53:21.816187+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9854,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'31","reported_seq":"46","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:22.016631+0000","last_change":"2021-01-27T09:44:29.337716+0000","last_active":"2021-01-27T09:53:22.016631+0000","last_peered":"2021-01-27T09:53:22.016631+0000","last_clean":"2021-01-27T09:53:22.016631+0000","last_became_active":"2021-01-27T09:44:29.337355+0000","last_became_peered":"2021-01-27T09:44:29.337355+0000","last_unstale":"2021-01-27T09:53:22.016631+0000","last_undegraded":"2021-01-27T09:53:22.016631+0000","last_fullsized":"2021-01-27T09:53:22.016631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":8,"stat_sum":{"num_bytes":7631879885,"num_objects":1919,"num_object_clones":0,"num_object_copies":7676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1919,"num_whiteouts":0,"num_read":177,"num_read_kb":0,"num_write":731258,"num_write_kb":17286591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15124119552,"data_stored":15124119552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53197,"ondisk_log_size":53197,"up":32,"acting":32,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":284,"ondisk_log_size":284,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":7725921,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":158,"num_read_kb":6083,"num_write":2193,"num_write_kb":8313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":26088,"num_omap_keys":52,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15605760,"data_stored":15451842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2108,"ondisk_log_size":2108,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9854,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509550,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2815572,"kb_used_data":2515916,"kb_used_omap":0,"kb_used_meta":293504,"kb_avail":91556268,"statfs":{"total":96636764160,"available":93753618432,"internally_reserved":0,"allocated":2576297984,"data_stored":2576125366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":300548096},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,0,1,0,1,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":112,"apply_latency_ms":112,"commit_latency_ns":112000000,"apply_latency_ns":112000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:52:35 2021","interfaces":[{"interface":"back","average":{"1min":84.682000000000002,"5min":472.56400000000002,"15min":163.239},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":629.97500000000002,"5min":2294.9899999999998,"15min":2294.9899999999998},"last":0.97999999999999998},{"interface":"front","average":{"1min":327.49400000000003,"5min":291.476,"15min":106.328},"min":{"1min":0.96899999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1240.673,"5min":1539.433,"15min":1539.433},"last":1.835}]},{"osd":1,"last update":"Wed Jan 27 09:52:35 2021","interfaces":[{"interface":"back","average":{"1min":10.132,"5min":73.468999999999994,"15min":25.878},"min":{"1min":0.624,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":56.219000000000001,"5min":1524.269,"15min":1524.269},"last":15.039999999999999},{"interface":"front","average":{"1min":55.095999999999997,"5min":216.88800000000001,"15min":74.480000000000004},"min":{"1min":0.70999999999999996,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":339.52100000000002,"5min":2197.2339999999999,"15min":2197.2339999999999},"last":19.356999999999999}]},{"osd":2,"last update":"Wed Jan 27 09:52:35 2021","interfaces":[{"interface":"back","average":{"1min":54.962000000000003,"5min":212.346,"15min":72.885999999999996},"min":{"1min":0.95499999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":339.596,"5min":2294.8020000000001,"15min":2294.8020000000001},"last":1.3},{"interface":"front","average":{"1min":10.414999999999999,"5min":76.203000000000003,"15min":27.359000000000002},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":63.506,"5min":1524.4739999999999,"15min":1524.4739999999999},"last":14.302}]},{"osd":4,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":334.327,"5min":243.10900000000001,"15min":92.652000000000001},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1240.47,"5min":1386.115,"15min":1386.115},"last":1.7010000000000001},{"interface":"front","average":{"1min":7.7119999999999997,"5min":125.717,"15min":44.113},"min":{"1min":1.0660000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":63.652999999999999,"5min":1524.7470000000001,"15min":1524.7470000000001},"last":14.499000000000001}]},{"osd":5,"last update":"Wed Jan 27 09:52:35 2021","interfaces":[{"interface":"back","average":{"1min":10.07,"5min":75.977000000000004,"15min":27.399999999999999},"min":{"1min":1.028,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":63.901000000000003,"5min":1524.604,"15min":1524.604},"last":14.641},{"interface":"front","average":{"1min":54.366999999999997,"5min":217.42699999999999,"15min":75.064999999999998},"min":{"1min":1.0740000000000001,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":339.96199999999999,"5min":2097.0590000000002,"15min":2097.0590000000002},"last":1.8779999999999999}]},{"osd":6,"last update":"Wed Jan 27 09:52:35 2021","interfaces":[{"interface":"back","average":{"1min":54.706000000000003,"5min":235.654,"15min":81.311999999999998},"min":{"1min":1.1930000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":340.03399999999999,"5min":2114.0410000000002,"15min":2114.0410000000002},"last":1.673},{"interface":"front","average":{"1min":299.02999999999997,"5min":197.31899999999999,"15min":77.299999999999997},"min":{"1min":1.075,"5min":1.0549999999999999,"15min":1.0549999999999999},"max":{"1min":1240.5540000000001,"5min":1317.1679999999999,"15min":1317.1679999999999},"last":1.9950000000000001}]},{"osd":7,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":7.4909999999999997,"5min":190.19900000000001,"15min":74.959000000000003},"min":{"1min":1.2410000000000001,"5min":1.198,"15min":1.198},"max":{"1min":63.780000000000001,"5min":1801.5260000000001,"15min":1801.5260000000001},"last":14.776999999999999},{"interface":"front","average":{"1min":7.8650000000000002,"5min":149.43000000000001,"15min":52.268999999999998},"min":{"1min":1.4750000000000001,"5min":1.427,"15min":1.427},"max":{"1min":64.024000000000001,"5min":1682.9359999999999,"15min":1682.9359999999999},"last":14.906000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509551,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1749656,"kb_used_data":1562960,"kb_used_omap":0,"kb_used_meta":186688,"kb_avail":92622184,"statfs":{"total":96636764160,"available":94845116416,"internally_reserved":0,"allocated":1600471040,"data_stored":1600255565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":191168512},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,0,4,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":25.510999999999999,"5min":121.765,"15min":41.948},"min":{"1min":0.63,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":502.11900000000003,"5min":1480.2760000000001,"15min":1480.2760000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":64.305999999999997,"5min":134.34800000000001,"15min":51.317},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":900.13300000000004,"5min":1730.1669999999999,"15min":1730.1669999999999},"last":7.3470000000000004}]},{"osd":1,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":2.8490000000000002,"5min":3.5899999999999999,"15min":3.0990000000000002},"min":{"1min":0.70999999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":15.544,"5min":29.736999999999998,"15min":29.736999999999998},"last":7.0629999999999997},{"interface":"front","average":{"1min":3.0739999999999998,"5min":3.7989999999999999,"15min":2.891},"min":{"1min":0.79600000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":15.452999999999999,"5min":44.777999999999999,"15min":44.777999999999999},"last":7.4720000000000004}]},{"osd":3,"last update":"Wed Jan 27 09:52:42 2021","interfaces":[{"interface":"back","average":{"1min":56.670000000000002,"5min":138.53700000000001,"15min":58.232999999999997},"min":{"1min":0.81699999999999995,"5min":0.753,"15min":0.753},"max":{"1min":503.72199999999998,"5min":1800.183,"15min":1800.183},"last":4.306},{"interface":"front","average":{"1min":186.88900000000001,"5min":217.07400000000001,"15min":79.460999999999999},"min":{"1min":0.93700000000000006,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":717.49800000000005,"5min":3309.5619999999999,"15min":3309.5619999999999},"last":4.4500000000000002}]},{"osd":4,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":1.9239999999999999,"5min":16.788,"15min":7.8230000000000004},"min":{"1min":1.0109999999999999,"5min":0.98099999999999998,"15min":0.88400000000000001},"max":{"1min":4.2859999999999996,"5min":291.916,"15min":291.916},"last":1.292},{"interface":"front","average":{"1min":2.2629999999999999,"5min":14.132,"15min":6.6920000000000002},"min":{"1min":1.091,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":5.3959999999999999,"5min":448.73200000000003,"15min":448.73200000000003},"last":4.6849999999999996}]},{"osd":5,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":2.2829999999999999,"5min":2.5110000000000001,"15min":2.7280000000000002},"min":{"1min":1.1679999999999999,"5min":0.94299999999999995,"15min":0.84299999999999997},"max":{"1min":4.9800000000000004,"5min":17.311,"15min":17.311},"last":4.8479999999999999},{"interface":"front","average":{"1min":1.8049999999999999,"5min":2.6850000000000001,"15min":3.2589999999999999},"min":{"1min":1.016,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":3.3639999999999999,"5min":16.814,"15min":19.155999999999999},"last":1.264}]},{"osd":6,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":2.2959999999999998,"5min":2.6640000000000001,"15min":3.262},"min":{"1min":1.0649999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":5.1340000000000003,"5min":15.388999999999999,"15min":43.197000000000003},"last":7.2160000000000002},{"interface":"front","average":{"1min":1.99,"5min":3.1120000000000001,"15min":3.0129999999999999},"min":{"1min":1.1839999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":3.6349999999999998,"5min":38.168999999999997,"15min":38.168999999999997},"last":1.3979999999999999}]},{"osd":7,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":2.8010000000000002,"5min":98.846000000000004,"15min":35.628},"min":{"1min":1.7390000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"max":{"1min":8.3960000000000008,"5min":1464.1279999999999,"15min":1464.1279999999999},"last":7.0860000000000003},{"interface":"front","average":{"1min":2.0880000000000001,"5min":89.135000000000005,"15min":32.567999999999998},"min":{"1min":1.1779999999999999,"5min":1.1659999999999999,"15min":1.123},"max":{"1min":4.7030000000000003,"5min":1081.211,"15min":1081.211},"last":1.526}]}]},{"osd":1,"up_from":15,"seq":64424509551,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2135048,"kb_used_data":1903552,"kb_used_omap":0,"kb_used_meta":231488,"kb_avail":92236792,"statfs":{"total":96636764160,"available":94450475008,"internally_reserved":0,"allocated":1949237248,"data_stored":1949064630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237043712},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":3.4100000000000001,"5min":164.898,"15min":66.231999999999999},"min":{"1min":0.623,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":11.911,"5min":1471.8320000000001,"15min":1471.8320000000001},"last":1.087},{"interface":"front","average":{"1min":3.2519999999999998,"5min":167.161,"15min":66.174999999999997},"min":{"1min":0.91900000000000004,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":13.644,"5min":1292.7439999999999,"15min":1292.7439999999999},"last":2.669}]},{"osd":2,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":3.3149999999999999,"5min":7.3220000000000001,"15min":3.7250000000000001},"min":{"1min":0.68200000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":38.75,"5min":270.13200000000001,"15min":270.13200000000001},"last":2.2690000000000001},{"interface":"front","average":{"1min":4.0650000000000004,"5min":8.2029999999999994,"15min":4.5860000000000003},"min":{"1min":0.74299999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":38.798999999999999,"5min":275.97399999999999,"15min":275.97399999999999},"last":2.1920000000000002}]},{"osd":3,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":54.905999999999999,"5min":202.47999999999999,"15min":76.338999999999999},"min":{"1min":1.006,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":836.53599999999994,"5min":1387.9079999999999,"15min":1387.9079999999999},"last":4.0609999999999999},{"interface":"front","average":{"1min":125.508,"5min":142.643,"15min":60.207000000000001},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79000000000000004},"max":{"1min":958.32299999999998,"5min":1852.193,"15min":1852.193},"last":4.0999999999999996}]},{"osd":4,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":2.0129999999999999,"5min":33.369999999999997,"15min":12.941000000000001},"min":{"1min":0.98299999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":7.9109999999999996,"5min":1089.0440000000001,"15min":1089.0440000000001},"last":1.857},{"interface":"front","average":{"1min":2.3839999999999999,"5min":15.292,"15min":7.5679999999999996},"min":{"1min":1.145,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":7.181,"5min":656.05499999999995,"15min":656.05499999999995},"last":2.335}]},{"osd":5,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":2.8399999999999999,"5min":3.71,"15min":3.2530000000000001},"min":{"1min":0.95999999999999996,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":9.75,"5min":33.588000000000001,"15min":33.588000000000001},"last":1.9530000000000001},{"interface":"front","average":{"1min":2.5,"5min":3.464,"15min":3.266},"min":{"1min":1.04,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":13.391999999999999,"5min":25.948,"15min":25.948},"last":1.988}]},{"osd":6,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":3.0830000000000002,"5min":3.8730000000000002,"15min":3.4049999999999998},"min":{"1min":1.127,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":9.8889999999999993,"5min":33.341999999999999,"15min":33.341999999999999},"last":2.0790000000000002},{"interface":"front","average":{"1min":2.609,"5min":3.5230000000000001,"15min":3.3969999999999998},"min":{"1min":1.2909999999999999,"5min":1.05,"15min":1.05},"max":{"1min":13.547000000000001,"5min":26.204999999999998,"15min":26.204999999999998},"last":2.1190000000000002}]},{"osd":7,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":3.4119999999999999,"5min":68.495999999999995,"15min":25.510000000000002},"min":{"1min":1.55,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":7.5910000000000002,"5min":1194.567,"15min":1194.567},"last":2.4569999999999999},{"interface":"front","average":{"1min":3.0379999999999998,"5min":89.438999999999993,"15min":32.081000000000003},"min":{"1min":1.306,"5min":1.1499999999999999,"15min":1.1279999999999999},"max":{"1min":10.010999999999999,"5min":1655.51,"15min":1655.51},"last":2.2189999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509551,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2565676,"kb_used_data":2236452,"kb_used_omap":0,"kb_used_meta":298752,"kb_avail":91806164,"statfs":{"total":96636764160,"available":94009511936,"internally_reserved":0,"allocated":2290126848,"data_stored":2289941371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":305922048},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,0,0,1,4,5,2],"upper_bound":1024},"perf_stat":{"commit_latency_ms":152,"apply_latency_ms":152,"commit_latency_ns":152000000,"apply_latency_ns":152000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 27 09:52:40 2021","interfaces":[{"interface":"back","average":{"1min":22.449999999999999,"5min":141.71299999999999,"15min":48.68},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":277.43200000000002,"5min":1128.261,"15min":1128.261},"last":3.4990000000000001},{"interface":"front","average":{"1min":34.140999999999998,"5min":179.88200000000001,"15min":64.679000000000002},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":401.923,"5min":2237.944,"15min":2237.944},"last":4.7149999999999999}]},{"osd":2,"last update":"Wed Jan 27 09:52:42 2021","interfaces":[{"interface":"back","average":{"1min":61.780999999999999,"5min":147.833,"15min":57.649999999999999},"min":{"1min":0.68100000000000005,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1004.691,"5min":1821.519,"15min":1821.519},"last":26.844000000000001},{"interface":"front","average":{"1min":19.707000000000001,"5min":205.67400000000001,"15min":70.120000000000005},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":278.09699999999998,"5min":2749.7919999999999,"15min":2749.7919999999999},"last":4.5800000000000001}]},{"osd":3,"last update":"Wed Jan 27 09:52:42 2021","interfaces":[{"interface":"back","average":{"1min":4.2190000000000003,"5min":193.13800000000001,"15min":70.350999999999999},"min":{"1min":0.68999999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":16.309000000000001,"5min":2240.3739999999998,"15min":2240.3739999999998},"last":4.1319999999999997},{"interface":"front","average":{"1min":4.6029999999999998,"5min":283.86399999999998,"15min":97.561000000000007},"min":{"1min":0.996,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":16.579000000000001,"5min":2588.5129999999999,"15min":2588.5129999999999},"last":4.2729999999999997}]},{"osd":4,"last update":"Wed Jan 27 09:52:42 2021","interfaces":[{"interface":"back","average":{"1min":19.523,"5min":161.06800000000001,"15min":56.033999999999999},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":277.84100000000001,"5min":1128.5070000000001,"15min":1128.5070000000001},"last":4.2009999999999996},{"interface":"front","average":{"1min":61.542000000000002,"5min":245.435,"15min":90.498999999999995},"min":{"1min":1.173,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":1004.8440000000001,"5min":2756.1100000000001,"15min":2756.1100000000001},"last":3.1160000000000001}]},{"osd":5,"last update":"Wed Jan 27 09:52:40 2021","interfaces":[{"interface":"back","average":{"1min":20.544,"5min":147.84899999999999,"15min":51.374000000000002},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":277.721,"5min":1821.7380000000001,"15min":1821.7380000000001},"last":3.593},{"interface":"front","average":{"1min":31.109999999999999,"5min":202.053,"15min":76.144000000000005},"min":{"1min":1.2150000000000001,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":402.07600000000002,"5min":2219.1909999999998,"15min":2219.1909999999998},"last":3.3639999999999999}]},{"osd":6,"last update":"Wed Jan 27 09:52:40 2021","interfaces":[{"interface":"back","average":{"1min":33.002000000000002,"5min":142.47399999999999,"15min":56.292000000000002},"min":{"1min":1.4530000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"max":{"1min":402.32999999999998,"5min":2189.3180000000002,"15min":2189.3180000000002},"last":3.2029999999999998},{"interface":"front","average":{"1min":33.424999999999997,"5min":186.369,"15min":71.284999999999997},"min":{"1min":1.46,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":402.20699999999999,"5min":2219.4609999999998,"15min":2219.4609999999998},"last":3.9870000000000001}]},{"osd":7,"last update":"Wed Jan 27 09:52:42 2021","interfaces":[{"interface":"back","average":{"1min":65.573999999999998,"5min":231.77199999999999,"15min":79.620999999999995},"min":{"1min":1.169,"5min":1.121,"15min":1.121},"max":{"1min":1004.977,"5min":2750.0140000000001,"15min":2750.0140000000001},"last":4.4139999999999997},{"interface":"front","average":{"1min":20.710000000000001,"5min":268.13099999999997,"15min":98.379999999999995},"min":{"1min":1.2430000000000001,"5min":1.228,"15min":1.228},"max":{"1min":277.96300000000002,"5min":3266.1680000000001,"15min":3266.1680000000001},"last":4.3419999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542254,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3626196,"kb_used_data":3210828,"kb_used_omap":0,"kb_used_meta":415360,"kb_avail":90745644,"statfs":{"total":96636764160,"available":92923539456,"internally_reserved":0,"allocated":3287887872,"data_stored":3287710484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":425328640},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,0,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:52:39 2021","interfaces":[{"interface":"back","average":{"1min":38.479999999999997,"5min":179.702,"15min":64.173000000000002},"min":{"1min":0.65000000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":600.43600000000004,"5min":1326.3920000000001,"15min":1326.3920000000001},"last":7.5359999999999996},{"interface":"front","average":{"1min":99.135000000000005,"5min":200.47499999999999,"15min":75.792000000000002},"min":{"1min":0.61899999999999999,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":768.01300000000003,"5min":1520.595,"15min":1520.595},"last":8.7089999999999996}]},{"osd":1,"last update":"Wed Jan 27 09:52:39 2021","interfaces":[{"interface":"back","average":{"1min":1.651,"5min":37.046999999999997,"15min":14.029999999999999},"min":{"1min":0.73299999999999998,"5min":0.624,"15min":0.624},"max":{"1min":4.8559999999999999,"5min":865.298,"15min":865.298},"last":2.3980000000000001},{"interface":"front","average":{"1min":2.1579999999999999,"5min":93.390000000000001,"15min":34.822000000000003},"min":{"1min":0.77500000000000002,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":7.4619999999999997,"5min":1996.8119999999999,"15min":1996.8119999999999},"last":2.3650000000000002}]},{"osd":2,"last update":"Wed Jan 27 09:52:44 2021","interfaces":[{"interface":"back","average":{"1min":1.742,"5min":77.522999999999996,"15min":28.794},"min":{"1min":0.93300000000000005,"5min":0.78300000000000003,"15min":0.71999999999999997},"max":{"1min":4.8799999999999999,"5min":1996.9359999999999,"15min":1996.9359999999999},"last":2.524},{"interface":"front","average":{"1min":2.085,"5min":73.248999999999995,"15min":26.899999999999999},"min":{"1min":0.94899999999999995,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":5.0030000000000001,"5min":1326.518,"15min":1326.518},"last":6.4320000000000004}]},{"osd":3,"last update":"Wed Jan 27 09:52:44 2021","interfaces":[{"interface":"back","average":{"1min":114.492,"5min":186.37100000000001,"15min":88.866},"min":{"1min":1.242,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":631.77300000000002,"5min":1632.471,"15min":1632.471},"last":2.625},{"interface":"front","average":{"1min":39.581000000000003,"5min":340.55700000000002,"15min":125.664},"min":{"1min":1.2430000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":476.57600000000002,"5min":3452.1500000000001,"15min":3452.1500000000001},"last":2.9740000000000002}]},{"osd":4,"last update":"Wed Jan 27 09:52:44 2021","interfaces":[{"interface":"back","average":{"1min":1.9159999999999999,"5min":125.336,"15min":45.834000000000003},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.9649999999999999,"5min":2007.1610000000001,"15min":2007.1610000000001},"last":4.7830000000000004},{"interface":"front","average":{"1min":1.927,"5min":91.346999999999994,"15min":33.601999999999997},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":4.0490000000000004,"5min":1344.953,"15min":1344.953},"last":3.1110000000000002}]},{"osd":5,"last update":"Wed Jan 27 09:52:44 2021","interfaces":[{"interface":"back","average":{"1min":2.2080000000000002,"5min":71.998999999999995,"15min":26.306000000000001},"min":{"1min":1.012,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":4.8570000000000002,"5min":1326.6369999999999,"15min":1326.6369999999999},"last":3.6850000000000001},{"interface":"front","average":{"1min":2.363,"5min":77.890000000000001,"15min":28.004999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":4.7210000000000001,"5min":1998.104,"15min":1998.104},"last":3.2400000000000002}]},{"osd":6,"last update":"Wed Jan 27 09:52:39 2021","interfaces":[{"interface":"back","average":{"1min":2.097,"5min":73.609999999999999,"15min":27.739999999999998},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":3.9300000000000002,"5min":1997.972,"15min":1997.972},"last":8.6029999999999998},{"interface":"front","average":{"1min":2.2469999999999999,"5min":33.520000000000003,"15min":13.202},"min":{"1min":1.1779999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":3.718,"5min":627.93899999999996,"15min":627.93899999999996},"last":4.6390000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542255,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1487380,"kb_used_data":1287372,"kb_used_omap":0,"kb_used_meta":195904,"kb_avail":92884460,"statfs":{"total":96636764160,"available":95113687040,"internally_reserved":0,"allocated":1318268928,"data_stored":1318045688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":200605696},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:52:32 2021","interfaces":[{"interface":"back","average":{"1min":157.42599999999999,"5min":168.34399999999999,"15min":59.067},"min":{"1min":0.67700000000000005,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1853.4939999999999,"5min":2062.3220000000001,"15min":2062.3220000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":61.987000000000002,"5min":74.463999999999999,"15min":26.213999999999999},"min":{"1min":0.629,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":599.41499999999996,"5min":735.14300000000003,"15min":735.14300000000003},"last":0.88500000000000001}]},{"osd":1,"last update":"Wed Jan 27 09:52:36 2021","interfaces":[{"interface":"back","average":{"1min":1.9279999999999999,"5min":5.0750000000000002,"15min":3.1749999999999998},"min":{"1min":0.70099999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":7.2759999999999998,"5min":202.423,"15min":202.423},"last":1.1699999999999999},{"interface":"front","average":{"1min":3.452,"5min":5.3419999999999996,"15min":3.4100000000000001},"min":{"1min":0.85399999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":17.707999999999998,"5min":188.43000000000001,"15min":188.43000000000001},"last":1.411}]},{"osd":2,"last update":"Wed Jan 27 09:52:32 2021","interfaces":[{"interface":"back","average":{"1min":4.6459999999999999,"5min":5.1600000000000001,"15min":3.3929999999999998},"min":{"1min":0.999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":53.814999999999998,"5min":182.20699999999999,"15min":182.20699999999999},"last":1.3100000000000001},{"interface":"front","average":{"1min":4,"5min":4.4880000000000004,"15min":3.1070000000000002},"min":{"1min":0.86499999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":54.156999999999996,"5min":150.04900000000001,"15min":150.04900000000001},"last":1.202}]},{"osd":3,"last update":"Wed Jan 27 09:52:32 2021","interfaces":[{"interface":"back","average":{"1min":79.433999999999997,"5min":93.548000000000002,"15min":42.853000000000002},"min":{"1min":1.0780000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":773.70600000000002,"5min":1796.723,"15min":1796.723},"last":1.3700000000000001},{"interface":"front","average":{"1min":107.178,"5min":126.97799999999999,"15min":44.210000000000001},"min":{"1min":0.93500000000000005,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":458.67899999999997,"5min":1821.835,"15min":1821.835},"last":1.452}]},{"osd":4,"last update":"Wed Jan 27 09:52:32 2021","interfaces":[{"interface":"back","average":{"1min":1.9510000000000001,"5min":23.593,"15min":9.5060000000000002},"min":{"1min":1.2050000000000001,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":3.6240000000000001,"5min":560.41999999999996,"15min":560.41999999999996},"last":1.1299999999999999},{"interface":"front","average":{"1min":2.1749999999999998,"5min":24.751000000000001,"15min":10.162000000000001},"min":{"1min":1.4610000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":3.9159999999999999,"5min":513.15200000000004,"15min":513.15200000000004},"last":1.27}]},{"osd":5,"last update":"Wed Jan 27 09:52:32 2021","interfaces":[{"interface":"back","average":{"1min":2.4729999999999999,"5min":1.9319999999999999,"15min":2.617},"min":{"1min":1.226,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":5.5910000000000002,"5min":5.5910000000000002,"15min":5.5910000000000002},"last":2.1859999999999999},{"interface":"front","average":{"1min":2.3690000000000002,"5min":2.0499999999999998,"15min":2.7770000000000001},"min":{"1min":1.47,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":4.3200000000000003,"5min":6.194,"15min":6.194},"last":2.2559999999999998}]},{"osd":7,"last update":"Wed Jan 27 09:52:40 2021","interfaces":[{"interface":"back","average":{"1min":1.9750000000000001,"5min":20.114999999999998,"15min":8.9580000000000002},"min":{"1min":1.008,"5min":0.996,"15min":0.996},"max":{"1min":3.8130000000000002,"5min":507.45499999999998,"15min":507.45499999999998},"last":1.7410000000000001},{"interface":"front","average":{"1min":2.7240000000000002,"5min":98.575999999999993,"15min":35.030000000000001},"min":{"1min":1.2849999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":6.0919999999999996,"5min":2702.8879999999999,"15min":2702.8879999999999},"last":1.589}]}]},{"osd":5,"up_from":14,"seq":60129542255,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":520240,"kb_used_data":447208,"kb_used_omap":0,"kb_used_meta":73024,"kb_avail":93851600,"statfs":{"total":96636764160,"available":96104038400,"internally_reserved":0,"allocated":457940992,"data_stored":457749204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":74776576},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:52:44 2021","interfaces":[{"interface":"back","average":{"1min":51.319000000000003,"5min":115.47,"15min":39.746000000000002},"min":{"1min":0.72299999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":686.48400000000004,"5min":2305.5720000000001,"15min":2305.5720000000001},"last":3.7879999999999998},{"interface":"front","average":{"1min":74.786000000000001,"5min":174.10300000000001,"15min":66.584999999999994},"min":{"1min":0.79600000000000004,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":664.76199999999994,"5min":2556.7280000000001,"15min":2556.7280000000001},"last":2.1219999999999999}]},{"osd":1,"last update":"Wed Jan 27 09:52:39 2021","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":4.1619999999999999,"15min":3.1429999999999998},"min":{"1min":0.82799999999999996,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.7650000000000001,"5min":240.86600000000001,"15min":240.86600000000001},"last":2.121},{"interface":"front","average":{"1min":1.4399999999999999,"5min":4.2880000000000003,"15min":2.9319999999999999},"min":{"1min":0.84599999999999997,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":4.2409999999999997,"5min":247.31299999999999,"15min":247.31299999999999},"last":2.2789999999999999}]},{"osd":2,"last update":"Wed Jan 27 09:52:39 2021","interfaces":[{"interface":"back","average":{"1min":3.7160000000000002,"5min":3.625,"15min":2.9380000000000002},"min":{"1min":0.76100000000000001,"5min":0.749,"15min":0.749},"max":{"1min":33.819000000000003,"5min":125.51000000000001,"15min":125.51000000000001},"last":4.7649999999999997},{"interface":"front","average":{"1min":4.2430000000000003,"5min":3.6699999999999999,"15min":2.9169999999999998},"min":{"1min":0.86599999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":39.350999999999999,"5min":122.705,"15min":122.705},"last":4.2000000000000002}]},{"osd":3,"last update":"Wed Jan 27 09:52:44 2021","interfaces":[{"interface":"back","average":{"1min":48.682000000000002,"5min":183.256,"15min":62.790999999999997},"min":{"1min":1.1100000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":544.40800000000002,"5min":2676.6819999999998,"15min":2676.6819999999998},"last":3.2029999999999998},{"interface":"front","average":{"1min":49.439,"5min":258.351,"15min":94.745000000000005},"min":{"1min":1.603,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":544.46299999999997,"5min":2676.6190000000001,"15min":2676.6190000000001},"last":3.395}]},{"osd":4,"last update":"Wed Jan 27 09:52:39 2021","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":19.733000000000001,"15min":8.3249999999999993},"min":{"1min":0.93300000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":3.2290000000000001,"5min":635.86400000000003,"15min":635.86400000000003},"last":0.92200000000000004},{"interface":"front","average":{"1min":2.0329999999999999,"5min":26.106999999999999,"15min":10.853999999999999},"min":{"1min":1.242,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":3.9740000000000002,"5min":525.19600000000003,"15min":525.19600000000003},"last":1.738}]},{"osd":6,"last update":"Wed Jan 27 09:52:39 2021","interfaces":[{"interface":"back","average":{"1min":1.7529999999999999,"5min":1.9770000000000001,"15min":2.6179999999999999},"min":{"1min":0.92200000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":4.407,"5min":7.5590000000000002,"15min":7.5590000000000002},"last":2.0800000000000001},{"interface":"front","average":{"1min":2.2309999999999999,"5min":2.1230000000000002,"15min":2.7749999999999999},"min":{"1min":1.2470000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":4.3780000000000001,"5min":6.3419999999999996,"15min":6.3419999999999996},"last":1.5980000000000001}]},{"osd":7,"last update":"Wed Jan 27 09:52:39 2021","interfaces":[{"interface":"back","average":{"1min":2.1019999999999999,"5min":60.780999999999999,"15min":22.518000000000001},"min":{"1min":1.1870000000000001,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":3.6699999999999999,"5min":1037.163,"15min":1037.163},"last":1.1120000000000001},{"interface":"front","average":{"1min":2.5150000000000001,"5min":102.337,"15min":36.506},"min":{"1min":1.417,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":7.3419999999999996,"5min":1580.106,"15min":1580.106},"last":1.4510000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542254,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2375380,"kb_used_data":2134988,"kb_used_omap":0,"kb_used_meta":240384,"kb_avail":91996460,"statfs":{"total":96636764160,"available":94204375040,"internally_reserved":0,"allocated":2186227712,"data_stored":2186041384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":246153216},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,0,0,0,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:52:38 2021","interfaces":[{"interface":"back","average":{"1min":132.995,"5min":265.90300000000002,"15min":101.357},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1374.481,"5min":1734.057,"15min":1734.057},"last":0.58399999999999996},{"interface":"front","average":{"1min":79.593000000000004,"5min":135.369,"15min":46.354999999999997},"min":{"1min":0.69399999999999995,"5min":0.67300000000000004,"15min":0.63300000000000001},"max":{"1min":952.15599999999995,"5min":1753.086,"15min":1753.086},"last":0.75800000000000001}]},{"osd":1,"last update":"Wed Jan 27 09:52:38 2021","interfaces":[{"interface":"back","average":{"1min":3.141,"5min":21.094999999999999,"15min":8.3960000000000008},"min":{"1min":0.83599999999999997,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":20.324999999999999,"5min":637.33699999999999,"15min":637.33699999999999},"last":6.1920000000000002},{"interface":"front","average":{"1min":2.8849999999999998,"5min":32.070999999999998,"15min":13.242000000000001},"min":{"1min":0.81100000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":20.195,"5min":517.21100000000001,"15min":517.21100000000001},"last":6.0140000000000002}]},{"osd":2,"last update":"Wed Jan 27 09:52:38 2021","interfaces":[{"interface":"back","average":{"1min":10.528,"5min":29.974,"15min":12.68},"min":{"1min":0.88300000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":182.86199999999999,"5min":517.07500000000005,"15min":517.07500000000005},"last":2.6469999999999998},{"interface":"front","average":{"1min":11.304,"5min":13.021000000000001,"15min":6.0759999999999996},"min":{"1min":0.86299999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":182.66,"5min":375.03399999999999,"15min":375.03399999999999},"last":2.738}]},{"osd":3,"last update":"Wed Jan 27 09:52:38 2021","interfaces":[{"interface":"back","average":{"1min":120.029,"5min":130.02199999999999,"15min":61.021000000000001},"min":{"1min":1.1859999999999999,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":802.05700000000002,"5min":1265.72,"15min":1265.72},"last":1.1919999999999999},{"interface":"front","average":{"1min":18.762,"5min":123.413,"15min":42.933999999999997},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":178.262,"5min":1872.2360000000001,"15min":1872.2360000000001},"last":3.0209999999999999}]},{"osd":5,"last update":"Wed Jan 27 09:52:33 2021","interfaces":[{"interface":"back","average":{"1min":1.9330000000000001,"5min":17.984000000000002,"15min":7.6829999999999998},"min":{"1min":0.89400000000000002,"5min":0.86499999999999999,"15min":0.82999999999999996},"max":{"1min":3.3330000000000002,"5min":692.52700000000004,"15min":692.52700000000004},"last":0.71999999999999997},{"interface":"front","average":{"1min":2.1259999999999999,"5min":30.195,"15min":12.696999999999999},"min":{"1min":1.1160000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":3.3690000000000002,"5min":516.92399999999998,"15min":516.92399999999998},"last":0.83299999999999996}]},{"osd":6,"last update":"Wed Jan 27 09:52:33 2021","interfaces":[{"interface":"back","average":{"1min":2.3399999999999999,"5min":32.018999999999998,"15min":13.260999999999999},"min":{"1min":1.0980000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":5.2279999999999998,"5min":574.76400000000001,"15min":574.76400000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":2.4550000000000001,"5min":12.504,"15min":6.1900000000000004},"min":{"1min":1.1799999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":6.3230000000000004,"5min":375.23599999999999,"15min":375.23599999999999},"last":1.1479999999999999}]},{"osd":7,"last update":"Wed Jan 27 09:52:33 2021","interfaces":[{"interface":"back","average":{"1min":2.4199999999999999,"5min":53.210000000000001,"15min":19.949000000000002},"min":{"1min":1.2250000000000001,"5min":1.103,"15min":1.103},"max":{"1min":4.0359999999999996,"5min":738.697,"15min":738.697},"last":2.621},{"interface":"front","average":{"1min":4.3730000000000002,"5min":99.399000000000001,"15min":35.256},"min":{"1min":1.387,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":42.088999999999999,"5min":2337.453,"15min":2337.453},"last":5.6429999999999998}]}]}]}} 2021-01-27T09:53:28.736 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2021-01-27T09:44:24.550437+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=24, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.736 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2021-01-27T09:44:27.897533+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=27, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.737 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2021-01-27T09:44:28.901960+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=28, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.737 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2021-01-27T09:44:32.342881+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=32, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.737 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2021-01-27T09:44:24.550437+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=24, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.738 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2021-01-27T09:44:27.897533+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=27, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.738 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2021-01-27T09:44:28.901960+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=28, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.738 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2021-01-27T09:44:32.342881+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=32, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.739 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2021-01-27T09:44:24.550437+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=24, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.739 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2021-01-27T09:44:27.897533+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=27, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.739 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2021-01-27T09:44:28.901960+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=28, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.740 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2021-01-27T09:44:32.342881+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=32, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.740 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2021-01-27T09:44:24.550437+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=24, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.740 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2021-01-27T09:44:27.897533+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=27, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.741 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2021-01-27T09:44:28.901960+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=28, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.741 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2021-01-27T09:44:32.342881+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=32, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.741 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2021-01-27T09:44:32.342881+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=32, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.742 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2021-01-27T09:44:24.550437+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=24, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.742 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2021-01-27T09:44:28.901960+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=28, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.743 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2021-01-27T09:44:32.342881+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=32, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.743 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2021-01-27T09:44:27.897533+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=27, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.744 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2021-01-27T09:44:24.550437+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=24, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.744 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2021-01-27T09:44:28.901960+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=28, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.744 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2021-01-27T09:44:32.342881+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=32, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.745 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2021-01-27T09:44:27.897533+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=27, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.745 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2021-01-27T09:44:24.550437+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=24, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.746 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2021-01-27T09:44:28.901960+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=28, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.746 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2021-01-27T09:44:32.342881+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=32, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.747 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2021-01-27T09:44:27.897533+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=27, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.747 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2021-01-27T09:44:24.550437+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=24, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.748 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2021-01-27T09:44:28.901960+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=28, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:28.749 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2021-01-27T09:53:48.750 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-01-27T09:53:48.920 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.914+0000 7f46c759e700 1 Processor -- start 2021-01-27T09:53:48.920 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.914+0000 7f46c759e700 1 -- start start 2021-01-27T09:53:48.921 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.918+0000 7f46c759e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f46c80b89e0 0x7f46c80baab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:48.922 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.918+0000 7f46c759e700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f46c80bf050 0x7f46c8067500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:48.922 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.918+0000 7f46c759e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c80ba8c0 con 0x7f46c80bec70 2021-01-27T09:53:48.922 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.918+0000 7f46c759e700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c80685c0 con 0x7f46c80bf050 2021-01-27T09:53:48.923 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.918+0000 7f46c759e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c8067b20 con 0x7f46c80b89e0 2021-01-27T09:53:48.925 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.918+0000 7f46c5d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f46c80b89e0 0x7f46c80baab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:48.925 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.918+0000 7f46c5d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f46c80b89e0 0x7f46c80baab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55702/0 (socket says 172.21.15.146:55702) 2021-01-27T09:53:48.925 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.918+0000 7f46c5d9b700 1 -- 172.21.15.146:0/2411423386 learned_addr learned my addr 172.21.15.146:0/2411423386 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:48.927 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.918+0000 7f46c6d9d700 1 --2- 172.21.15.146:0/2411423386 >> v2:172.21.15.78:3300/0 conn(0x7f46c80bf050 0x7f46c8067500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:48.927 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.918+0000 7f46c5d9b700 1 -- 172.21.15.146:0/2411423386 >> v2:172.21.15.78:3300/0 conn(0x7f46c80bf050 msgr2=0x7f46c8067500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:53:48.928 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.918+0000 7f46c5d9b700 1 --2- 172.21.15.146:0/2411423386 >> v2:172.21.15.78:3300/0 conn(0x7f46c80bf050 0x7f46c8067500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:48.928 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.918+0000 7f46c5d9b700 1 -- 172.21.15.146:0/2411423386 >> v1:172.21.15.146:6789/0 conn(0x7f46c80bec70 legacy=0x7f46c8151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:48.928 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.918+0000 7f46c5d9b700 1 -- 172.21.15.146:0/2411423386 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c80ba0e0 con 0x7f46c80b89e0 2021-01-27T09:53:48.928 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.918+0000 7f46c5d9b700 1 --2- 172.21.15.146:0/2411423386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46c80b89e0 0x7f46c80baab0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f46c8066830 tx=0x7f46bc006ee0).ready entity=mon.1 client_cookie=cdb6ab39f06f9044 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:48.929 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.918+0000 7f46c559a700 1 -- 172.21.15.146:0/2411423386 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc0097e0 con 0x7f46c80b89e0 2021-01-27T09:53:48.929 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.918+0000 7f46c559a700 1 -- 172.21.15.146:0/2411423386 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc009940 con 0x7f46c80b89e0 2021-01-27T09:53:48.929 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.918+0000 7f46c559a700 1 -- 172.21.15.146:0/2411423386 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc009cc0 con 0x7f46c80b89e0 2021-01-27T09:53:48.929 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.918+0000 7f46c759e700 1 -- 172.21.15.146:0/2411423386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46c80b89e0 msgr2=0x7f46c80baab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:48.929 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.918+0000 7f46c759e700 1 --2- 172.21.15.146:0/2411423386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46c80b89e0 0x7f46c80baab0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f46c8066830 tx=0x7f46bc006ee0).stop 2021-01-27T09:53:48.932 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.922+0000 7f46c759e700 1 -- 172.21.15.146:0/2411423386 shutdown_connections 2021-01-27T09:53:48.933 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.922+0000 7f46c759e700 1 --2- 172.21.15.146:0/2411423386 >> v2:172.21.15.78:3300/0 conn(0x7f46c80bf050 0x7f46c8067500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:48.933 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.922+0000 7f46c759e700 1 --2- 172.21.15.146:0/2411423386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46c80b89e0 0x7f46c80baab0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:48.933 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.922+0000 7f46c759e700 1 -- 172.21.15.146:0/2411423386 >> 172.21.15.146:0/2411423386 conn(0x7f46c8064240 msgr2=0x7f46c8064620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:48.933 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.922+0000 7f46c759e700 1 -- 172.21.15.146:0/2411423386 shutdown_connections 2021-01-27T09:53:48.934 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.922+0000 7f46c759e700 1 -- 172.21.15.146:0/2411423386 wait complete. 2021-01-27T09:53:48.934 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.922+0000 7f46c759e700 1 Processor -- start 2021-01-27T09:53:48.934 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.922+0000 7f46c759e700 1 -- start start 2021-01-27T09:53:48.934 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.926+0000 7f46c759e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46c80b89e0 0x7f46c80bb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:48.935 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.926+0000 7f46c759e700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46c80bec70 0x7f46c814d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:48.935 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.926+0000 7f46c759e700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46c80bf050 0x7f46c813f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:48.936 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.926+0000 7f46c759e700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c8148250 con 0x7f46c80bf050 2021-01-27T09:53:48.936 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.926+0000 7f46c759e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c81484f0 con 0x7f46c80b89e0 2021-01-27T09:53:48.937 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.926+0000 7f46c759e700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c815dbc0 con 0x7f46c80bec70 2021-01-27T09:53:48.937 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.926+0000 7f46c659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46c80b89e0 0x7f46c80bb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:48.937 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.926+0000 7f46c5d9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46c80bec70 0x7f46c814d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:48.937 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.926+0000 7f46c6d9d700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46c80bf050 0x7f46c813f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:48.938 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.926+0000 7f46c5d9b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46c80bec70 0x7f46c814d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:45196/0 (socket says 172.21.15.146:45196) 2021-01-27T09:53:48.938 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.926+0000 7f46c5d9b700 1 -- 172.21.15.146:0/3183269571 learned_addr learned my addr 172.21.15.146:0/3183269571 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:53:48.938 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.926+0000 7f46c659c700 1 -- 172.21.15.146:0/3183269571 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46c80bec70 msgr2=0x7f46c814d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:48.938 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.926+0000 7f46c659c700 1 --2- 172.21.15.146:0/3183269571 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46c80bec70 0x7f46c814d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:48.939 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.926+0000 7f46c659c700 1 -- 172.21.15.146:0/3183269571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46c80bf050 msgr2=0x7f46c813f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:48.939 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.926+0000 7f46c659c700 1 --2- 172.21.15.146:0/3183269571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46c80bf050 0x7f46c813f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:48.939 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.926+0000 7f46c659c700 1 -- 172.21.15.146:0/3183269571 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c815de60 con 0x7f46c80b89e0 2021-01-27T09:53:48.939 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.926+0000 7f46c659c700 1 --2- 172.21.15.146:0/3183269571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46c80b89e0 0x7f46c80bb480 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f46b800c710 tx=0x7f46b8007bc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:48.940 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.926+0000 7f46b67fc700 1 -- 172.21.15.146:0/3183269571 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b8007020 con 0x7f46c80b89e0 2021-01-27T09:53:48.940 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.926+0000 7f46b67fc700 1 -- 172.21.15.146:0/3183269571 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b8001e90 con 0x7f46c80b89e0 2021-01-27T09:53:48.940 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.926+0000 7f46b67fc700 1 -- 172.21.15.146:0/3183269571 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b8007390 con 0x7f46c80b89e0 2021-01-27T09:53:48.940 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.926+0000 7f46c759e700 1 -- 172.21.15.146:0/3183269571 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c815e100 con 0x7f46c80b89e0 2021-01-27T09:53:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.926+0000 7f46c759e700 1 -- 172.21.15.146:0/3183269571 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c80bb970 con 0x7f46c80b89e0 2021-01-27T09:53:48.942 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.930+0000 7f46c759e700 1 -- 172.21.15.146:0/3183269571 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c8063d60 con 0x7f46c80b89e0 2021-01-27T09:53:48.942 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.930+0000 7f46b67fc700 1 -- 172.21.15.146:0/3183269571 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f46b8010030 con 0x7f46c80b89e0 2021-01-27T09:53:48.942 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.934+0000 7f46b67fc700 1 --2- 172.21.15.146:0/3183269571 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f46a40561e0 0x7f46a40586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:53:48.942 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.934+0000 7f46b67fc700 1 -- 172.21.15.146:0/3183269571 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7f46b806eaf0 con 0x7f46c80b89e0 2021-01-27T09:53:48.943 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.934+0000 7f46c5d9b700 1 --2- 172.21.15.146:0/3183269571 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f46a40561e0 0x7f46a40586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:53:48.943 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.934+0000 7f46c5d9b700 1 --2- 172.21.15.146:0/3183269571 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f46a40561e0 0x7f46a40586a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f46c8062e50 tx=0x7f46bc016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:53:48.943 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:48.938+0000 7f46b67fc700 1 -- 172.21.15.146:0/3183269571 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f46b80440a0 con 0x7f46c80b89e0 2021-01-27T09:53:49.080 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:49.074+0000 7f46c759e700 1 -- 172.21.15.146:0/3183269571 --> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f46c80bf880 con 0x7f46a40561e0 2021-01-27T09:53:49.097 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:49.090+0000 7f46b67fc700 1 -- 172.21.15.146:0/3183269571 <== mgr.4104 v2:172.21.15.78:6832/15486 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+125382 (secure 0 0 0) 0x7f46c80bf880 con 0x7f46a40561e0 2021-01-27T09:53:49.097 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:53:49.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:49.094+0000 7f46c759e700 1 -- 172.21.15.146:0/3183269571 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f46a40561e0 msgr2=0x7f46a40586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:49.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:49.094+0000 7f46c759e700 1 --2- 172.21.15.146:0/3183269571 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f46a40561e0 0x7f46a40586a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f46c8062e50 tx=0x7f46bc016000).stop 2021-01-27T09:53:49.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:49.094+0000 7f46c759e700 1 -- 172.21.15.146:0/3183269571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46c80b89e0 msgr2=0x7f46c80bb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:53:49.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:49.094+0000 7f46c759e700 1 --2- 172.21.15.146:0/3183269571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46c80b89e0 0x7f46c80bb480 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f46b800c710 tx=0x7f46b8007bc0).stop 2021-01-27T09:53:49.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:49.094+0000 7f46c759e700 1 -- 172.21.15.146:0/3183269571 shutdown_connections 2021-01-27T09:53:49.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:49.094+0000 7f46c759e700 1 --2- 172.21.15.146:0/3183269571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46c80bf050 0x7f46c813f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:49.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:49.094+0000 7f46c759e700 1 --2- 172.21.15.146:0/3183269571 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f46c80bec70 0x7f46c814d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:49.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:49.094+0000 7f46c759e700 1 --2- 172.21.15.146:0/3183269571 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f46a40561e0 0x7f46a40586a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:49.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:49.094+0000 7f46c759e700 1 --2- 172.21.15.146:0/3183269571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46c80b89e0 0x7f46c80bb480 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:53:49.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:49.094+0000 7f46c759e700 1 -- 172.21.15.146:0/3183269571 >> 172.21.15.146:0/3183269571 conn(0x7f46c8064240 msgr2=0x7f46c8060900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:53:49.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:49.094+0000 7f46c759e700 1 -- 172.21.15.146:0/3183269571 shutdown_connections 2021-01-27T09:53:49.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:53:49.094+0000 7f46c759e700 1 -- 172.21.15.146:0/3183269571 wait complete. 2021-01-27T09:53:49.104 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2021-01-27T09:53:49.127 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2021-01-27T09:53:48.603709+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7727571,"num_objects":67,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":335,"num_read_kb":6083,"num_write":735386,"num_write_kb":17294920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":40822,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57719,"ondisk_log_size":57719,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2090464,"kb_used_data":17824,"kb_used_omap":0,"kb_used_meta":2072576,"kb_avail":752884256,"statfs":{"total":773094113280,"available":770953478144,"internally_reserved":0,"allocated":18251776,"data_stored":16726844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2122317824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,3,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":174,"apply_latency_ms":174,"commit_latency_ns":174000000,"apply_latency_ns":174000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3768876417,"num_objects":-1001,"num_object_clones":0,"num_object_copies":-3986,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1001,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1004,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003216"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"19","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.715453+0000","last_change":"2021-01-27T09:44:26.437753+0000","last_active":"2021-01-27T09:49:18.715453+0000","last_peered":"2021-01-27T09:49:18.715453+0000","last_clean":"2021-01-27T09:49:18.715453+0000","last_became_active":"2021-01-27T09:44:26.437402+0000","last_became_peered":"2021-01-27T09:44:26.437402+0000","last_unstale":"2021-01-27T09:49:18.715453+0000","last_undegraded":"2021-01-27T09:49:18.715453+0000","last_fullsized":"2021-01-27T09:49:18.715453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"29'61","reported_seq":"82","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:41.372769+0000","last_change":"2021-01-27T09:44:28.931645+0000","last_active":"2021-01-27T09:53:41.372769+0000","last_peered":"2021-01-27T09:53:41.372769+0000","last_clean":"2021-01-27T09:53:41.372769+0000","last_became_active":"2021-01-27T09:44:28.931347+0000","last_became_peered":"2021-01-27T09:44:28.931347+0000","last_unstale":"2021-01-27T09:53:41.372769+0000","last_undegraded":"2021-01-27T09:53:41.372769+0000","last_fullsized":"2021-01-27T09:53:41.372769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":61,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":13,"num_write":109,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"29'52","reported_seq":"72","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:43.817219+0000","last_change":"2021-01-27T09:53:43.817219+0000","last_active":"2021-01-27T09:53:43.817219+0000","last_peered":"2021-01-27T09:53:43.817219+0000","last_clean":"2021-01-27T09:53:43.817219+0000","last_became_active":"2021-01-27T09:44:29.336207+0000","last_became_peered":"2021-01-27T09:44:29.336207+0000","last_unstale":"2021-01-27T09:53:43.817219+0000","last_undegraded":"2021-01-27T09:53:43.817219+0000","last_fullsized":"2021-01-27T09:53:43.817219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'52","last_scrub_stamp":"2021-01-27T09:53:43.817089+0000","last_deep_scrub":"29'52","last_deep_scrub_stamp":"2021-01-27T09:53:43.817089+0000","last_clean_scrub_stamp":"2021-01-27T09:53:43.817089+0000","log_size":52,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"29'6763","reported_seq":"6795","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:43.024416+0000","last_change":"2021-01-27T09:44:33.381360+0000","last_active":"2021-01-27T09:53:43.024416+0000","last_peered":"2021-01-27T09:53:43.024416+0000","last_clean":"2021-01-27T09:53:43.024416+0000","last_became_active":"2021-01-27T09:44:33.380037+0000","last_became_peered":"2021-01-27T09:44:33.380037+0000","last_unstale":"2021-01-27T09:53:43.024416+0000","last_undegraded":"2021-01-27T09:53:43.024416+0000","last_fullsized":"2021-01-27T09:53:43.024416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":6763,"ondisk_log_size":6763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":90410,"num_write_kb":2139720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"34","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:41.292183+0000","last_change":"2021-01-27T09:53:41.293045+0000","last_active":"2021-01-27T09:53:41.292183+0000","last_peered":"2021-01-27T09:53:41.292183+0000","last_clean":"2021-01-27T09:53:41.292183+0000","last_became_active":"2021-01-27T09:44:26.435467+0000","last_became_peered":"2021-01-27T09:44:26.435467+0000","last_unstale":"2021-01-27T09:53:41.292183+0000","last_undegraded":"2021-01-27T09:53:41.292183+0000","last_fullsized":"2021-01-27T09:53:41.292183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'81","reported_seq":"108","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:16.683856+0000","last_change":"2021-01-27T09:44:28.934250+0000","last_active":"2021-01-27T09:53:16.683856+0000","last_peered":"2021-01-27T09:53:16.683856+0000","last_clean":"2021-01-27T09:53:16.683856+0000","last_became_active":"2021-01-27T09:44:28.933897+0000","last_became_peered":"2021-01-27T09:44:28.933897+0000","last_unstale":"2021-01-27T09:53:16.683856+0000","last_undegraded":"2021-01-27T09:53:16.683856+0000","last_fullsized":"2021-01-27T09:53:16.683856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":81,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":666,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":24,"num_read_kb":26,"num_write":114,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'57","reported_seq":"73","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:42.389963+0000","last_change":"2021-01-27T09:44:29.341412+0000","last_active":"2021-01-27T09:53:42.389963+0000","last_peered":"2021-01-27T09:53:42.389963+0000","last_clean":"2021-01-27T09:53:42.389963+0000","last_became_active":"2021-01-27T09:44:29.341016+0000","last_became_peered":"2021-01-27T09:44:29.341016+0000","last_unstale":"2021-01-27T09:53:42.389963+0000","last_undegraded":"2021-01-27T09:53:42.389963+0000","last_fullsized":"2021-01-27T09:53:42.389963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":57,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"29'7566","reported_seq":"7614","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:43.619814+0000","last_change":"2021-01-27T09:44:33.378505+0000","last_active":"2021-01-27T09:53:43.619814+0000","last_peered":"2021-01-27T09:53:43.619814+0000","last_clean":"2021-01-27T09:53:43.619814+0000","last_became_active":"2021-01-27T09:44:33.377285+0000","last_became_peered":"2021-01-27T09:44:33.377285+0000","last_unstale":"2021-01-27T09:53:43.619814+0000","last_undegraded":"2021-01-27T09:53:43.619814+0000","last_fullsized":"2021-01-27T09:53:43.619814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":7566,"ondisk_log_size":7566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":100950,"num_write_kb":2356202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"19","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.715278+0000","last_change":"2021-01-27T09:44:25.841172+0000","last_active":"2021-01-27T09:49:18.715278+0000","last_peered":"2021-01-27T09:49:18.715278+0000","last_clean":"2021-01-27T09:49:18.715278+0000","last_became_active":"2021-01-27T09:44:25.840711+0000","last_became_peered":"2021-01-27T09:44:25.840711+0000","last_unstale":"2021-01-27T09:49:18.715278+0000","last_undegraded":"2021-01-27T09:49:18.715278+0000","last_fullsized":"2021-01-27T09:49:18.715278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'912","reported_seq":"943","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:44.246292+0000","last_change":"2021-01-27T09:53:44.246292+0000","last_active":"2021-01-27T09:53:44.246292+0000","last_peered":"2021-01-27T09:53:44.246292+0000","last_clean":"2021-01-27T09:53:44.246292+0000","last_became_active":"2021-01-27T09:44:28.932513+0000","last_became_peered":"2021-01-27T09:44:28.932513+0000","last_unstale":"2021-01-27T09:53:44.246292+0000","last_undegraded":"2021-01-27T09:53:44.246292+0000","last_fullsized":"2021-01-27T09:53:44.246292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'912","last_scrub_stamp":"2021-01-27T09:53:44.246125+0000","last_deep_scrub":"29'912","last_deep_scrub_stamp":"2021-01-27T09:53:44.246125+0000","last_clean_scrub_stamp":"2021-01-27T09:53:44.246125+0000","log_size":912,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4195502,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":17,"num_read_kb":4112,"num_write":906,"num_write_kb":4328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"29'59","reported_seq":"75","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:43.962721+0000","last_change":"2021-01-27T09:44:29.350508+0000","last_active":"2021-01-27T09:53:43.962721+0000","last_peered":"2021-01-27T09:53:43.962721+0000","last_clean":"2021-01-27T09:53:43.962721+0000","last_became_active":"2021-01-27T09:44:29.350179+0000","last_became_peered":"2021-01-27T09:44:29.350179+0000","last_unstale":"2021-01-27T09:53:43.962721+0000","last_undegraded":"2021-01-27T09:53:43.962721+0000","last_fullsized":"2021-01-27T09:53:43.962721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":59,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"29'6970","reported_seq":"7009","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:43.909174+0000","last_change":"2021-01-27T09:53:38.870166+0000","last_active":"2021-01-27T09:53:43.909174+0000","last_peered":"2021-01-27T09:53:43.909174+0000","last_clean":"2021-01-27T09:53:43.909174+0000","last_became_active":"2021-01-27T09:44:33.439809+0000","last_became_peered":"2021-01-27T09:44:33.439809+0000","last_unstale":"2021-01-27T09:53:43.909174+0000","last_undegraded":"2021-01-27T09:53:43.909174+0000","last_fullsized":"2021-01-27T09:53:43.909174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6921","last_scrub_stamp":"2021-01-27T09:53:38.870038+0000","last_deep_scrub":"29'6921","last_deep_scrub_stamp":"2021-01-27T09:53:38.870038+0000","last_clean_scrub_stamp":"2021-01-27T09:53:38.870038+0000","log_size":6970,"ondisk_log_size":6970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":92360,"num_write_kb":2198460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"25","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:39.174731+0000","last_change":"2021-01-27T09:53:39.174731+0000","last_active":"2021-01-27T09:53:39.174731+0000","last_peered":"2021-01-27T09:53:39.174731+0000","last_clean":"2021-01-27T09:53:39.174731+0000","last_became_active":"2021-01-27T09:44:26.403537+0000","last_became_peered":"2021-01-27T09:44:26.403537+0000","last_unstale":"2021-01-27T09:53:39.174731+0000","last_undegraded":"2021-01-27T09:53:39.174731+0000","last_fullsized":"2021-01-27T09:53:39.174731+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:53:39.174584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:53:39.174584+0000","last_clean_scrub_stamp":"2021-01-27T09:53:39.174584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"29'35","reported_seq":"62","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:41.757902+0000","last_change":"2021-01-27T09:53:41.757902+0000","last_active":"2021-01-27T09:53:41.757902+0000","last_peered":"2021-01-27T09:53:41.757902+0000","last_clean":"2021-01-27T09:53:41.757902+0000","last_became_active":"2021-01-27T09:44:28.932127+0000","last_became_peered":"2021-01-27T09:44:28.932127+0000","last_unstale":"2021-01-27T09:53:41.757902+0000","last_undegraded":"2021-01-27T09:53:41.757902+0000","last_fullsized":"2021-01-27T09:53:41.757902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2021-01-27T09:53:41.757781+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2021-01-27T09:53:41.757781+0000","last_clean_scrub_stamp":"2021-01-27T09:53:41.757781+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":736,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":14,"num_read_kb":20,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"29'62","reported_seq":"83","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:46.307368+0000","last_change":"2021-01-27T09:53:46.307368+0000","last_active":"2021-01-27T09:53:46.307368+0000","last_peered":"2021-01-27T09:53:46.307368+0000","last_clean":"2021-01-27T09:53:46.307368+0000","last_became_active":"2021-01-27T09:44:29.337813+0000","last_became_peered":"2021-01-27T09:44:29.337813+0000","last_unstale":"2021-01-27T09:53:46.307368+0000","last_undegraded":"2021-01-27T09:53:46.307368+0000","last_fullsized":"2021-01-27T09:53:46.307368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'62","last_scrub_stamp":"2021-01-27T09:53:46.307255+0000","last_deep_scrub":"29'62","last_deep_scrub_stamp":"2021-01-27T09:53:46.307255+0000","last_clean_scrub_stamp":"2021-01-27T09:53:46.307255+0000","log_size":62,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"29'7233","reported_seq":"7270","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:43.927870+0000","last_change":"2021-01-27T09:44:33.442248+0000","last_active":"2021-01-27T09:53:43.927870+0000","last_peered":"2021-01-27T09:53:43.927870+0000","last_clean":"2021-01-27T09:53:43.927870+0000","last_became_active":"2021-01-27T09:44:33.440410+0000","last_became_peered":"2021-01-27T09:44:33.440410+0000","last_unstale":"2021-01-27T09:53:43.927870+0000","last_undegraded":"2021-01-27T09:53:43.927870+0000","last_fullsized":"2021-01-27T09:53:43.927870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":7233,"ondisk_log_size":7233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1650,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":96120,"num_write_kb":2240389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"29'6738","reported_seq":"6779","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:44.763794+0000","last_change":"2021-01-27T09:53:44.763794+0000","last_active":"2021-01-27T09:53:44.763794+0000","last_peered":"2021-01-27T09:53:44.763794+0000","last_clean":"2021-01-27T09:53:44.763794+0000","last_became_active":"2021-01-27T09:44:33.440377+0000","last_became_peered":"2021-01-27T09:44:33.440377+0000","last_unstale":"2021-01-27T09:53:44.763794+0000","last_undegraded":"2021-01-27T09:53:44.763794+0000","last_fullsized":"2021-01-27T09:53:44.763794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6738","last_scrub_stamp":"2021-01-27T09:53:44.763662+0000","last_deep_scrub":"29'6738","last_deep_scrub_stamp":"2021-01-27T09:53:44.763662+0000","last_clean_scrub_stamp":"2021-01-27T09:53:44.763662+0000","log_size":6738,"ondisk_log_size":6738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":89749,"num_write_kb":2125206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"29'773","reported_seq":"803","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:41.391878+0000","last_change":"2021-01-27T09:53:20.555476+0000","last_active":"2021-01-27T09:53:41.391878+0000","last_peered":"2021-01-27T09:53:41.391878+0000","last_clean":"2021-01-27T09:53:41.391878+0000","last_became_active":"2021-01-27T09:44:28.928444+0000","last_became_peered":"2021-01-27T09:44:28.928444+0000","last_unstale":"2021-01-27T09:53:41.391878+0000","last_undegraded":"2021-01-27T09:53:41.391878+0000","last_fullsized":"2021-01-27T09:53:41.391878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'769","last_scrub_stamp":"2021-01-27T09:53:20.555294+0000","last_deep_scrub":"29'769","last_deep_scrub_stamp":"2021-01-27T09:53:20.555294+0000","last_clean_scrub_stamp":"2021-01-27T09:53:20.555294+0000","log_size":773,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2924759,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":16,"num_read_kb":1577,"num_write":757,"num_write_kb":3111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":26088,"num_omap_keys":52,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"19","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.715153+0000","last_change":"2021-01-27T09:44:26.403671+0000","last_active":"2021-01-27T09:49:18.715153+0000","last_peered":"2021-01-27T09:49:18.715153+0000","last_clean":"2021-01-27T09:49:18.715153+0000","last_became_active":"2021-01-27T09:44:26.403137+0000","last_became_peered":"2021-01-27T09:44:26.403137+0000","last_unstale":"2021-01-27T09:49:18.715153+0000","last_undegraded":"2021-01-27T09:49:18.715153+0000","last_fullsized":"2021-01-27T09:49:18.715153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'52","reported_seq":"68","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:43.820497+0000","last_change":"2021-01-27T09:44:29.347824+0000","last_active":"2021-01-27T09:53:43.820497+0000","last_peered":"2021-01-27T09:53:43.820497+0000","last_clean":"2021-01-27T09:53:43.820497+0000","last_became_active":"2021-01-27T09:44:29.347463+0000","last_became_peered":"2021-01-27T09:44:29.347463+0000","last_unstale":"2021-01-27T09:53:43.820497+0000","last_undegraded":"2021-01-27T09:53:43.820497+0000","last_fullsized":"2021-01-27T09:53:43.820497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":52,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"29'6720","reported_seq":"6756","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:46.790247+0000","last_change":"2021-01-27T09:53:46.790247+0000","last_active":"2021-01-27T09:53:46.790247+0000","last_peered":"2021-01-27T09:53:46.790247+0000","last_clean":"2021-01-27T09:53:46.790247+0000","last_became_active":"2021-01-27T09:44:33.440172+0000","last_became_peered":"2021-01-27T09:44:33.440172+0000","last_unstale":"2021-01-27T09:53:46.790247+0000","last_undegraded":"2021-01-27T09:53:46.790247+0000","last_fullsized":"2021-01-27T09:53:46.790247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6720","last_scrub_stamp":"2021-01-27T09:53:46.790136+0000","last_deep_scrub":"29'6720","last_deep_scrub_stamp":"2021-01-27T09:53:46.790136+0000","last_clean_scrub_stamp":"2021-01-27T09:53:46.790136+0000","log_size":6720,"ondisk_log_size":6720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":88875,"num_write_kb":2080841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"29'30","reported_seq":"66","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:45.104194+0000","last_change":"2021-01-27T09:53:45.104194+0000","last_active":"2021-01-27T09:53:45.104194+0000","last_peered":"2021-01-27T09:53:45.104194+0000","last_clean":"2021-01-27T09:53:45.104194+0000","last_became_active":"2021-01-27T09:44:28.930374+0000","last_became_peered":"2021-01-27T09:44:28.930374+0000","last_unstale":"2021-01-27T09:53:45.104194+0000","last_undegraded":"2021-01-27T09:53:45.104194+0000","last_fullsized":"2021-01-27T09:53:45.104194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2021-01-27T09:53:45.103992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:53:45.103992+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":112,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":32,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"25","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:43.439770+0000","last_change":"2021-01-27T09:53:43.439770+0000","last_active":"2021-01-27T09:53:43.439770+0000","last_peered":"2021-01-27T09:53:43.439770+0000","last_clean":"2021-01-27T09:53:43.439770+0000","last_became_active":"2021-01-27T09:44:25.838635+0000","last_became_peered":"2021-01-27T09:44:25.838635+0000","last_unstale":"2021-01-27T09:53:43.439770+0000","last_undegraded":"2021-01-27T09:53:43.439770+0000","last_fullsized":"2021-01-27T09:53:43.439770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:53:43.439518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:53:43.439518+0000","last_clean_scrub_stamp":"2021-01-27T09:53:43.439518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'56","reported_seq":"72","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:42.953878+0000","last_change":"2021-01-27T09:44:29.348218+0000","last_active":"2021-01-27T09:53:42.953878+0000","last_peered":"2021-01-27T09:53:42.953878+0000","last_clean":"2021-01-27T09:53:42.953878+0000","last_became_active":"2021-01-27T09:44:29.347905+0000","last_became_peered":"2021-01-27T09:44:29.347905+0000","last_unstale":"2021-01-27T09:53:42.953878+0000","last_undegraded":"2021-01-27T09:53:42.953878+0000","last_fullsized":"2021-01-27T09:53:42.953878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":56,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"29'6658","reported_seq":"6690","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:43.112166+0000","last_change":"2021-01-27T09:44:33.378828+0000","last_active":"2021-01-27T09:53:43.112166+0000","last_peered":"2021-01-27T09:53:43.112166+0000","last_clean":"2021-01-27T09:53:43.112166+0000","last_became_active":"2021-01-27T09:44:33.376984+0000","last_became_peered":"2021-01-27T09:44:33.376984+0000","last_unstale":"2021-01-27T09:53:43.112166+0000","last_undegraded":"2021-01-27T09:53:43.112166+0000","last_fullsized":"2021-01-27T09:53:43.112166+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:32.342881+0000","last_clean_scrub_stamp":"2021-01-27T09:44:32.342881+0000","log_size":6658,"ondisk_log_size":6658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":88504,"num_write_kb":2116621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'205","reported_seq":"272","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:41.391666+0000","last_change":"2021-01-27T09:53:39.234228+0000","last_active":"2021-01-27T09:53:41.391666+0000","last_peered":"2021-01-27T09:53:41.391666+0000","last_clean":"2021-01-27T09:53:41.391666+0000","last_became_active":"2021-01-27T09:44:28.932701+0000","last_became_peered":"2021-01-27T09:44:28.932701+0000","last_unstale":"2021-01-27T09:53:41.391666+0000","last_undegraded":"2021-01-27T09:53:41.391666+0000","last_fullsized":"2021-01-27T09:53:41.391666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'200","last_scrub_stamp":"2021-01-27T09:53:39.234148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:53:39.234148+0000","log_size":205,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":598042,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":41,"num_read_kb":295,"num_write":200,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"38","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:45.148263+0000","last_change":"2021-01-27T09:53:45.148263+0000","last_active":"2021-01-27T09:53:45.148263+0000","last_peered":"2021-01-27T09:53:45.148263+0000","last_clean":"2021-01-27T09:53:45.148263+0000","last_became_active":"2021-01-27T09:44:25.736516+0000","last_became_peered":"2021-01-27T09:44:25.736516+0000","last_unstale":"2021-01-27T09:53:45.148263+0000","last_undegraded":"2021-01-27T09:53:45.148263+0000","last_fullsized":"2021-01-27T09:53:45.148263+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:53:45.148009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:53:45.148009+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'63","reported_seq":"79","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:43.949407+0000","last_change":"2021-01-27T09:44:29.347815+0000","last_active":"2021-01-27T09:53:43.949407+0000","last_peered":"2021-01-27T09:53:43.949407+0000","last_clean":"2021-01-27T09:53:43.949407+0000","last_became_active":"2021-01-27T09:44:29.347415+0000","last_became_peered":"2021-01-27T09:44:29.347415+0000","last_unstale":"2021-01-27T09:53:43.949407+0000","last_undegraded":"2021-01-27T09:53:43.949407+0000","last_fullsized":"2021-01-27T09:53:43.949407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":63,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"29'6469","reported_seq":"6513","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:43.832064+0000","last_change":"2021-01-27T09:53:43.153878+0000","last_active":"2021-01-27T09:53:43.832064+0000","last_peered":"2021-01-27T09:53:43.832064+0000","last_clean":"2021-01-27T09:53:43.832064+0000","last_became_active":"2021-01-27T09:44:33.435975+0000","last_became_peered":"2021-01-27T09:44:33.435975+0000","last_unstale":"2021-01-27T09:53:43.832064+0000","last_undegraded":"2021-01-27T09:53:43.832064+0000","last_fullsized":"2021-01-27T09:53:43.832064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6466","last_scrub_stamp":"2021-01-27T09:53:43.153754+0000","last_deep_scrub":"29'6466","last_deep_scrub_stamp":"2021-01-27T09:53:43.153754+0000","last_clean_scrub_stamp":"2021-01-27T09:53:43.153754+0000","log_size":6469,"ondisk_log_size":6469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":86208,"num_write_kb":2029152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'44","reported_seq":"64","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:16.319604+0000","last_change":"2021-01-27T09:44:28.930455+0000","last_active":"2021-01-27T09:53:16.319604+0000","last_peered":"2021-01-27T09:53:16.319604+0000","last_clean":"2021-01-27T09:53:16.319604+0000","last_became_active":"2021-01-27T09:44:28.930088+0000","last_became_peered":"2021-01-27T09:44:28.930088+0000","last_unstale":"2021-01-27T09:53:16.319604+0000","last_undegraded":"2021-01-27T09:53:16.319604+0000","last_fullsized":"2021-01-27T09:53:16.319604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:44:27.897533+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6104,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7,"num_read_kb":12,"num_write":66,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"19","reported_epoch":"28","state":"active+clean","last_fresh":"2021-01-27T09:49:18.722361+0000","last_change":"2021-01-27T09:44:25.736301+0000","last_active":"2021-01-27T09:49:18.722361+0000","last_peered":"2021-01-27T09:49:18.722361+0000","last_clean":"2021-01-27T09:49:18.722361+0000","last_became_active":"2021-01-27T09:44:25.735741+0000","last_became_peered":"2021-01-27T09:44:25.735741+0000","last_unstale":"2021-01-27T09:49:18.722361+0000","last_undegraded":"2021-01-27T09:49:18.722361+0000","last_fullsized":"2021-01-27T09:49:18.722361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:44:24.550437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'4","reported_seq":"30","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:21.816315+0000","last_change":"2021-01-27T09:53:21.816315+0000","last_active":"2021-01-27T09:53:21.816315+0000","last_peered":"2021-01-27T09:53:21.816315+0000","last_clean":"2021-01-27T09:53:21.816315+0000","last_became_active":"2021-01-27T09:44:24.569755+0000","last_became_peered":"2021-01-27T09:44:24.569755+0000","last_unstale":"2021-01-27T09:53:21.816315+0000","last_undegraded":"2021-01-27T09:53:21.816315+0000","last_fullsized":"2021-01-27T09:53:21.816315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2021-01-27T09:53:21.816187+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2021-01-27T09:53:21.816187+0000","last_clean_scrub_stamp":"2021-01-27T09:53:21.816187+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9854,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'56","reported_seq":"71","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:42.475536+0000","last_change":"2021-01-27T09:44:29.337716+0000","last_active":"2021-01-27T09:53:42.475536+0000","last_peered":"2021-01-27T09:53:42.475536+0000","last_clean":"2021-01-27T09:53:42.475536+0000","last_became_active":"2021-01-27T09:44:29.337355+0000","last_became_peered":"2021-01-27T09:44:29.337355+0000","last_unstale":"2021-01-27T09:53:42.475536+0000","last_undegraded":"2021-01-27T09:53:42.475536+0000","last_fullsized":"2021-01-27T09:53:42.475536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:28.901960+0000","last_clean_scrub_stamp":"2021-01-27T09:44:28.901960+0000","log_size":56,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":8,"stat_sum":{"num_bytes":1650,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":177,"num_read_kb":0,"num_write":733176,"num_write_kb":17286591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":49152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55117,"ondisk_log_size":55117,"up":32,"acting":32,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":457,"ondisk_log_size":457,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":7725921,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":158,"num_read_kb":6083,"num_write":2208,"num_write_kb":8319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30968,"num_omap_keys":62,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15605760,"data_stored":15451842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2141,"ondisk_log_size":2141,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9854,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509554,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319732,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":319424,"kb_avail":94052108,"statfs":{"total":96636764160,"available":96309358592,"internally_reserved":0,"allocated":307200,"data_stored":134582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":327090176},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,3,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:53:37 2021","interfaces":[{"interface":"back","average":{"1min":5.274,"5min":308.63799999999998,"15min":163.46100000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":28.126000000000001,"5min":2098.6239999999998,"15min":2294.9899999999998},"last":5.4379999999999997},{"interface":"front","average":{"1min":57.298999999999999,"5min":214.78999999999999,"15min":110.01000000000001},"min":{"1min":1.143,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":838.81899999999996,"5min":1539.433,"15min":1539.433},"last":6.7619999999999996}]},{"osd":1,"last update":"Wed Jan 27 09:53:37 2021","interfaces":[{"interface":"back","average":{"1min":4.891,"5min":73.766000000000005,"15min":26.062000000000001},"min":{"1min":0.63900000000000001,"5min":0.624,"15min":0.58699999999999997},"max":{"1min":23.977,"5min":1524.269,"15min":1524.269},"last":1.232},{"interface":"front","average":{"1min":6.6500000000000004,"5min":139.51599999999999,"15min":74.756},"min":{"1min":0.77100000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":28.852,"5min":2096.9099999999999,"15min":2197.2339999999999},"last":8.0839999999999996}]},{"osd":2,"last update":"Wed Jan 27 09:53:37 2021","interfaces":[{"interface":"back","average":{"1min":5.6239999999999997,"5min":123.563,"15min":73.085999999999999},"min":{"1min":0.90000000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":29.120000000000001,"5min":1322.53,"15min":2294.8020000000001},"last":7.976},{"interface":"front","average":{"1min":4.9889999999999999,"5min":76.313999999999993,"15min":27.516999999999999},"min":{"1min":0.86599999999999999,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":27.065999999999999,"5min":1524.4739999999999,"15min":1524.4739999999999},"last":1.46}]},{"osd":4,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":334.327,"5min":243.10900000000001,"15min":92.652000000000001},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1240.47,"5min":1386.115,"15min":1386.115},"last":7.21},{"interface":"front","average":{"1min":7.7119999999999997,"5min":125.717,"15min":44.113},"min":{"1min":1.0660000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":63.652999999999999,"5min":1524.7470000000001,"15min":1524.7470000000001},"last":0.93999999999999995}]},{"osd":5,"last update":"Wed Jan 27 09:53:37 2021","interfaces":[{"interface":"back","average":{"1min":5.1699999999999999,"5min":76.319999999999993,"15min":27.533999999999999},"min":{"1min":1.052,"5min":0.99199999999999999,"15min":0.93500000000000005},"max":{"1min":24.245000000000001,"5min":1524.604,"15min":1524.604},"last":1.0700000000000001},{"interface":"front","average":{"1min":5.5510000000000002,"5min":140.566,"15min":75.225999999999999},"min":{"1min":1.667,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":28.986999999999998,"5min":2097.0590000000002,"15min":2097.0590000000002},"last":7.7439999999999998}]},{"osd":6,"last update":"Wed Jan 27 09:53:37 2021","interfaces":[{"interface":"back","average":{"1min":6.2389999999999999,"5min":150.97499999999999,"15min":81.501000000000005},"min":{"1min":1.673,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":29.265999999999998,"5min":2114.0410000000002,"15min":2114.0410000000002},"last":7.8650000000000002},{"interface":"front","average":{"1min":57.228999999999999,"5min":157.42400000000001,"15min":80.890000000000001},"min":{"1min":1.2949999999999999,"5min":1.075,"15min":1.0549999999999999},"max":{"1min":839.03099999999995,"5min":1240.5540000000001,"15min":1317.1679999999999},"last":6.899}]},{"osd":7,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":7.4909999999999997,"5min":190.19900000000001,"15min":74.959000000000003},"min":{"1min":1.2410000000000001,"5min":1.198,"15min":1.198},"max":{"1min":63.780000000000001,"5min":1801.5260000000001,"15min":1801.5260000000001},"last":1.3480000000000001},{"interface":"front","average":{"1min":7.8650000000000002,"5min":149.43000000000001,"15min":52.268999999999998},"min":{"1min":1.4750000000000001,"5min":1.427,"15min":1.427},"max":{"1min":64.024000000000001,"5min":1682.9359999999999,"15min":1682.9359999999999},"last":3.1240000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509555,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":211988,"kb_used_data":3788,"kb_used_omap":0,"kb_used_meta":208192,"kb_avail":94159852,"statfs":{"total":96636764160,"available":96419688448,"internally_reserved":0,"allocated":3878912,"data_stored":3663437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":213188608},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":25.510999999999999,"5min":121.765,"15min":41.948},"min":{"1min":0.63,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":502.11900000000003,"5min":1480.2760000000001,"15min":1480.2760000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":64.305999999999997,"5min":134.34800000000001,"15min":51.317},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":900.13300000000004,"5min":1730.1669999999999,"15min":1730.1669999999999},"last":1.0309999999999999}]},{"osd":1,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":2.8490000000000002,"5min":3.5899999999999999,"15min":3.0990000000000002},"min":{"1min":0.70999999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":15.544,"5min":29.736999999999998,"15min":29.736999999999998},"last":0.83299999999999996},{"interface":"front","average":{"1min":3.0739999999999998,"5min":3.7989999999999999,"15min":2.891},"min":{"1min":0.79600000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":15.452999999999999,"5min":44.777999999999999,"15min":44.777999999999999},"last":1.181}]},{"osd":3,"last update":"Wed Jan 27 09:52:42 2021","interfaces":[{"interface":"back","average":{"1min":56.670000000000002,"5min":138.53700000000001,"15min":58.232999999999997},"min":{"1min":0.81699999999999995,"5min":0.753,"15min":0.753},"max":{"1min":503.72199999999998,"5min":1800.183,"15min":1800.183},"last":201.49299999999999},{"interface":"front","average":{"1min":186.88900000000001,"5min":217.07400000000001,"15min":79.460999999999999},"min":{"1min":0.93700000000000006,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":717.49800000000005,"5min":3309.5619999999999,"15min":3309.5619999999999},"last":198.33699999999999}]},{"osd":4,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":1.9239999999999999,"5min":16.788,"15min":7.8230000000000004},"min":{"1min":1.0109999999999999,"5min":0.98099999999999998,"15min":0.88400000000000001},"max":{"1min":4.2859999999999996,"5min":291.916,"15min":291.916},"last":1.2609999999999999},{"interface":"front","average":{"1min":2.2629999999999999,"5min":14.132,"15min":6.6920000000000002},"min":{"1min":1.091,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":5.3959999999999999,"5min":448.73200000000003,"15min":448.73200000000003},"last":1.4139999999999999}]},{"osd":5,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":2.2829999999999999,"5min":2.5110000000000001,"15min":2.7280000000000002},"min":{"1min":1.1679999999999999,"5min":0.94299999999999995,"15min":0.84299999999999997},"max":{"1min":4.9800000000000004,"5min":17.311,"15min":17.311},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.8049999999999999,"5min":2.6850000000000001,"15min":3.2589999999999999},"min":{"1min":1.016,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":3.3639999999999999,"5min":16.814,"15min":19.155999999999999},"last":1.597}]},{"osd":6,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":2.2959999999999998,"5min":2.6640000000000001,"15min":3.262},"min":{"1min":1.0649999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":5.1340000000000003,"5min":15.388999999999999,"15min":43.197000000000003},"last":1.6859999999999999},{"interface":"front","average":{"1min":1.99,"5min":3.1120000000000001,"15min":3.0129999999999999},"min":{"1min":1.1839999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":3.6349999999999998,"5min":38.168999999999997,"15min":38.168999999999997},"last":1.296}]},{"osd":7,"last update":"Wed Jan 27 09:52:43 2021","interfaces":[{"interface":"back","average":{"1min":2.8010000000000002,"5min":98.846000000000004,"15min":35.628},"min":{"1min":1.7390000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"max":{"1min":8.3960000000000008,"5min":1464.1279999999999,"15min":1464.1279999999999},"last":1.8169999999999999},{"interface":"front","average":{"1min":2.0880000000000001,"5min":89.135000000000005,"15min":32.567999999999998},"min":{"1min":1.1779999999999999,"5min":1.1659999999999999,"15min":1.123},"max":{"1min":4.7030000000000003,"5min":1081.211,"15min":1081.211},"last":1.468}]}]},{"osd":1,"up_from":15,"seq":64424509555,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252468,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":252160,"kb_avail":94119372,"statfs":{"total":96636764160,"available":96378236928,"internally_reserved":0,"allocated":307200,"data_stored":134582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":258211840},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:53:45 2021","interfaces":[{"interface":"back","average":{"1min":2.9809999999999999,"5min":96.191000000000003,"15min":66.296000000000006},"min":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":11.170999999999999,"5min":1084.3209999999999,"15min":1471.8320000000001},"last":1.02},{"interface":"front","average":{"1min":3.7410000000000001,"5min":126.245,"15min":66.286000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.61199999999999999},"max":{"1min":16.039999999999999,"5min":1286.9860000000001,"15min":1292.7439999999999},"last":1.0780000000000001}]},{"osd":2,"last update":"Wed Jan 27 09:53:45 2021","interfaces":[{"interface":"back","average":{"1min":2.7160000000000002,"5min":4.9249999999999998,"15min":3.774},"min":{"1min":0.68000000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":20.096,"5min":160.691,"15min":270.13200000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":2.8029999999999999,"5min":5.5730000000000004,"15min":4.6189999999999998},"min":{"1min":0.88600000000000001,"5min":0.74299999999999999,"15min":0.68600000000000005},"max":{"1min":10.702,"5min":163.256,"15min":275.97399999999999},"last":0.80700000000000005}]},{"osd":3,"last update":"Wed Jan 27 09:53:45 2021","interfaces":[{"interface":"back","average":{"1min":6.8339999999999996,"5min":121.959,"15min":76.599999999999994},"min":{"1min":0.94599999999999995,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":21.187000000000001,"5min":1387.9079999999999,"15min":1387.9079999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":32.347000000000001,"5min":112.297,"15min":62.198999999999998},"min":{"1min":0.94999999999999996,"5min":0.79300000000000004,"15min":0.79000000000000004},"max":{"1min":589.51800000000003,"5min":1852.193,"15min":1852.193},"last":0.99199999999999999}]},{"osd":4,"last update":"Wed Jan 27 09:53:45 2021","interfaces":[{"interface":"back","average":{"1min":2.4780000000000002,"5min":28.882999999999999,"15min":12.917999999999999},"min":{"1min":0.873,"5min":0.873,"15min":0.66300000000000003},"max":{"1min":10.625999999999999,"5min":1089.0440000000001,"15min":1089.0440000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":3.4350000000000001,"5min":4.0709999999999997,"15min":7.5860000000000003},"min":{"1min":1.0840000000000001,"5min":0.97799999999999998,"15min":0.90600000000000003},"max":{"1min":13.500999999999999,"5min":29.530999999999999,"15min":656.05499999999995},"last":1.9470000000000001}]},{"osd":5,"last update":"Wed Jan 27 09:53:45 2021","interfaces":[{"interface":"back","average":{"1min":2.355,"5min":3.2029999999999998,"15min":3.2029999999999998},"min":{"1min":1.1359999999999999,"5min":0.91400000000000003,"15min":0.90600000000000003},"max":{"1min":9.6219999999999999,"5min":33.588000000000001,"15min":33.588000000000001},"last":1.9730000000000001},{"interface":"front","average":{"1min":2.9550000000000001,"5min":3.3519999999999999,"15min":3.2440000000000002},"min":{"1min":1,"5min":0.995,"15min":0.76500000000000001},"max":{"1min":11.173,"5min":25.948,"15min":25.948},"last":1.4390000000000001}]},{"osd":6,"last update":"Wed Jan 27 09:53:45 2021","interfaces":[{"interface":"back","average":{"1min":2.698,"5min":3.4079999999999999,"15min":3.3679999999999999},"min":{"1min":1.1399999999999999,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":9.8989999999999991,"5min":33.341999999999999,"15min":33.341999999999999},"last":1.333},{"interface":"front","average":{"1min":3.1379999999999999,"5min":3.5190000000000001,"15min":3.3759999999999999},"min":{"1min":1.121,"5min":1.121,"15min":1.05},"max":{"1min":10.795999999999999,"5min":26.204999999999998,"15min":26.204999999999998},"last":1.8}]},{"osd":7,"last update":"Wed Jan 27 09:53:45 2021","interfaces":[{"interface":"back","average":{"1min":3.6440000000000001,"5min":42.393000000000001,"15min":25.516999999999999},"min":{"1min":1.234,"5min":1.103,"15min":0.82499999999999996},"max":{"1min":13.653,"5min":1194.567,"15min":1194.567},"last":1.833},{"interface":"front","average":{"1min":2.8290000000000002,"5min":39.707000000000001,"15min":32.039000000000001},"min":{"1min":1.3819999999999999,"5min":1.1499999999999999,"15min":1.1279999999999999},"max":{"1min":10.157,"5min":1313.825,"15min":1655.51},"last":2.0630000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509555,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321384,"kb_used_data":3168,"kb_used_omap":0,"kb_used_meta":318208,"kb_avail":94050456,"statfs":{"total":96636764160,"available":96307666944,"internally_reserved":0,"allocated":3244032,"data_stored":3058555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":325844992},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 27 09:53:41 2021","interfaces":[{"interface":"back","average":{"1min":8.218,"5min":122.497,"15min":49.094999999999999},"min":{"1min":0.68400000000000005,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":68.403000000000006,"5min":1128.261,"15min":1128.261},"last":1.1830000000000001},{"interface":"front","average":{"1min":26.498000000000001,"5min":108.386,"15min":66.331000000000003},"min":{"1min":0.93600000000000005,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":504.99000000000001,"5min":2188.9270000000001,"15min":2237.944},"last":1.893}]},{"osd":2,"last update":"Wed Jan 27 09:53:46 2021","interfaces":[{"interface":"back","average":{"1min":7.7140000000000004,"5min":132.482,"15min":58.021000000000001},"min":{"1min":0.73599999999999999,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":93.251000000000005,"5min":1821.519,"15min":1821.519},"last":1.488},{"interface":"front","average":{"1min":27.811,"5min":168.07300000000001,"15min":71.825000000000003},"min":{"1min":1.1539999999999999,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":504.71499999999997,"5min":2749.7919999999999,"15min":2749.7919999999999},"last":2.181}]},{"osd":3,"last update":"Wed Jan 27 09:53:46 2021","interfaces":[{"interface":"back","average":{"1min":11.454000000000001,"5min":151.505,"15min":70.988},"min":{"1min":0.95799999999999996,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":68.799000000000007,"5min":1821.873,"15min":2240.3739999999998},"last":1.752},{"interface":"front","average":{"1min":11.688000000000001,"5min":237.37899999999999,"15min":98.140000000000001},"min":{"1min":1.109,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":69.260999999999996,"5min":2588.5129999999999,"15min":2588.5129999999999},"last":1.9910000000000001}]},{"osd":4,"last update":"Wed Jan 27 09:53:46 2021","interfaces":[{"interface":"back","average":{"1min":27.02,"5min":150.148,"15min":57.659999999999997},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":504.86000000000001,"5min":1128.5070000000001,"15min":1128.5070000000001},"last":2.6139999999999999},{"interface":"front","average":{"1min":8.5120000000000005,"5min":177.375,"15min":90.894999999999996},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":94.864999999999995,"5min":2756.1100000000001,"15min":2756.1100000000001},"last":2.5800000000000001}]},{"osd":5,"last update":"Wed Jan 27 09:53:41 2021","interfaces":[{"interface":"back","average":{"1min":26.295000000000002,"5min":133.10499999999999,"15min":52.923999999999999},"min":{"1min":0.96699999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":505.24599999999998,"5min":1821.7380000000001,"15min":1821.7380000000001},"last":2.887},{"interface":"front","average":{"1min":6.5140000000000002,"5min":128.58600000000001,"15min":76.390000000000001},"min":{"1min":1.3200000000000001,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":68.259,"5min":2189.192,"15min":2219.1909999999998},"last":2.133}]},{"osd":6,"last update":"Wed Jan 27 09:53:41 2021","interfaces":[{"interface":"back","average":{"1min":7.3440000000000003,"5min":86.447999999999993,"15min":56.587000000000003},"min":{"1min":1.6850000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"max":{"1min":68.668000000000006,"5min":2189.3180000000002,"15min":2189.3180000000002},"last":2.3239999999999998},{"interface":"front","average":{"1min":8.1069999999999993,"5min":99.637,"15min":71.597999999999999},"min":{"1min":1.3899999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":68.543999999999997,"5min":2189.7489999999998,"15min":2219.4609999999998},"last":2.8660000000000001}]},{"osd":7,"last update":"Wed Jan 27 09:53:46 2021","interfaces":[{"interface":"back","average":{"1min":8.6219999999999999,"5min":200.71799999999999,"15min":79.978999999999999},"min":{"1min":1.391,"5min":1.121,"15min":1.121},"max":{"1min":95.629999999999995,"5min":2750.0140000000001,"15min":2750.0140000000001},"last":2.665},{"interface":"front","average":{"1min":27.588999999999999,"5min":195.63800000000001,"15min":100.005},"min":{"1min":1.371,"5min":1.228,"15min":1.228},"max":{"1min":505.11799999999999,"5min":3266.1680000000001,"15min":3266.1680000000001},"last":3.093}]}]},{"osd":7,"up_from":14,"seq":60129542258,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":440056,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":439744,"kb_avail":93931784,"statfs":{"total":96636764160,"available":96186146816,"internally_reserved":0,"allocated":311296,"data_stored":133908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":450297856},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:53:41 2021","interfaces":[{"interface":"back","average":{"1min":3.4049999999999998,"5min":114.139,"15min":64.271000000000001},"min":{"1min":0.79600000000000004,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":15.473000000000001,"5min":1245.2170000000001,"15min":1326.3920000000001},"last":3.2730000000000001},{"interface":"front","average":{"1min":18.687000000000001,"5min":168.70400000000001,"15min":76.894000000000005},"min":{"1min":0.64500000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":266.68299999999999,"5min":1520.595,"15min":1520.595},"last":1.9830000000000001}]},{"osd":1,"last update":"Wed Jan 27 09:53:41 2021","interfaces":[{"interface":"back","average":{"1min":9.3970000000000002,"5min":31.244,"15min":14.503},"min":{"1min":0.78500000000000003,"5min":0.73299999999999998,"15min":0.624},"max":{"1min":117.753,"5min":865.298,"15min":865.298},"last":2.411},{"interface":"front","average":{"1min":2.0329999999999999,"5min":74.781000000000006,"15min":34.814999999999998},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":5.8179999999999996,"5min":1996.8119999999999,"15min":1996.8119999999999},"last":1.8360000000000001}]},{"osd":2,"last update":"Wed Jan 27 09:53:45 2021","interfaces":[{"interface":"back","average":{"1min":3.1269999999999998,"5min":65.135000000000005,"15min":28.826000000000001},"min":{"1min":1.2210000000000001,"5min":0.81499999999999995,"15min":0.71999999999999997},"max":{"1min":22.030000000000001,"5min":1996.9359999999999,"15min":1996.9359999999999},"last":1.522},{"interface":"front","average":{"1min":3.3900000000000001,"5min":37.545999999999999,"15min":26.943000000000001},"min":{"1min":0.96399999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":22.163,"5min":1102.5360000000001,"15min":1326.518},"last":2.1819999999999999}]},{"osd":3,"last update":"Wed Jan 27 09:53:45 2021","interfaces":[{"interface":"back","average":{"1min":40.689,"5min":154.17699999999999,"15min":91.412999999999997},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.80700000000000005},"max":{"1min":371.14400000000001,"5min":1632.471,"15min":1632.471},"last":1.5920000000000001},{"interface":"front","average":{"1min":19.155000000000001,"5min":228.571,"15min":126.777},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":0.92300000000000004},"max":{"1min":262.82100000000003,"5min":3452.1500000000001,"15min":3452.1500000000001},"last":2.7280000000000002}]},{"osd":4,"last update":"Wed Jan 27 09:53:45 2021","interfaces":[{"interface":"back","average":{"1min":2.4430000000000001,"5min":75.483000000000004,"15min":45.832999999999998},"min":{"1min":0.75800000000000001,"5min":0.754,"15min":0.754},"max":{"1min":6.5620000000000003,"5min":2007.1610000000001,"15min":2007.1610000000001},"last":3.6469999999999998},{"interface":"front","average":{"1min":2.3250000000000002,"5min":48.866999999999997,"15min":33.548999999999999},"min":{"1min":0.90500000000000003,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":6.0620000000000003,"5min":1245.086,"15min":1344.953},"last":2.3420000000000001}]},{"osd":5,"last update":"Wed Jan 27 09:53:45 2021","interfaces":[{"interface":"back","average":{"1min":2.3799999999999999,"5min":36.137,"15min":26.263999999999999},"min":{"1min":0.97499999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":6.375,"5min":1102.3889999999999,"15min":1326.6369999999999},"last":2.8730000000000002},{"interface":"front","average":{"1min":2.4500000000000002,"5min":65.256,"15min":27.956},"min":{"1min":1.147,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":6.859,"5min":1998.104,"15min":1998.104},"last":3.1099999999999999}]},{"osd":6,"last update":"Wed Jan 27 09:53:41 2021","interfaces":[{"interface":"back","average":{"1min":3.0179999999999998,"5min":65.625,"15min":27.728999999999999},"min":{"1min":1.2669999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":8.6029999999999998,"5min":1997.972,"15min":1997.972},"last":3.5110000000000001},{"interface":"front","average":{"1min":9.0739999999999998,"5min":27.779,"15min":13.598000000000001},"min":{"1min":1.0109999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":117.616,"5min":627.93899999999996,"15min":627.93899999999996},"last":3.9630000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542259,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":203824,"kb_used_data":5032,"kb_used_omap":0,"kb_used_meta":198784,"kb_avail":94168016,"statfs":{"total":96636764160,"available":96428048384,"internally_reserved":0,"allocated":5152768,"data_stored":4929528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":203554816},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:53:34 2021","interfaces":[{"interface":"back","average":{"1min":3.2789999999999999,"5min":141.98400000000001,"15min":59.155999999999999},"min":{"1min":0.629,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":17.308,"5min":2062.3220000000001,"15min":2062.3220000000001},"last":1.8999999999999999},{"interface":"front","average":{"1min":3.2240000000000002,"5min":67.819999999999993,"15min":26.286000000000001},"min":{"1min":0.70699999999999996,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":17.681000000000001,"5min":735.14300000000003,"15min":735.14300000000003},"last":1.679}]},{"osd":1,"last update":"Wed Jan 27 09:53:40 2021","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":3.7829999999999999,"15min":3.2029999999999998},"min":{"1min":0.68999999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":9.1470000000000002,"5min":202.423,"15min":202.423},"last":1.3140000000000001},{"interface":"front","average":{"1min":2.032,"5min":3.8929999999999998,"15min":3.3809999999999998},"min":{"1min":0.90700000000000003,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":5.3339999999999996,"5min":188.43000000000001,"15min":188.43000000000001},"last":1.3660000000000001}]},{"osd":2,"last update":"Wed Jan 27 09:53:34 2021","interfaces":[{"interface":"back","average":{"1min":2.2360000000000002,"5min":3.4089999999999998,"15min":3.375},"min":{"1min":0.89800000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":5.8630000000000004,"5min":89.617999999999995,"15min":182.20699999999999},"last":2.1240000000000001},{"interface":"front","average":{"1min":2.1269999999999998,"5min":3.0680000000000001,"15min":3.089},"min":{"1min":0.98199999999999998,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":8.0939999999999994,"5min":86.694999999999993,"15min":150.04900000000001},"last":1.4330000000000001}]},{"osd":3,"last update":"Wed Jan 27 09:53:34 2021","interfaces":[{"interface":"back","average":{"1min":3.6240000000000001,"5min":82.180999999999997,"15min":42.915999999999997},"min":{"1min":1.3200000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":14.695,"5min":1796.723,"15min":1796.723},"last":1.9850000000000001},{"interface":"front","average":{"1min":49.997999999999998,"5min":134.54400000000001,"15min":47.350999999999999},"min":{"1min":1.1259999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":606.72500000000002,"5min":1821.835,"15min":1821.835},"last":2.343}]},{"osd":4,"last update":"Wed Jan 27 09:53:34 2021","interfaces":[{"interface":"back","average":{"1min":2.2610000000000001,"5min":21.617000000000001,"15min":9.4890000000000008},"min":{"1min":0.84399999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":7.3159999999999998,"5min":560.41999999999996,"15min":560.41999999999996},"last":2.6360000000000001},{"interface":"front","average":{"1min":2.5630000000000002,"5min":11.353,"15min":10.140000000000001},"min":{"1min":1.107,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":6.1550000000000002,"5min":513.15200000000004,"15min":513.15200000000004},"last":2.8130000000000002}]},{"osd":5,"last update":"Wed Jan 27 09:53:34 2021","interfaces":[{"interface":"back","average":{"1min":2.2040000000000002,"5min":2.0600000000000001,"15min":2.5640000000000001},"min":{"1min":0.85799999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":5.1929999999999996,"5min":5.5910000000000002,"15min":5.5910000000000002},"last":2.5760000000000001},{"interface":"front","average":{"1min":2.4620000000000002,"5min":2.1499999999999999,"15min":2.7280000000000002},"min":{"1min":1.2849999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":5.2889999999999997,"5min":5.2889999999999997,"15min":6.194},"last":2.948}]},{"osd":7,"last update":"Wed Jan 27 09:53:40 2021","interfaces":[{"interface":"back","average":{"1min":2.4670000000000001,"5min":13.202999999999999,"15min":8.9090000000000007},"min":{"1min":1.256,"5min":0.996,"15min":0.996},"max":{"1min":9.5649999999999995,"5min":507.45499999999998,"15min":507.45499999999998},"last":2.851},{"interface":"front","average":{"1min":2.702,"5min":63.426000000000002,"15min":34.991},"min":{"1min":1.248,"5min":1.248,"15min":1.1970000000000001},"max":{"1min":8.9120000000000008,"5min":2702.8879999999999,"15min":2702.8879999999999},"last":2.996}]}]},{"osd":5,"up_from":14,"seq":60129542259,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81160,"kb_used_data":4416,"kb_used_omap":0,"kb_used_meta":76736,"kb_avail":94290680,"statfs":{"total":96636764160,"available":96553656320,"internally_reserved":0,"allocated":4521984,"data_stored":4330196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":78577664},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:53:46 2021","interfaces":[{"interface":"back","average":{"1min":43.249000000000002,"5min":98.941000000000003,"15min":42.506},"min":{"1min":0.97699999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":397.89699999999999,"5min":1057.0899999999999,"15min":2305.5720000000001},"last":1.7829999999999999},{"interface":"front","average":{"1min":20.716000000000001,"5min":123.782,"15min":67.826999999999998},"min":{"1min":0.75800000000000001,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":288.15100000000001,"5min":1931.6790000000001,"15min":2556.7280000000001},"last":1.893}]},{"osd":1,"last update":"Wed Jan 27 09:53:39 2021","interfaces":[{"interface":"back","average":{"1min":3.2810000000000001,"5min":4.2119999999999997,"15min":3.2130000000000001},"min":{"1min":0.73999999999999999,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":15.502000000000001,"5min":240.86600000000001,"15min":240.86600000000001},"last":3.2730000000000001},{"interface":"front","average":{"1min":1.7669999999999999,"5min":4.0650000000000004,"15min":2.9020000000000001},"min":{"1min":0.78500000000000003,"5min":0.65800000000000003,"15min":0.64900000000000002},"max":{"1min":6.3109999999999999,"5min":247.31299999999999,"15min":247.31299999999999},"last":1.861}]},{"osd":2,"last update":"Wed Jan 27 09:53:39 2021","interfaces":[{"interface":"back","average":{"1min":1.976,"5min":3.6349999999999998,"15min":2.8900000000000001},"min":{"1min":0.84299999999999997,"5min":0.749,"15min":0.749},"max":{"1min":4.7649999999999997,"5min":125.51000000000001,"15min":125.51000000000001},"last":2.4089999999999998},{"interface":"front","average":{"1min":2.0289999999999999,"5min":3.661,"15min":2.883},"min":{"1min":0.85299999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":4.2000000000000002,"5min":122.705,"15min":122.705},"last":3.4079999999999999}]},{"osd":3,"last update":"Wed Jan 27 09:53:46 2021","interfaces":[{"interface":"back","average":{"1min":3.657,"5min":165.078,"15min":62.859999999999999},"min":{"1min":1.2270000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":21.655999999999999,"5min":2676.6819999999998,"15min":2676.6819999999998},"last":2.0569999999999999},{"interface":"front","average":{"1min":4.2699999999999996,"5min":155.61699999999999,"15min":94.835999999999999},"min":{"1min":1.2589999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":21.068000000000001,"5min":2676.6190000000001,"15min":2676.6190000000001},"last":3.6139999999999999}]},{"osd":4,"last update":"Wed Jan 27 09:53:39 2021","interfaces":[{"interface":"back","average":{"1min":2.1190000000000002,"5min":5.3929999999999998,"15min":8.2870000000000008},"min":{"1min":0.81599999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":4.1239999999999997,"5min":201.47999999999999,"15min":635.86400000000003},"last":3.0750000000000002},{"interface":"front","average":{"1min":2.4079999999999999,"5min":13.323,"15min":10.824},"min":{"1min":1.01,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":4.202,"5min":352.37599999999998,"15min":525.19600000000003},"last":3.5099999999999998}]},{"osd":6,"last update":"Wed Jan 27 09:53:39 2021","interfaces":[{"interface":"back","average":{"1min":1.9690000000000001,"5min":2.0070000000000001,"15min":2.5510000000000002},"min":{"1min":0.94599999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":3.089,"5min":7.5590000000000002,"15min":7.5590000000000002},"last":2.496},{"interface":"front","average":{"1min":2.3599999999999999,"5min":2.2400000000000002,"15min":2.722},"min":{"1min":0.99099999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":4.0119999999999996,"5min":6.3419999999999996,"15min":6.3419999999999996},"last":3.9569999999999999}]},{"osd":7,"last update":"Wed Jan 27 09:53:39 2021","interfaces":[{"interface":"back","average":{"1min":2.464,"5min":29.141999999999999,"15min":22.472999999999999},"min":{"1min":1.1120000000000001,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":6.3600000000000003,"5min":503.666,"15min":1037.163},"last":2.911},{"interface":"front","average":{"1min":2.4359999999999999,"5min":74.584000000000003,"15min":36.448},"min":{"1min":1.002,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":4.5119999999999996,"5min":1580.106,"15min":1580.106},"last":3.8690000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542258,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":259852,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":259328,"kb_avail":94111988,"statfs":{"total":96636764160,"available":96370675712,"internally_reserved":0,"allocated":528384,"data_stored":342056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":265551872},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:53:42 2021","interfaces":[{"interface":"back","average":{"1min":31.007000000000001,"5min":178.648,"15min":103.289},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":517.53599999999994,"5min":1450.174,"15min":1734.057},"last":1.345},{"interface":"front","average":{"1min":2.8220000000000001,"5min":94.733999999999995,"15min":46.420999999999999},"min":{"1min":0.75800000000000001,"5min":0.68400000000000005,"15min":0.63300000000000001},"max":{"1min":10.228999999999999,"5min":1753.086,"15min":1753.086},"last":1.893}]},{"osd":1,"last update":"Wed Jan 27 09:53:42 2021","interfaces":[{"interface":"back","average":{"1min":3.2989999999999999,"5min":20.617999999999999,"15min":8.4809999999999999},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":17.425999999999998,"5min":637.33699999999999,"15min":637.33699999999999},"last":1.167},{"interface":"front","average":{"1min":3.2549999999999999,"5min":11.847,"15min":13.303000000000001},"min":{"1min":0.85399999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":17.553999999999998,"5min":265.786,"15min":517.21100000000001},"last":1.6819999999999999}]},{"osd":2,"last update":"Wed Jan 27 09:53:42 2021","interfaces":[{"interface":"back","average":{"1min":2.8519999999999999,"5min":9.7720000000000002,"15min":12.708},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":10.388999999999999,"5min":265.935,"15min":517.07500000000005},"last":1.381},{"interface":"front","average":{"1min":2.1179999999999999,"5min":4.0090000000000003,"15min":6.0549999999999997},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":4.7309999999999999,"5min":182.66,"15min":375.03399999999999},"last":1.575}]},{"osd":3,"last update":"Wed Jan 27 09:53:42 2021","interfaces":[{"interface":"back","average":{"1min":7.4020000000000001,"5min":104.36799999999999,"15min":61.338999999999999},"min":{"1min":1.0820000000000001,"5min":0.98899999999999999,"15min":0.97899999999999998},"max":{"1min":87.488,"5min":1265.72,"15min":1265.72},"last":1.0820000000000001},{"interface":"front","average":{"1min":3.8399999999999999,"5min":122.044,"15min":43.006999999999998},"min":{"1min":1.3320000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":15.509,"5min":1872.2360000000001,"15min":1872.2360000000001},"last":1.413}]},{"osd":5,"last update":"Wed Jan 27 09:53:36 2021","interfaces":[{"interface":"back","average":{"1min":2.0600000000000001,"5min":17.367000000000001,"15min":7.6470000000000002},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":3.806,"5min":692.52700000000004,"15min":692.52700000000004},"last":1.8680000000000001},{"interface":"front","average":{"1min":2.3919999999999999,"5min":8.6419999999999995,"15min":12.65},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":4.6980000000000004,"5min":265.64800000000002,"15min":516.92399999999998},"last":2.1379999999999999}]},{"osd":6,"last update":"Wed Jan 27 09:53:36 2021","interfaces":[{"interface":"back","average":{"1min":2.4049999999999998,"5min":9.1620000000000008,"15min":13.222},"min":{"1min":0.86199999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":9.8529999999999998,"5min":265.505,"15min":574.76400000000001},"last":1.8260000000000001},{"interface":"front","average":{"1min":2.7069999999999999,"5min":3.1040000000000001,"15min":6.1660000000000004},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":10.651,"5min":65.150999999999996,"15min":375.23599999999999},"last":1.7729999999999999}]},{"osd":7,"last update":"Wed Jan 27 09:53:36 2021","interfaces":[{"interface":"back","average":{"1min":3.1040000000000001,"5min":27.786999999999999,"15min":19.928999999999998},"min":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":10.367000000000001,"5min":563.33299999999997,"15min":738.697},"last":2.0019999999999998},{"interface":"front","average":{"1min":3.169,"5min":43.103999999999999,"15min":35.25},"min":{"1min":1.0620000000000001,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":10.523,"5min":1411.2909999999999,"15min":2337.453},"last":1.6259999999999999}]}]}]}} 2021-01-27T09:53:49.131 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2021-01-27T09:44:24.550437+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=24, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:49.131 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2021-01-27T09:44:27.897533+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=27, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:49.131 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2021-01-27T09:44:32.342881+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=32, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:49.132 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2021-01-27T09:44:24.550437+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=24, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:49.132 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2021-01-27T09:44:27.897533+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=27, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:49.132 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2021-01-27T09:44:28.901960+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=28, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:49.133 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2021-01-27T09:44:32.342881+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=32, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:49.133 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2021-01-27T09:44:24.550437+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=24, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:49.133 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2021-01-27T09:44:28.901960+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=28, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:49.134 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2021-01-27T09:44:32.342881+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=32, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:49.134 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2021-01-27T09:44:24.550437+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=24, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:49.135 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2021-01-27T09:44:28.901960+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=28, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:49.135 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2021-01-27T09:44:28.901960+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=28, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:49.135 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2021-01-27T09:44:32.342881+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=32, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:49.136 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2021-01-27T09:44:28.901960+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=28, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:49.136 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2021-01-27T09:44:27.897533+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=27, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:49.136 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2021-01-27T09:44:24.550437+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=24, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:49.137 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2021-01-27T09:44:28.901960+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=44, tm_sec=28, tm_wday=2, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=27, tm_hour=9, tm_min=53, tm_sec=18, tm_wday=2, tm_yday=27, tm_isdst=0) 2021-01-27T09:53:49.137 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2021-01-27T09:54:09.138 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-01-27T09:54:09.306 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.301+0000 7f66dd0c1700 1 Processor -- start 2021-01-27T09:54:09.306 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.301+0000 7f66dd0c1700 1 -- start start 2021-01-27T09:54:09.308 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.301+0000 7f66dd0c1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f66d80b8230 0x7f66d814eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:09.308 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.301+0000 7f66dd0c1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66d80b8610 0x7f66d80b9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:09.308 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.301+0000 7f66dd0c1700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f66d80be0d0 0x7f66d80be560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:09.308 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.301+0000 7f66dd0c1700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d80ba700 con 0x7f66d80be0d0 2021-01-27T09:54:09.309 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.301+0000 7f66dd0c1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d814f020 con 0x7f66d80b8230 2021-01-27T09:54:09.309 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.301+0000 7f66dd0c1700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d8066280 con 0x7f66d80b8610 2021-01-27T09:54:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.301+0000 7f66ce59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66d80b8610 0x7f66d80b9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.301+0000 7f66ce59c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66d80b8610 0x7f66d80b9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:45202/0 (socket says 172.21.15.146:45202) 2021-01-27T09:54:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.301+0000 7f66ce59c700 1 -- 172.21.15.146:0/1349011651 learned_addr learned my addr 172.21.15.146:0/1349011651 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:54:09.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.301+0000 7f66d6d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f66d80b8230 0x7f66d814eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:09.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.301+0000 7f66d759e700 1 --2- 172.21.15.146:0/1349011651 >> v2:172.21.15.78:3300/0 conn(0x7f66d80be0d0 0x7f66d80be560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:09.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.305+0000 7f66ce59c700 1 -- 172.21.15.146:0/1349011651 >> v2:172.21.15.146:3300/0 conn(0x7f66d80b8230 msgr2=0x7f66d814eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:54:09.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.305+0000 7f66ce59c700 1 --2- 172.21.15.146:0/1349011651 >> v2:172.21.15.146:3300/0 conn(0x7f66d80b8230 0x7f66d814eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:09.311 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.305+0000 7f66ce59c700 1 -- 172.21.15.146:0/1349011651 >> v2:172.21.15.78:3300/0 conn(0x7f66d80be0d0 msgr2=0x7f66d80be560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:54:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.305+0000 7f66ce59c700 1 --2- 172.21.15.146:0/1349011651 >> v2:172.21.15.78:3300/0 conn(0x7f66d80be0d0 0x7f66d80be560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.305+0000 7f66ce59c700 1 -- 172.21.15.146:0/1349011651 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d814acd0 con 0x7f66d80b8610 2021-01-27T09:54:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.305+0000 7f66ce59c700 1 --2- 172.21.15.146:0/1349011651 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66d80b8610 0x7f66d80b9f20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f66d80bdd80 tx=0x7f66c0006f70).ready entity=mon.2 client_cookie=d12db4c15ab8ab7d server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:09.313 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.305+0000 7f66d659c700 1 -- 172.21.15.146:0/1349011651 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c000dbb0 con 0x7f66d80b8610 2021-01-27T09:54:09.313 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.305+0000 7f66d659c700 1 -- 172.21.15.146:0/1349011651 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c000dd10 con 0x7f66d80b8610 2021-01-27T09:54:09.313 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.305+0000 7f66d659c700 1 -- 172.21.15.146:0/1349011651 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c0010680 con 0x7f66d80b8610 2021-01-27T09:54:09.314 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.305+0000 7f66dd0c1700 1 -- 172.21.15.146:0/1349011651 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66d80b8610 msgr2=0x7f66d80b9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:09.314 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.305+0000 7f66dd0c1700 1 --2- 172.21.15.146:0/1349011651 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66d80b8610 0x7f66d80b9f20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f66d80bdd80 tx=0x7f66c0006f70).stop 2021-01-27T09:54:09.314 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.305+0000 7f66dd0c1700 1 -- 172.21.15.146:0/1349011651 shutdown_connections 2021-01-27T09:54:09.314 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.305+0000 7f66dd0c1700 1 --2- 172.21.15.146:0/1349011651 >> v2:172.21.15.78:3300/0 conn(0x7f66d80be0d0 0x7f66d80be560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.305+0000 7f66dd0c1700 1 --2- 172.21.15.146:0/1349011651 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66d80b8610 0x7f66d80b9f20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.305+0000 7f66dd0c1700 1 --2- 172.21.15.146:0/1349011651 >> v2:172.21.15.146:3300/0 conn(0x7f66d80b8230 0x7f66d814eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.305+0000 7f66dd0c1700 1 -- 172.21.15.146:0/1349011651 >> 172.21.15.146:0/1349011651 conn(0x7f66d8069110 msgr2=0x7f66d8067e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:54:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.305+0000 7f66dd0c1700 1 -- 172.21.15.146:0/1349011651 shutdown_connections 2021-01-27T09:54:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.305+0000 7f66dd0c1700 1 -- 172.21.15.146:0/1349011651 wait complete. 2021-01-27T09:54:09.317 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.309+0000 7f66dd0c1700 1 Processor -- start 2021-01-27T09:54:09.317 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.309+0000 7f66dd0c1700 1 -- start start 2021-01-27T09:54:09.317 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.309+0000 7f66dd0c1700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66d80b8230 0x7f66d80649d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:09.318 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.309+0000 7f66dd0c1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d80be0d0 0x7f66d8066620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:09.318 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.309+0000 7f66dd0c1700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66d813f270 0x7f66d813f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:09.318 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.309+0000 7f66dd0c1700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d81416d0 con 0x7f66d813f270 2021-01-27T09:54:09.318 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.309+0000 7f66dd0c1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d815d8e0 con 0x7f66d80be0d0 2021-01-27T09:54:09.319 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.309+0000 7f66dd0c1700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d815db80 con 0x7f66d80b8230 2021-01-27T09:54:09.319 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.309+0000 7f66d6d9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66d80b8230 0x7f66d80649d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:09.319 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.309+0000 7f66ce59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d80be0d0 0x7f66d8066620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:09.319 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.309+0000 7f66d6d9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66d80b8230 0x7f66d80649d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:45208/0 (socket says 172.21.15.146:45208) 2021-01-27T09:54:09.319 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.309+0000 7f66d6d9d700 1 -- 172.21.15.146:0/4004260045 learned_addr learned my addr 172.21.15.146:0/4004260045 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:54:09.320 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.309+0000 7f66d759e700 1 --2- 172.21.15.146:0/4004260045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66d813f270 0x7f66d813f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:09.320 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.309+0000 7f66ce59c700 1 -- 172.21.15.146:0/4004260045 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66d80b8230 msgr2=0x7f66d80649d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:09.320 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.309+0000 7f66ce59c700 1 --2- 172.21.15.146:0/4004260045 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66d80b8230 0x7f66d80649d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:09.320 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.309+0000 7f66ce59c700 1 -- 172.21.15.146:0/4004260045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66d813f270 msgr2=0x7f66d813f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:09.320 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.309+0000 7f66ce59c700 1 --2- 172.21.15.146:0/4004260045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66d813f270 0x7f66d813f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:09.321 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.309+0000 7f66ce59c700 1 -- 172.21.15.146:0/4004260045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d815de20 con 0x7f66d80be0d0 2021-01-27T09:54:09.321 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.309+0000 7f66ce59c700 1 --2- 172.21.15.146:0/4004260045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d80be0d0 0x7f66d8066620 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f66c0016000 tx=0x7f66d80b9e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:09.321 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.309+0000 7f66cf7fe700 1 -- 172.21.15.146:0/4004260045 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c0019660 con 0x7f66d80be0d0 2021-01-27T09:54:09.321 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.309+0000 7f66cf7fe700 1 -- 172.21.15.146:0/4004260045 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c00197c0 con 0x7f66d80be0d0 2021-01-27T09:54:09.321 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.313+0000 7f66cf7fe700 1 -- 172.21.15.146:0/4004260045 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c0019b40 con 0x7f66d80be0d0 2021-01-27T09:54:09.322 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.313+0000 7f66dd0c1700 1 -- 172.21.15.146:0/4004260045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d815e0c0 con 0x7f66d80be0d0 2021-01-27T09:54:09.322 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.313+0000 7f66dd0c1700 1 -- 172.21.15.146:0/4004260045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d815e600 con 0x7f66d80be0d0 2021-01-27T09:54:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.313+0000 7f66dd0c1700 1 -- 172.21.15.146:0/4004260045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d8044ee0 con 0x7f66d80be0d0 2021-01-27T09:54:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.313+0000 7f66cf7fe700 1 -- 172.21.15.146:0/4004260045 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f66c0016030 con 0x7f66d80be0d0 2021-01-27T09:54:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.313+0000 7f66cf7fe700 1 --2- 172.21.15.146:0/4004260045 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f66bc0561e0 0x7f66bc0586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:09.324 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.313+0000 7f66cf7fe700 1 -- 172.21.15.146:0/4004260045 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7f66c00702e0 con 0x7f66d80be0d0 2021-01-27T09:54:09.324 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.313+0000 7f66d6d9d700 1 --2- 172.21.15.146:0/4004260045 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f66bc0561e0 0x7f66bc0586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:09.324 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.317+0000 7f66d6d9d700 1 --2- 172.21.15.146:0/4004260045 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f66bc0561e0 0x7f66bc0586a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f66c8009ef0 tx=0x7f66c8009220).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:09.327 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.321+0000 7f66cf7fe700 1 -- 172.21.15.146:0/4004260045 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f66c0045890 con 0x7f66d80be0d0 2021-01-27T09:54:09.466 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.461+0000 7f66dd0c1700 1 -- 172.21.15.146:0/4004260045 --> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f66d805c870 con 0x7f66bc0561e0 2021-01-27T09:54:09.478 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.473+0000 7f66cf7fe700 1 -- 172.21.15.146:0/4004260045 <== mgr.4104 v2:172.21.15.78:6832/15486 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+125504 (secure 0 0 0) 0x7f66d805c870 con 0x7f66bc0561e0 2021-01-27T09:54:09.479 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:54:09.484 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.477+0000 7f66dd0c1700 1 -- 172.21.15.146:0/4004260045 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f66bc0561e0 msgr2=0x7f66bc0586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:09.484 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.477+0000 7f66dd0c1700 1 --2- 172.21.15.146:0/4004260045 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f66bc0561e0 0x7f66bc0586a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f66c8009ef0 tx=0x7f66c8009220).stop 2021-01-27T09:54:09.484 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.477+0000 7f66dd0c1700 1 -- 172.21.15.146:0/4004260045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d80be0d0 msgr2=0x7f66d8066620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:09.484 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.477+0000 7f66dd0c1700 1 --2- 172.21.15.146:0/4004260045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d80be0d0 0x7f66d8066620 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f66c0016000 tx=0x7f66d80b9e40).stop 2021-01-27T09:54:09.485 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.477+0000 7f66dd0c1700 1 -- 172.21.15.146:0/4004260045 shutdown_connections 2021-01-27T09:54:09.485 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.477+0000 7f66dd0c1700 1 --2- 172.21.15.146:0/4004260045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66d813f270 0x7f66d813f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:09.486 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.477+0000 7f66dd0c1700 1 --2- 172.21.15.146:0/4004260045 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f66bc0561e0 0x7f66bc0586a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:09.486 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.477+0000 7f66dd0c1700 1 --2- 172.21.15.146:0/4004260045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d80be0d0 0x7f66d8066620 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:09.486 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.477+0000 7f66dd0c1700 1 --2- 172.21.15.146:0/4004260045 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66d80b8230 0x7f66d80649d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:09.486 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.477+0000 7f66dd0c1700 1 -- 172.21.15.146:0/4004260045 >> 172.21.15.146:0/4004260045 conn(0x7f66d8069110 msgr2=0x7f66d81489f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:54:09.487 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.477+0000 7f66dd0c1700 1 -- 172.21.15.146:0/4004260045 shutdown_connections 2021-01-27T09:54:09.487 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.477+0000 7f66dd0c1700 1 -- 172.21.15.146:0/4004260045 wait complete. 2021-01-27T09:54:09.488 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2021-01-27T09:54:09.511 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2021-01-27T09:54:08.610061+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7725921,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":335,"num_read_kb":6083,"num_write":735387,"num_write_kb":17294920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":40822,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57738,"ondisk_log_size":57738,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2094428,"kb_used_data":17628,"kb_used_omap":0,"kb_used_meta":2076736,"kb_avail":752880292,"statfs":{"total":773094113280,"available":770949419008,"internally_reserved":0,"allocated":18051072,"data_stored":16526140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2126577664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":68,"apply_latency_ms":68,"commit_latency_ns":68000000,"apply_latency_ns":68000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003626"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"24","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:59.177398+0000","last_change":"2021-01-27T09:53:59.177398+0000","last_active":"2021-01-27T09:53:59.177398+0000","last_peered":"2021-01-27T09:53:59.177398+0000","last_clean":"2021-01-27T09:53:59.177398+0000","last_became_active":"2021-01-27T09:44:26.437402+0000","last_became_peered":"2021-01-27T09:44:26.437402+0000","last_unstale":"2021-01-27T09:53:59.177398+0000","last_undegraded":"2021-01-27T09:53:59.177398+0000","last_fullsized":"2021-01-27T09:53:59.177398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:53:59.177144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:53:59.177144+0000","last_clean_scrub_stamp":"2021-01-27T09:53:59.177144+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"29'65","reported_seq":"91","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:50.476198+0000","last_change":"2021-01-27T09:53:50.476198+0000","last_active":"2021-01-27T09:53:50.476198+0000","last_peered":"2021-01-27T09:53:50.476198+0000","last_clean":"2021-01-27T09:53:50.476198+0000","last_became_active":"2021-01-27T09:44:28.931347+0000","last_became_peered":"2021-01-27T09:44:28.931347+0000","last_unstale":"2021-01-27T09:53:50.476198+0000","last_undegraded":"2021-01-27T09:53:50.476198+0000","last_fullsized":"2021-01-27T09:53:50.476198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'65","last_scrub_stamp":"2021-01-27T09:53:50.476040+0000","last_deep_scrub":"29'65","last_deep_scrub_stamp":"2021-01-27T09:53:50.476040+0000","last_clean_scrub_stamp":"2021-01-27T09:53:50.476040+0000","log_size":65,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":13,"num_write":109,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"29'52","reported_seq":"72","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:43.817219+0000","last_change":"2021-01-27T09:53:43.817219+0000","last_active":"2021-01-27T09:53:43.817219+0000","last_peered":"2021-01-27T09:53:43.817219+0000","last_clean":"2021-01-27T09:53:43.817219+0000","last_became_active":"2021-01-27T09:44:29.336207+0000","last_became_peered":"2021-01-27T09:44:29.336207+0000","last_unstale":"2021-01-27T09:53:43.817219+0000","last_undegraded":"2021-01-27T09:53:43.817219+0000","last_fullsized":"2021-01-27T09:53:43.817219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'52","last_scrub_stamp":"2021-01-27T09:53:43.817089+0000","last_deep_scrub":"29'52","last_deep_scrub_stamp":"2021-01-27T09:53:43.817089+0000","last_clean_scrub_stamp":"2021-01-27T09:53:43.817089+0000","log_size":52,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"29'6763","reported_seq":"6800","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:57.850516+0000","last_change":"2021-01-27T09:53:57.850516+0000","last_active":"2021-01-27T09:53:57.850516+0000","last_peered":"2021-01-27T09:53:57.850516+0000","last_clean":"2021-01-27T09:53:57.850516+0000","last_became_active":"2021-01-27T09:44:33.380037+0000","last_became_peered":"2021-01-27T09:44:33.380037+0000","last_unstale":"2021-01-27T09:53:57.850516+0000","last_undegraded":"2021-01-27T09:53:57.850516+0000","last_fullsized":"2021-01-27T09:53:57.850516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6763","last_scrub_stamp":"2021-01-27T09:53:57.850379+0000","last_deep_scrub":"29'6763","last_deep_scrub_stamp":"2021-01-27T09:53:57.850379+0000","last_clean_scrub_stamp":"2021-01-27T09:53:57.850379+0000","log_size":6763,"ondisk_log_size":6763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":90410,"num_write_kb":2139720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"39","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:45.412642+0000","last_change":"2021-01-27T09:53:45.412642+0000","last_active":"2021-01-27T09:53:45.412642+0000","last_peered":"2021-01-27T09:53:45.412642+0000","last_clean":"2021-01-27T09:53:45.412642+0000","last_became_active":"2021-01-27T09:44:26.435467+0000","last_became_peered":"2021-01-27T09:44:26.435467+0000","last_unstale":"2021-01-27T09:53:45.412642+0000","last_undegraded":"2021-01-27T09:53:45.412642+0000","last_fullsized":"2021-01-27T09:53:45.412642+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:53:45.412437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:53:45.412437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'91","reported_seq":"123","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:51.603446+0000","last_change":"2021-01-27T09:53:51.603446+0000","last_active":"2021-01-27T09:53:51.603446+0000","last_peered":"2021-01-27T09:53:51.603446+0000","last_clean":"2021-01-27T09:53:51.603446+0000","last_became_active":"2021-01-27T09:44:28.933897+0000","last_became_peered":"2021-01-27T09:44:28.933897+0000","last_unstale":"2021-01-27T09:53:51.603446+0000","last_undegraded":"2021-01-27T09:53:51.603446+0000","last_fullsized":"2021-01-27T09:53:51.603446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'91","last_scrub_stamp":"2021-01-27T09:53:51.603306+0000","last_deep_scrub":"29'91","last_deep_scrub_stamp":"2021-01-27T09:53:51.603306+0000","last_clean_scrub_stamp":"2021-01-27T09:53:51.603306+0000","log_size":91,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":666,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":24,"num_read_kb":26,"num_write":114,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'57","reported_seq":"78","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:52.671759+0000","last_change":"2021-01-27T09:53:52.671759+0000","last_active":"2021-01-27T09:53:52.671759+0000","last_peered":"2021-01-27T09:53:52.671759+0000","last_clean":"2021-01-27T09:53:52.671759+0000","last_became_active":"2021-01-27T09:44:29.341016+0000","last_became_peered":"2021-01-27T09:44:29.341016+0000","last_unstale":"2021-01-27T09:53:52.671759+0000","last_undegraded":"2021-01-27T09:53:52.671759+0000","last_fullsized":"2021-01-27T09:53:52.671759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'57","last_scrub_stamp":"2021-01-27T09:53:52.671633+0000","last_deep_scrub":"29'57","last_deep_scrub_stamp":"2021-01-27T09:53:52.671633+0000","last_clean_scrub_stamp":"2021-01-27T09:53:52.671633+0000","log_size":57,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"29'7566","reported_seq":"7619","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:54:03.625298+0000","last_change":"2021-01-27T09:54:03.625298+0000","last_active":"2021-01-27T09:54:03.625298+0000","last_peered":"2021-01-27T09:54:03.625298+0000","last_clean":"2021-01-27T09:54:03.625298+0000","last_became_active":"2021-01-27T09:44:33.377285+0000","last_became_peered":"2021-01-27T09:44:33.377285+0000","last_unstale":"2021-01-27T09:54:03.625298+0000","last_undegraded":"2021-01-27T09:54:03.625298+0000","last_fullsized":"2021-01-27T09:54:03.625298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7566","last_scrub_stamp":"2021-01-27T09:54:03.625176+0000","last_deep_scrub":"29'7566","last_deep_scrub_stamp":"2021-01-27T09:54:03.625176+0000","last_clean_scrub_stamp":"2021-01-27T09:54:03.625176+0000","log_size":7566,"ondisk_log_size":7566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":100950,"num_write_kb":2356202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"24","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:53.239141+0000","last_change":"2021-01-27T09:53:53.239141+0000","last_active":"2021-01-27T09:53:53.239141+0000","last_peered":"2021-01-27T09:53:53.239141+0000","last_clean":"2021-01-27T09:53:53.239141+0000","last_became_active":"2021-01-27T09:44:25.840711+0000","last_became_peered":"2021-01-27T09:44:25.840711+0000","last_unstale":"2021-01-27T09:53:53.239141+0000","last_undegraded":"2021-01-27T09:53:53.239141+0000","last_fullsized":"2021-01-27T09:53:53.239141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:53:53.238960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:53:53.238960+0000","last_clean_scrub_stamp":"2021-01-27T09:53:53.238960+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'912","reported_seq":"943","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:44.246292+0000","last_change":"2021-01-27T09:53:44.246292+0000","last_active":"2021-01-27T09:53:44.246292+0000","last_peered":"2021-01-27T09:53:44.246292+0000","last_clean":"2021-01-27T09:53:44.246292+0000","last_became_active":"2021-01-27T09:44:28.932513+0000","last_became_peered":"2021-01-27T09:44:28.932513+0000","last_unstale":"2021-01-27T09:53:44.246292+0000","last_undegraded":"2021-01-27T09:53:44.246292+0000","last_fullsized":"2021-01-27T09:53:44.246292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'912","last_scrub_stamp":"2021-01-27T09:53:44.246125+0000","last_deep_scrub":"29'912","last_deep_scrub_stamp":"2021-01-27T09:53:44.246125+0000","last_clean_scrub_stamp":"2021-01-27T09:53:44.246125+0000","log_size":912,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4195502,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":17,"num_read_kb":4112,"num_write":906,"num_write_kb":4328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"29'59","reported_seq":"80","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:50.340063+0000","last_change":"2021-01-27T09:53:50.340063+0000","last_active":"2021-01-27T09:53:50.340063+0000","last_peered":"2021-01-27T09:53:50.340063+0000","last_clean":"2021-01-27T09:53:50.340063+0000","last_became_active":"2021-01-27T09:44:29.350179+0000","last_became_peered":"2021-01-27T09:44:29.350179+0000","last_unstale":"2021-01-27T09:53:50.340063+0000","last_undegraded":"2021-01-27T09:53:50.340063+0000","last_fullsized":"2021-01-27T09:53:50.340063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'59","last_scrub_stamp":"2021-01-27T09:53:50.339955+0000","last_deep_scrub":"29'59","last_deep_scrub_stamp":"2021-01-27T09:53:50.339955+0000","last_clean_scrub_stamp":"2021-01-27T09:53:50.339955+0000","log_size":59,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"29'6970","reported_seq":"7009","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:43.909174+0000","last_change":"2021-01-27T09:53:38.870166+0000","last_active":"2021-01-27T09:53:43.909174+0000","last_peered":"2021-01-27T09:53:43.909174+0000","last_clean":"2021-01-27T09:53:43.909174+0000","last_became_active":"2021-01-27T09:44:33.439809+0000","last_became_peered":"2021-01-27T09:44:33.439809+0000","last_unstale":"2021-01-27T09:53:43.909174+0000","last_undegraded":"2021-01-27T09:53:43.909174+0000","last_fullsized":"2021-01-27T09:53:43.909174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6921","last_scrub_stamp":"2021-01-27T09:53:38.870038+0000","last_deep_scrub":"29'6921","last_deep_scrub_stamp":"2021-01-27T09:53:38.870038+0000","last_clean_scrub_stamp":"2021-01-27T09:53:38.870038+0000","log_size":6970,"ondisk_log_size":6970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":92360,"num_write_kb":2198460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"25","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:39.174731+0000","last_change":"2021-01-27T09:53:39.174731+0000","last_active":"2021-01-27T09:53:39.174731+0000","last_peered":"2021-01-27T09:53:39.174731+0000","last_clean":"2021-01-27T09:53:39.174731+0000","last_became_active":"2021-01-27T09:44:26.403537+0000","last_became_peered":"2021-01-27T09:44:26.403537+0000","last_unstale":"2021-01-27T09:53:39.174731+0000","last_undegraded":"2021-01-27T09:53:39.174731+0000","last_fullsized":"2021-01-27T09:53:39.174731+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:53:39.174584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:53:39.174584+0000","last_clean_scrub_stamp":"2021-01-27T09:53:39.174584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"29'35","reported_seq":"62","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:41.757902+0000","last_change":"2021-01-27T09:53:41.757902+0000","last_active":"2021-01-27T09:53:41.757902+0000","last_peered":"2021-01-27T09:53:41.757902+0000","last_clean":"2021-01-27T09:53:41.757902+0000","last_became_active":"2021-01-27T09:44:28.932127+0000","last_became_peered":"2021-01-27T09:44:28.932127+0000","last_unstale":"2021-01-27T09:53:41.757902+0000","last_undegraded":"2021-01-27T09:53:41.757902+0000","last_fullsized":"2021-01-27T09:53:41.757902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2021-01-27T09:53:41.757781+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2021-01-27T09:53:41.757781+0000","last_clean_scrub_stamp":"2021-01-27T09:53:41.757781+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":736,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":14,"num_read_kb":20,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"29'62","reported_seq":"83","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:46.307368+0000","last_change":"2021-01-27T09:53:46.307368+0000","last_active":"2021-01-27T09:53:46.307368+0000","last_peered":"2021-01-27T09:53:46.307368+0000","last_clean":"2021-01-27T09:53:46.307368+0000","last_became_active":"2021-01-27T09:44:29.337813+0000","last_became_peered":"2021-01-27T09:44:29.337813+0000","last_unstale":"2021-01-27T09:53:46.307368+0000","last_undegraded":"2021-01-27T09:53:46.307368+0000","last_fullsized":"2021-01-27T09:53:46.307368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'62","last_scrub_stamp":"2021-01-27T09:53:46.307255+0000","last_deep_scrub":"29'62","last_deep_scrub_stamp":"2021-01-27T09:53:46.307255+0000","last_clean_scrub_stamp":"2021-01-27T09:53:46.307255+0000","log_size":62,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"29'7234","reported_seq":"7276","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:54:00.672668+0000","last_change":"2021-01-27T09:54:00.672668+0000","last_active":"2021-01-27T09:54:00.672668+0000","last_peered":"2021-01-27T09:54:00.672668+0000","last_clean":"2021-01-27T09:54:00.672668+0000","last_became_active":"2021-01-27T09:44:33.440410+0000","last_became_peered":"2021-01-27T09:44:33.440410+0000","last_unstale":"2021-01-27T09:54:00.672668+0000","last_undegraded":"2021-01-27T09:54:00.672668+0000","last_fullsized":"2021-01-27T09:54:00.672668+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7234","last_scrub_stamp":"2021-01-27T09:54:00.672499+0000","last_deep_scrub":"29'7234","last_deep_scrub_stamp":"2021-01-27T09:54:00.672499+0000","last_clean_scrub_stamp":"2021-01-27T09:54:00.672499+0000","log_size":7234,"ondisk_log_size":7234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":96121,"num_write_kb":2240389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"29'6738","reported_seq":"6779","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:44.763794+0000","last_change":"2021-01-27T09:53:44.763794+0000","last_active":"2021-01-27T09:53:44.763794+0000","last_peered":"2021-01-27T09:53:44.763794+0000","last_clean":"2021-01-27T09:53:44.763794+0000","last_became_active":"2021-01-27T09:44:33.440377+0000","last_became_peered":"2021-01-27T09:44:33.440377+0000","last_unstale":"2021-01-27T09:53:44.763794+0000","last_undegraded":"2021-01-27T09:53:44.763794+0000","last_fullsized":"2021-01-27T09:53:44.763794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6738","last_scrub_stamp":"2021-01-27T09:53:44.763662+0000","last_deep_scrub":"29'6738","last_deep_scrub_stamp":"2021-01-27T09:53:44.763662+0000","last_clean_scrub_stamp":"2021-01-27T09:53:44.763662+0000","log_size":6738,"ondisk_log_size":6738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":89749,"num_write_kb":2125206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"29'773","reported_seq":"803","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:41.391878+0000","last_change":"2021-01-27T09:53:20.555476+0000","last_active":"2021-01-27T09:53:41.391878+0000","last_peered":"2021-01-27T09:53:41.391878+0000","last_clean":"2021-01-27T09:53:41.391878+0000","last_became_active":"2021-01-27T09:44:28.928444+0000","last_became_peered":"2021-01-27T09:44:28.928444+0000","last_unstale":"2021-01-27T09:53:41.391878+0000","last_undegraded":"2021-01-27T09:53:41.391878+0000","last_fullsized":"2021-01-27T09:53:41.391878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'769","last_scrub_stamp":"2021-01-27T09:53:20.555294+0000","last_deep_scrub":"29'769","last_deep_scrub_stamp":"2021-01-27T09:53:20.555294+0000","last_clean_scrub_stamp":"2021-01-27T09:53:20.555294+0000","log_size":773,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2924759,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":16,"num_read_kb":1577,"num_write":757,"num_write_kb":3111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":26088,"num_omap_keys":52,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"24","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:48.121412+0000","last_change":"2021-01-27T09:53:48.121412+0000","last_active":"2021-01-27T09:53:48.121412+0000","last_peered":"2021-01-27T09:53:48.121412+0000","last_clean":"2021-01-27T09:53:48.121412+0000","last_became_active":"2021-01-27T09:44:26.403137+0000","last_became_peered":"2021-01-27T09:44:26.403137+0000","last_unstale":"2021-01-27T09:53:48.121412+0000","last_undegraded":"2021-01-27T09:53:48.121412+0000","last_fullsized":"2021-01-27T09:53:48.121412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:53:48.121283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:53:48.121283+0000","last_clean_scrub_stamp":"2021-01-27T09:53:48.121283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'52","reported_seq":"73","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:51.278531+0000","last_change":"2021-01-27T09:53:51.278531+0000","last_active":"2021-01-27T09:53:51.278531+0000","last_peered":"2021-01-27T09:53:51.278531+0000","last_clean":"2021-01-27T09:53:51.278531+0000","last_became_active":"2021-01-27T09:44:29.347463+0000","last_became_peered":"2021-01-27T09:44:29.347463+0000","last_unstale":"2021-01-27T09:53:51.278531+0000","last_undegraded":"2021-01-27T09:53:51.278531+0000","last_fullsized":"2021-01-27T09:53:51.278531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'52","last_scrub_stamp":"2021-01-27T09:53:51.278420+0000","last_deep_scrub":"29'52","last_deep_scrub_stamp":"2021-01-27T09:53:51.278420+0000","last_clean_scrub_stamp":"2021-01-27T09:53:51.278420+0000","log_size":52,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"29'6720","reported_seq":"6756","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:46.790247+0000","last_change":"2021-01-27T09:53:46.790247+0000","last_active":"2021-01-27T09:53:46.790247+0000","last_peered":"2021-01-27T09:53:46.790247+0000","last_clean":"2021-01-27T09:53:46.790247+0000","last_became_active":"2021-01-27T09:44:33.440172+0000","last_became_peered":"2021-01-27T09:44:33.440172+0000","last_unstale":"2021-01-27T09:53:46.790247+0000","last_undegraded":"2021-01-27T09:53:46.790247+0000","last_fullsized":"2021-01-27T09:53:46.790247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6720","last_scrub_stamp":"2021-01-27T09:53:46.790136+0000","last_deep_scrub":"29'6720","last_deep_scrub_stamp":"2021-01-27T09:53:46.790136+0000","last_clean_scrub_stamp":"2021-01-27T09:53:46.790136+0000","log_size":6720,"ondisk_log_size":6720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":88875,"num_write_kb":2080841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"29'30","reported_seq":"66","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:45.104194+0000","last_change":"2021-01-27T09:53:45.104194+0000","last_active":"2021-01-27T09:53:45.104194+0000","last_peered":"2021-01-27T09:53:45.104194+0000","last_clean":"2021-01-27T09:53:45.104194+0000","last_became_active":"2021-01-27T09:44:28.930374+0000","last_became_peered":"2021-01-27T09:44:28.930374+0000","last_unstale":"2021-01-27T09:53:45.104194+0000","last_undegraded":"2021-01-27T09:53:45.104194+0000","last_fullsized":"2021-01-27T09:53:45.104194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2021-01-27T09:53:45.103992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:53:45.103992+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":112,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":32,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"25","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:43.439770+0000","last_change":"2021-01-27T09:53:43.439770+0000","last_active":"2021-01-27T09:53:43.439770+0000","last_peered":"2021-01-27T09:53:43.439770+0000","last_clean":"2021-01-27T09:53:43.439770+0000","last_became_active":"2021-01-27T09:44:25.838635+0000","last_became_peered":"2021-01-27T09:44:25.838635+0000","last_unstale":"2021-01-27T09:53:43.439770+0000","last_undegraded":"2021-01-27T09:53:43.439770+0000","last_fullsized":"2021-01-27T09:53:43.439770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:53:43.439518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:53:43.439518+0000","last_clean_scrub_stamp":"2021-01-27T09:53:43.439518+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'56","reported_seq":"77","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:52.395026+0000","last_change":"2021-01-27T09:53:52.395026+0000","last_active":"2021-01-27T09:53:52.395026+0000","last_peered":"2021-01-27T09:53:52.395026+0000","last_clean":"2021-01-27T09:53:52.395026+0000","last_became_active":"2021-01-27T09:44:29.347905+0000","last_became_peered":"2021-01-27T09:44:29.347905+0000","last_unstale":"2021-01-27T09:53:52.395026+0000","last_undegraded":"2021-01-27T09:53:52.395026+0000","last_fullsized":"2021-01-27T09:53:52.395026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'56","last_scrub_stamp":"2021-01-27T09:53:52.394915+0000","last_deep_scrub":"29'56","last_deep_scrub_stamp":"2021-01-27T09:53:52.394915+0000","last_clean_scrub_stamp":"2021-01-27T09:53:52.394915+0000","log_size":56,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"29'6658","reported_seq":"6695","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:54:04.481071+0000","last_change":"2021-01-27T09:54:04.481071+0000","last_active":"2021-01-27T09:54:04.481071+0000","last_peered":"2021-01-27T09:54:04.481071+0000","last_clean":"2021-01-27T09:54:04.481071+0000","last_became_active":"2021-01-27T09:44:33.376984+0000","last_became_peered":"2021-01-27T09:44:33.376984+0000","last_unstale":"2021-01-27T09:54:04.481071+0000","last_undegraded":"2021-01-27T09:54:04.481071+0000","last_fullsized":"2021-01-27T09:54:04.481071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6658","last_scrub_stamp":"2021-01-27T09:54:04.480961+0000","last_deep_scrub":"29'6658","last_deep_scrub_stamp":"2021-01-27T09:54:04.480961+0000","last_clean_scrub_stamp":"2021-01-27T09:54:04.480961+0000","log_size":6658,"ondisk_log_size":6658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":88504,"num_write_kb":2116621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'205","reported_seq":"272","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:41.391666+0000","last_change":"2021-01-27T09:53:39.234228+0000","last_active":"2021-01-27T09:53:41.391666+0000","last_peered":"2021-01-27T09:53:41.391666+0000","last_clean":"2021-01-27T09:53:41.391666+0000","last_became_active":"2021-01-27T09:44:28.932701+0000","last_became_peered":"2021-01-27T09:44:28.932701+0000","last_unstale":"2021-01-27T09:53:41.391666+0000","last_undegraded":"2021-01-27T09:53:41.391666+0000","last_fullsized":"2021-01-27T09:53:41.391666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'200","last_scrub_stamp":"2021-01-27T09:53:39.234148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:27.897533+0000","last_clean_scrub_stamp":"2021-01-27T09:53:39.234148+0000","log_size":205,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":598042,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":41,"num_read_kb":295,"num_write":200,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"38","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:45.148263+0000","last_change":"2021-01-27T09:53:45.148263+0000","last_active":"2021-01-27T09:53:45.148263+0000","last_peered":"2021-01-27T09:53:45.148263+0000","last_clean":"2021-01-27T09:53:45.148263+0000","last_became_active":"2021-01-27T09:44:25.736516+0000","last_became_peered":"2021-01-27T09:44:25.736516+0000","last_unstale":"2021-01-27T09:53:45.148263+0000","last_undegraded":"2021-01-27T09:53:45.148263+0000","last_fullsized":"2021-01-27T09:53:45.148263+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:53:45.148009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:44:24.550437+0000","last_clean_scrub_stamp":"2021-01-27T09:53:45.148009+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'63","reported_seq":"84","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:49.185224+0000","last_change":"2021-01-27T09:53:49.185224+0000","last_active":"2021-01-27T09:53:49.185224+0000","last_peered":"2021-01-27T09:53:49.185224+0000","last_clean":"2021-01-27T09:53:49.185224+0000","last_became_active":"2021-01-27T09:44:29.347415+0000","last_became_peered":"2021-01-27T09:44:29.347415+0000","last_unstale":"2021-01-27T09:53:49.185224+0000","last_undegraded":"2021-01-27T09:53:49.185224+0000","last_fullsized":"2021-01-27T09:53:49.185224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2021-01-27T09:53:49.185092+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2021-01-27T09:53:49.185092+0000","last_clean_scrub_stamp":"2021-01-27T09:53:49.185092+0000","log_size":63,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"29'6469","reported_seq":"6513","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:43.832064+0000","last_change":"2021-01-27T09:53:43.153878+0000","last_active":"2021-01-27T09:53:43.832064+0000","last_peered":"2021-01-27T09:53:43.832064+0000","last_clean":"2021-01-27T09:53:43.832064+0000","last_became_active":"2021-01-27T09:44:33.435975+0000","last_became_peered":"2021-01-27T09:44:33.435975+0000","last_unstale":"2021-01-27T09:53:43.832064+0000","last_undegraded":"2021-01-27T09:53:43.832064+0000","last_fullsized":"2021-01-27T09:53:43.832064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6466","last_scrub_stamp":"2021-01-27T09:53:43.153754+0000","last_deep_scrub":"29'6466","last_deep_scrub_stamp":"2021-01-27T09:53:43.153754+0000","last_clean_scrub_stamp":"2021-01-27T09:53:43.153754+0000","log_size":6469,"ondisk_log_size":6469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":86208,"num_write_kb":2029152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'48","reported_seq":"73","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:47.411257+0000","last_change":"2021-01-27T09:53:47.411257+0000","last_active":"2021-01-27T09:53:47.411257+0000","last_peered":"2021-01-27T09:53:47.411257+0000","last_clean":"2021-01-27T09:53:47.411257+0000","last_became_active":"2021-01-27T09:44:28.930088+0000","last_became_peered":"2021-01-27T09:44:28.930088+0000","last_unstale":"2021-01-27T09:53:47.411257+0000","last_undegraded":"2021-01-27T09:53:47.411257+0000","last_fullsized":"2021-01-27T09:53:47.411257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2021-01-27T09:53:47.411066+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2021-01-27T09:53:47.411066+0000","last_clean_scrub_stamp":"2021-01-27T09:53:47.411066+0000","log_size":48,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6104,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7,"num_read_kb":12,"num_write":66,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"24","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:52.234287+0000","last_change":"2021-01-27T09:53:52.234287+0000","last_active":"2021-01-27T09:53:52.234287+0000","last_peered":"2021-01-27T09:53:52.234287+0000","last_clean":"2021-01-27T09:53:52.234287+0000","last_became_active":"2021-01-27T09:44:25.735741+0000","last_became_peered":"2021-01-27T09:44:25.735741+0000","last_unstale":"2021-01-27T09:53:52.234287+0000","last_undegraded":"2021-01-27T09:53:52.234287+0000","last_fullsized":"2021-01-27T09:53:52.234287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T09:53:52.234114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T09:53:52.234114+0000","last_clean_scrub_stamp":"2021-01-27T09:53:52.234114+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'4","reported_seq":"30","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:53:21.816315+0000","last_change":"2021-01-27T09:53:21.816315+0000","last_active":"2021-01-27T09:53:21.816315+0000","last_peered":"2021-01-27T09:53:21.816315+0000","last_clean":"2021-01-27T09:53:21.816315+0000","last_became_active":"2021-01-27T09:44:24.569755+0000","last_became_peered":"2021-01-27T09:44:24.569755+0000","last_unstale":"2021-01-27T09:53:21.816315+0000","last_undegraded":"2021-01-27T09:53:21.816315+0000","last_fullsized":"2021-01-27T09:53:21.816315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2021-01-27T09:53:21.816187+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2021-01-27T09:53:21.816187+0000","last_clean_scrub_stamp":"2021-01-27T09:53:21.816187+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9854,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'56","reported_seq":"76","reported_epoch":"29","state":"active+clean","last_fresh":"2021-01-27T09:54:02.565846+0000","last_change":"2021-01-27T09:54:02.565846+0000","last_active":"2021-01-27T09:54:02.565846+0000","last_peered":"2021-01-27T09:54:02.565846+0000","last_clean":"2021-01-27T09:54:02.565846+0000","last_became_active":"2021-01-27T09:44:29.337355+0000","last_became_peered":"2021-01-27T09:44:29.337355+0000","last_unstale":"2021-01-27T09:54:02.565846+0000","last_undegraded":"2021-01-27T09:54:02.565846+0000","last_fullsized":"2021-01-27T09:54:02.565846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'56","last_scrub_stamp":"2021-01-27T09:54:02.565745+0000","last_deep_scrub":"29'56","last_deep_scrub_stamp":"2021-01-27T09:54:02.565745+0000","last_clean_scrub_stamp":"2021-01-27T09:54:02.565745+0000","log_size":56,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":0,"num_write":733177,"num_write_kb":17286591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55118,"ondisk_log_size":55118,"up":32,"acting":32,"num_store_stats":8},{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":457,"ondisk_log_size":457,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":7725921,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":158,"num_read_kb":6083,"num_write":2208,"num_write_kb":8319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30968,"num_omap_keys":62,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15605760,"data_stored":15451842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2159,"ondisk_log_size":2159,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9854,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509558,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319732,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":319424,"kb_avail":94052108,"statfs":{"total":96636764160,"available":96309358592,"internally_reserved":0,"allocated":307200,"data_stored":134582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":327090176},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:53:37 2021","interfaces":[{"interface":"back","average":{"1min":5.274,"5min":308.63799999999998,"15min":163.46100000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":28.126000000000001,"5min":2098.6239999999998,"15min":2294.9899999999998},"last":1.181},{"interface":"front","average":{"1min":57.298999999999999,"5min":214.78999999999999,"15min":110.01000000000001},"min":{"1min":1.143,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":838.81899999999996,"5min":1539.433,"15min":1539.433},"last":1.272}]},{"osd":1,"last update":"Wed Jan 27 09:53:37 2021","interfaces":[{"interface":"back","average":{"1min":4.891,"5min":73.766000000000005,"15min":26.062000000000001},"min":{"1min":0.63900000000000001,"5min":0.624,"15min":0.58699999999999997},"max":{"1min":23.977,"5min":1524.269,"15min":1524.269},"last":1.704},{"interface":"front","average":{"1min":6.6500000000000004,"5min":139.51599999999999,"15min":74.756},"min":{"1min":0.77100000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":28.852,"5min":2096.9099999999999,"15min":2197.2339999999999},"last":2.1520000000000001}]},{"osd":2,"last update":"Wed Jan 27 09:53:37 2021","interfaces":[{"interface":"back","average":{"1min":5.6239999999999997,"5min":123.563,"15min":73.085999999999999},"min":{"1min":0.90000000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":29.120000000000001,"5min":1322.53,"15min":2294.8020000000001},"last":2.9540000000000002},{"interface":"front","average":{"1min":4.9889999999999999,"5min":76.313999999999993,"15min":27.516999999999999},"min":{"1min":0.86599999999999999,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":27.065999999999999,"5min":1524.4739999999999,"15min":1524.4739999999999},"last":2.294}]},{"osd":4,"last update":"Wed Jan 27 09:53:48 2021","interfaces":[{"interface":"back","average":{"1min":4.5810000000000004,"5min":178.28,"15min":92.762},"min":{"1min":0.874,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":20.765999999999998,"5min":1386.115,"15min":1386.115},"last":2.2269999999999999},{"interface":"front","average":{"1min":5.2640000000000002,"5min":95.355999999999995,"15min":44.259},"min":{"1min":0.93999999999999995,"5min":0.89900000000000002,"15min":0.80000000000000004},"max":{"1min":24.105,"5min":1524.7470000000001,"15min":1524.7470000000001},"last":2.7530000000000001}]},{"osd":5,"last update":"Wed Jan 27 09:53:37 2021","interfaces":[{"interface":"back","average":{"1min":5.1699999999999999,"5min":76.319999999999993,"15min":27.533999999999999},"min":{"1min":1.052,"5min":0.99199999999999999,"15min":0.93500000000000005},"max":{"1min":24.245000000000001,"5min":1524.604,"15min":1524.604},"last":3.0419999999999998},{"interface":"front","average":{"1min":5.5510000000000002,"5min":140.566,"15min":75.225999999999999},"min":{"1min":1.667,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":28.986999999999998,"5min":2097.0590000000002,"15min":2097.0590000000002},"last":2.7050000000000001}]},{"osd":6,"last update":"Wed Jan 27 09:53:37 2021","interfaces":[{"interface":"back","average":{"1min":6.2389999999999999,"5min":150.97499999999999,"15min":81.501000000000005},"min":{"1min":1.673,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":29.265999999999998,"5min":2114.0410000000002,"15min":2114.0410000000002},"last":3.6869999999999998},{"interface":"front","average":{"1min":57.228999999999999,"5min":157.42400000000001,"15min":80.890000000000001},"min":{"1min":1.2949999999999999,"5min":1.075,"15min":1.0549999999999999},"max":{"1min":839.03099999999995,"5min":1240.5540000000001,"15min":1317.1679999999999},"last":2.524}]},{"osd":7,"last update":"Wed Jan 27 09:53:48 2021","interfaces":[{"interface":"back","average":{"1min":5.8719999999999999,"5min":138.31299999999999,"15min":75.125},"min":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"max":{"1min":24.449999999999999,"5min":1801.5260000000001,"15min":1801.5260000000001},"last":2.9129999999999998},{"interface":"front","average":{"1min":6.3780000000000001,"5min":125.89400000000001,"15min":52.442999999999998},"min":{"1min":1.6220000000000001,"5min":1.427,"15min":1.427},"max":{"1min":24.579999999999998,"5min":1682.9359999999999,"15min":1682.9359999999999},"last":3.3239999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509559,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":211988,"kb_used_data":3788,"kb_used_omap":0,"kb_used_meta":208192,"kb_avail":94159852,"statfs":{"total":96636764160,"available":96419688448,"internally_reserved":0,"allocated":3878912,"data_stored":3663437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":213188608},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:53:46 2021","interfaces":[{"interface":"back","average":{"1min":6.2169999999999996,"5min":101.28400000000001,"15min":42.243000000000002},"min":{"1min":0.63500000000000001,"5min":0.59399999999999997,"15min":0.58399999999999996},"max":{"1min":36.313000000000002,"5min":1480.2760000000001,"15min":1480.2760000000001},"last":2.5619999999999998},{"interface":"front","average":{"1min":5.46,"5min":102.15300000000001,"15min":51.534999999999997},"min":{"1min":0.746,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":37.813000000000002,"5min":1290.7180000000001,"15min":1730.1669999999999},"last":3.5609999999999999}]},{"osd":1,"last update":"Wed Jan 27 09:53:46 2021","interfaces":[{"interface":"back","average":{"1min":3.9609999999999999,"5min":3.8479999999999999,"15min":3.1989999999999998},"min":{"1min":0.83299999999999996,"5min":0.61599999999999999,"15min":0.57399999999999995},"max":{"1min":13.108000000000001,"5min":29.736999999999998,"15min":29.736999999999998},"last":1.8560000000000001},{"interface":"front","average":{"1min":3.5510000000000002,"5min":3.6400000000000001,"15min":2.9689999999999999},"min":{"1min":0.76800000000000002,"5min":0.75600000000000001,"15min":0.74199999999999999},"max":{"1min":12.042999999999999,"5min":29.59,"15min":44.777999999999999},"last":2.7509999999999999}]},{"osd":3,"last update":"Wed Jan 27 09:53:46 2021","interfaces":[{"interface":"back","average":{"1min":14.345000000000001,"5min":113.151,"15min":59.031999999999996},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":201.49299999999999,"5min":1800.183,"15min":1800.183},"last":2.3069999999999999},{"interface":"front","average":{"1min":14.342000000000001,"5min":98.867000000000004,"15min":80.210999999999999},"min":{"1min":1.931,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":198.33699999999999,"5min":1461.979,"15min":3309.5619999999999},"last":3.3340000000000001}]},{"osd":4,"last update":"Wed Jan 27 09:53:47 2021","interfaces":[{"interface":"back","average":{"1min":3.1589999999999998,"5min":8.3049999999999997,"15min":7.8109999999999999},"min":{"1min":1.2609999999999999,"5min":1.0109999999999999,"15min":0.88400000000000001},"max":{"1min":7.0199999999999996,"5min":176.553,"15min":291.916},"last":2.1419999999999999},{"interface":"front","average":{"1min":2.5259999999999998,"5min":11.493,"15min":6.665},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":5.5410000000000004,"5min":448.73200000000003,"15min":448.73200000000003},"last":2.3849999999999998}]},{"osd":5,"last update":"Wed Jan 27 09:53:46 2021","interfaces":[{"interface":"back","average":{"1min":2.9670000000000001,"5min":2.5430000000000001,"15min":2.7410000000000001},"min":{"1min":1.0209999999999999,"5min":0.97499999999999998,"15min":0.84299999999999997},"max":{"1min":6.7439999999999998,"5min":9.5399999999999991,"15min":17.311},"last":2.9510000000000001},{"interface":"front","average":{"1min":3.0030000000000001,"5min":2.6779999999999999,"15min":3.222},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":17.167000000000002,"5min":17.167000000000002,"15min":19.155999999999999},"last":3.2570000000000001}]},{"osd":6,"last update":"Wed Jan 27 09:53:46 2021","interfaces":[{"interface":"back","average":{"1min":3.5390000000000001,"5min":2.8809999999999998,"15min":3.2709999999999999},"min":{"1min":1.2949999999999999,"5min":1.0649999999999999,"15min":0.90800000000000003},"max":{"1min":11.897,"5min":15.388999999999999,"15min":43.197000000000003},"last":3.117},{"interface":"front","average":{"1min":3.5950000000000002,"5min":2.6850000000000001,"15min":3.0579999999999998},"min":{"1min":1.137,"5min":1.016,"15min":0.88400000000000001},"max":{"1min":17.524999999999999,"5min":17.524999999999999,"15min":38.168999999999997},"last":2.8980000000000001}]},{"osd":7,"last update":"Wed Jan 27 09:53:46 2021","interfaces":[{"interface":"back","average":{"1min":3.9980000000000002,"5min":63.661000000000001,"15min":35.646999999999998},"min":{"1min":1.1479999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"max":{"1min":12.441000000000001,"5min":1464.1279999999999,"15min":1464.1279999999999},"last":3.3929999999999998},{"interface":"front","average":{"1min":3.4169999999999998,"5min":25.277999999999999,"15min":32.573999999999998},"min":{"1min":1.119,"5min":1.119,"15min":1.119},"max":{"1min":17.673999999999999,"5min":940.86300000000006,"15min":1081.211},"last":4.3949999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509559,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252468,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":252160,"kb_avail":94119372,"statfs":{"total":96636764160,"available":96378236928,"internally_reserved":0,"allocated":307200,"data_stored":134582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":258211840},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:53:45 2021","interfaces":[{"interface":"back","average":{"1min":2.9809999999999999,"5min":96.191000000000003,"15min":66.296000000000006},"min":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":11.170999999999999,"5min":1084.3209999999999,"15min":1471.8320000000001},"last":2.0209999999999999},{"interface":"front","average":{"1min":3.7410000000000001,"5min":126.245,"15min":66.286000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.61199999999999999},"max":{"1min":16.039999999999999,"5min":1286.9860000000001,"15min":1292.7439999999999},"last":2.839}]},{"osd":2,"last update":"Wed Jan 27 09:53:45 2021","interfaces":[{"interface":"back","average":{"1min":2.7160000000000002,"5min":4.9249999999999998,"15min":3.774},"min":{"1min":0.68000000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":20.096,"5min":160.691,"15min":270.13200000000001},"last":1.8080000000000001},{"interface":"front","average":{"1min":2.8029999999999999,"5min":5.5730000000000004,"15min":4.6189999999999998},"min":{"1min":0.88600000000000001,"5min":0.74299999999999999,"15min":0.68600000000000005},"max":{"1min":10.702,"5min":163.256,"15min":275.97399999999999},"last":2.4630000000000001}]},{"osd":3,"last update":"Wed Jan 27 09:53:45 2021","interfaces":[{"interface":"back","average":{"1min":6.8339999999999996,"5min":121.959,"15min":76.599999999999994},"min":{"1min":0.94599999999999995,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":21.187000000000001,"5min":1387.9079999999999,"15min":1387.9079999999999},"last":2.9340000000000002},{"interface":"front","average":{"1min":32.347000000000001,"5min":112.297,"15min":62.198999999999998},"min":{"1min":0.94999999999999996,"5min":0.79300000000000004,"15min":0.79000000000000004},"max":{"1min":589.51800000000003,"5min":1852.193,"15min":1852.193},"last":3.472}]},{"osd":4,"last update":"Wed Jan 27 09:53:45 2021","interfaces":[{"interface":"back","average":{"1min":2.4780000000000002,"5min":28.882999999999999,"15min":12.917999999999999},"min":{"1min":0.873,"5min":0.873,"15min":0.66300000000000003},"max":{"1min":10.625999999999999,"5min":1089.0440000000001,"15min":1089.0440000000001},"last":2.3900000000000001},{"interface":"front","average":{"1min":3.4350000000000001,"5min":4.0709999999999997,"15min":7.5860000000000003},"min":{"1min":1.0840000000000001,"5min":0.97799999999999998,"15min":0.90600000000000003},"max":{"1min":13.500999999999999,"5min":29.530999999999999,"15min":656.05499999999995},"last":3.218}]},{"osd":5,"last update":"Wed Jan 27 09:53:45 2021","interfaces":[{"interface":"back","average":{"1min":2.355,"5min":3.2029999999999998,"15min":3.2029999999999998},"min":{"1min":1.1359999999999999,"5min":0.91400000000000003,"15min":0.90600000000000003},"max":{"1min":9.6219999999999999,"5min":33.588000000000001,"15min":33.588000000000001},"last":2.6699999999999999},{"interface":"front","average":{"1min":2.9550000000000001,"5min":3.3519999999999999,"15min":3.2440000000000002},"min":{"1min":1,"5min":0.995,"15min":0.76500000000000001},"max":{"1min":11.173,"5min":25.948,"15min":25.948},"last":2.7719999999999998}]},{"osd":6,"last update":"Wed Jan 27 09:53:45 2021","interfaces":[{"interface":"back","average":{"1min":2.698,"5min":3.4079999999999999,"15min":3.3679999999999999},"min":{"1min":1.1399999999999999,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":9.8989999999999991,"5min":33.341999999999999,"15min":33.341999999999999},"last":3.298},{"interface":"front","average":{"1min":3.1379999999999999,"5min":3.5190000000000001,"15min":3.3759999999999999},"min":{"1min":1.121,"5min":1.121,"15min":1.05},"max":{"1min":10.795999999999999,"5min":26.204999999999998,"15min":26.204999999999998},"last":3.1589999999999998}]},{"osd":7,"last update":"Wed Jan 27 09:53:45 2021","interfaces":[{"interface":"back","average":{"1min":3.6440000000000001,"5min":42.393000000000001,"15min":25.516999999999999},"min":{"1min":1.234,"5min":1.103,"15min":0.82499999999999996},"max":{"1min":13.653,"5min":1194.567,"15min":1194.567},"last":3.665},{"interface":"front","average":{"1min":2.8290000000000002,"5min":39.707000000000001,"15min":32.039000000000001},"min":{"1min":1.3819999999999999,"5min":1.1499999999999999,"15min":1.1279999999999999},"max":{"1min":10.157,"5min":1313.825,"15min":1655.51},"last":3.5139999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509559,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":321384,"kb_used_data":3168,"kb_used_omap":0,"kb_used_meta":318208,"kb_avail":94050456,"statfs":{"total":96636764160,"available":96307666944,"internally_reserved":0,"allocated":3244032,"data_stored":3058555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":325844992},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 27 09:53:41 2021","interfaces":[{"interface":"back","average":{"1min":8.218,"5min":122.497,"15min":49.094999999999999},"min":{"1min":0.68400000000000005,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":68.403000000000006,"5min":1128.261,"15min":1128.261},"last":1.792},{"interface":"front","average":{"1min":26.498000000000001,"5min":108.386,"15min":66.331000000000003},"min":{"1min":0.93600000000000005,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":504.99000000000001,"5min":2188.9270000000001,"15min":2237.944},"last":1.843}]},{"osd":2,"last update":"Wed Jan 27 09:53:46 2021","interfaces":[{"interface":"back","average":{"1min":7.7140000000000004,"5min":132.482,"15min":58.021000000000001},"min":{"1min":0.73599999999999999,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":93.251000000000005,"5min":1821.519,"15min":1821.519},"last":2.472},{"interface":"front","average":{"1min":27.811,"5min":168.07300000000001,"15min":71.825000000000003},"min":{"1min":1.1539999999999999,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":504.71499999999997,"5min":2749.7919999999999,"15min":2749.7919999999999},"last":2.1800000000000002}]},{"osd":3,"last update":"Wed Jan 27 09:53:46 2021","interfaces":[{"interface":"back","average":{"1min":11.454000000000001,"5min":151.505,"15min":70.988},"min":{"1min":0.95799999999999996,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":68.799000000000007,"5min":1821.873,"15min":2240.3739999999998},"last":2.7029999999999998},{"interface":"front","average":{"1min":11.688000000000001,"5min":237.37899999999999,"15min":98.140000000000001},"min":{"1min":1.109,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":69.260999999999996,"5min":2588.5129999999999,"15min":2588.5129999999999},"last":2.9430000000000001}]},{"osd":4,"last update":"Wed Jan 27 09:53:46 2021","interfaces":[{"interface":"back","average":{"1min":27.02,"5min":150.148,"15min":57.659999999999997},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":504.86000000000001,"5min":1128.5070000000001,"15min":1128.5070000000001},"last":3.4390000000000001},{"interface":"front","average":{"1min":8.5120000000000005,"5min":177.375,"15min":90.894999999999996},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":94.864999999999995,"5min":2756.1100000000001,"15min":2756.1100000000001},"last":2.0920000000000001}]},{"osd":5,"last update":"Wed Jan 27 09:53:41 2021","interfaces":[{"interface":"back","average":{"1min":26.295000000000002,"5min":133.10499999999999,"15min":52.923999999999999},"min":{"1min":0.96699999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":505.24599999999998,"5min":1821.7380000000001,"15min":1821.7380000000001},"last":3.1960000000000002},{"interface":"front","average":{"1min":6.5140000000000002,"5min":128.58600000000001,"15min":76.390000000000001},"min":{"1min":1.3200000000000001,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":68.259,"5min":2189.192,"15min":2219.1909999999998},"last":3.1539999999999999}]},{"osd":6,"last update":"Wed Jan 27 09:53:41 2021","interfaces":[{"interface":"back","average":{"1min":7.3440000000000003,"5min":86.447999999999993,"15min":56.587000000000003},"min":{"1min":1.6850000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"max":{"1min":68.668000000000006,"5min":2189.3180000000002,"15min":2189.3180000000002},"last":3.339},{"interface":"front","average":{"1min":8.1069999999999993,"5min":99.637,"15min":71.597999999999999},"min":{"1min":1.3899999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":68.543999999999997,"5min":2189.7489999999998,"15min":2219.4609999999998},"last":3.7639999999999998}]},{"osd":7,"last update":"Wed Jan 27 09:53:46 2021","interfaces":[{"interface":"back","average":{"1min":8.6219999999999999,"5min":200.71799999999999,"15min":79.978999999999999},"min":{"1min":1.391,"5min":1.121,"15min":1.121},"max":{"1min":95.629999999999995,"5min":2750.0140000000001,"15min":2750.0140000000001},"last":3.895},{"interface":"front","average":{"1min":27.588999999999999,"5min":195.63800000000001,"15min":100.005},"min":{"1min":1.371,"5min":1.228,"15min":1.228},"max":{"1min":505.11799999999999,"5min":3266.1680000000001,"15min":3266.1680000000001},"last":4.46}]}]},{"osd":7,"up_from":14,"seq":60129542262,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":440056,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":439744,"kb_avail":93931784,"statfs":{"total":96636764160,"available":96186146816,"internally_reserved":0,"allocated":311296,"data_stored":133908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":450297856},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:53:41 2021","interfaces":[{"interface":"back","average":{"1min":3.4049999999999998,"5min":114.139,"15min":64.271000000000001},"min":{"1min":0.79600000000000004,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":15.473000000000001,"5min":1245.2170000000001,"15min":1326.3920000000001},"last":2.0990000000000002},{"interface":"front","average":{"1min":18.687000000000001,"5min":168.70400000000001,"15min":76.894000000000005},"min":{"1min":0.64500000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":266.68299999999999,"5min":1520.595,"15min":1520.595},"last":2.028}]},{"osd":1,"last update":"Wed Jan 27 09:53:41 2021","interfaces":[{"interface":"back","average":{"1min":9.3970000000000002,"5min":31.244,"15min":14.503},"min":{"1min":0.78500000000000003,"5min":0.73299999999999998,"15min":0.624},"max":{"1min":117.753,"5min":865.298,"15min":865.298},"last":2.3889999999999998},{"interface":"front","average":{"1min":2.0329999999999999,"5min":74.781000000000006,"15min":34.814999999999998},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":5.8179999999999996,"5min":1996.8119999999999,"15min":1996.8119999999999},"last":2.7360000000000002}]},{"osd":2,"last update":"Wed Jan 27 09:53:45 2021","interfaces":[{"interface":"back","average":{"1min":3.1269999999999998,"5min":65.135000000000005,"15min":28.826000000000001},"min":{"1min":1.2210000000000001,"5min":0.81499999999999995,"15min":0.71999999999999997},"max":{"1min":22.030000000000001,"5min":1996.9359999999999,"15min":1996.9359999999999},"last":2.1920000000000002},{"interface":"front","average":{"1min":3.3900000000000001,"5min":37.545999999999999,"15min":26.943000000000001},"min":{"1min":0.96399999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":22.163,"5min":1102.5360000000001,"15min":1326.518},"last":3.7749999999999999}]},{"osd":3,"last update":"Wed Jan 27 09:53:45 2021","interfaces":[{"interface":"back","average":{"1min":40.689,"5min":154.17699999999999,"15min":91.412999999999997},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.80700000000000005},"max":{"1min":371.14400000000001,"5min":1632.471,"15min":1632.471},"last":2.972},{"interface":"front","average":{"1min":19.155000000000001,"5min":228.571,"15min":126.777},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":0.92300000000000004},"max":{"1min":262.82100000000003,"5min":3452.1500000000001,"15min":3452.1500000000001},"last":3.0579999999999998}]},{"osd":4,"last update":"Wed Jan 27 09:53:45 2021","interfaces":[{"interface":"back","average":{"1min":2.4430000000000001,"5min":75.483000000000004,"15min":45.832999999999998},"min":{"1min":0.75800000000000001,"5min":0.754,"15min":0.754},"max":{"1min":6.5620000000000003,"5min":2007.1610000000001,"15min":2007.1610000000001},"last":4.4139999999999997},{"interface":"front","average":{"1min":2.3250000000000002,"5min":48.866999999999997,"15min":33.548999999999999},"min":{"1min":0.90500000000000003,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":6.0620000000000003,"5min":1245.086,"15min":1344.953},"last":3.4249999999999998}]},{"osd":5,"last update":"Wed Jan 27 09:53:45 2021","interfaces":[{"interface":"back","average":{"1min":2.3799999999999999,"5min":36.137,"15min":26.263999999999999},"min":{"1min":0.97499999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":6.375,"5min":1102.3889999999999,"15min":1326.6369999999999},"last":4.1429999999999998},{"interface":"front","average":{"1min":2.4500000000000002,"5min":65.256,"15min":27.956},"min":{"1min":1.147,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":6.859,"5min":1998.104,"15min":1998.104},"last":3.835}]},{"osd":6,"last update":"Wed Jan 27 09:53:41 2021","interfaces":[{"interface":"back","average":{"1min":3.0179999999999998,"5min":65.625,"15min":27.728999999999999},"min":{"1min":1.2669999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":8.6029999999999998,"5min":1997.972,"15min":1997.972},"last":4.2069999999999999},{"interface":"front","average":{"1min":9.0739999999999998,"5min":27.779,"15min":13.598000000000001},"min":{"1min":1.0109999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":117.616,"5min":627.93899999999996,"15min":627.93899999999996},"last":4.6390000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542263,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":203888,"kb_used_data":5032,"kb_used_omap":0,"kb_used_meta":198848,"kb_avail":94167952,"statfs":{"total":96636764160,"available":96427982848,"internally_reserved":0,"allocated":5152768,"data_stored":4929528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":203620352},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:53:34 2021","interfaces":[{"interface":"back","average":{"1min":3.2789999999999999,"5min":141.98400000000001,"15min":59.155999999999999},"min":{"1min":0.629,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":17.308,"5min":2062.3220000000001,"15min":2062.3220000000001},"last":2.6299999999999999},{"interface":"front","average":{"1min":3.2240000000000002,"5min":67.819999999999993,"15min":26.286000000000001},"min":{"1min":0.70699999999999996,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":17.681000000000001,"5min":735.14300000000003,"15min":735.14300000000003},"last":1.5800000000000001}]},{"osd":1,"last update":"Wed Jan 27 09:53:40 2021","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":3.7829999999999999,"15min":3.2029999999999998},"min":{"1min":0.68999999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":9.1470000000000002,"5min":202.423,"15min":202.423},"last":2.8919999999999999},{"interface":"front","average":{"1min":2.032,"5min":3.8929999999999998,"15min":3.3809999999999998},"min":{"1min":0.90700000000000003,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":5.3339999999999996,"5min":188.43000000000001,"15min":188.43000000000001},"last":2.0499999999999998}]},{"osd":2,"last update":"Wed Jan 27 09:53:34 2021","interfaces":[{"interface":"back","average":{"1min":2.2360000000000002,"5min":3.4089999999999998,"15min":3.375},"min":{"1min":0.89800000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":5.8630000000000004,"5min":89.617999999999995,"15min":182.20699999999999},"last":2.2770000000000001},{"interface":"front","average":{"1min":2.1269999999999998,"5min":3.0680000000000001,"15min":3.089},"min":{"1min":0.98199999999999998,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":8.0939999999999994,"5min":86.694999999999993,"15min":150.04900000000001},"last":1.8200000000000001}]},{"osd":3,"last update":"Wed Jan 27 09:53:34 2021","interfaces":[{"interface":"back","average":{"1min":3.6240000000000001,"5min":82.180999999999997,"15min":42.915999999999997},"min":{"1min":1.3200000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":14.695,"5min":1796.723,"15min":1796.723},"last":2.552},{"interface":"front","average":{"1min":49.997999999999998,"5min":134.54400000000001,"15min":47.350999999999999},"min":{"1min":1.1259999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":606.72500000000002,"5min":1821.835,"15min":1821.835},"last":3.1070000000000002}]},{"osd":4,"last update":"Wed Jan 27 09:53:34 2021","interfaces":[{"interface":"back","average":{"1min":2.2610000000000001,"5min":21.617000000000001,"15min":9.4890000000000008},"min":{"1min":0.84399999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":7.3159999999999998,"5min":560.41999999999996,"15min":560.41999999999996},"last":2.4569999999999999},{"interface":"front","average":{"1min":2.5630000000000002,"5min":11.353,"15min":10.140000000000001},"min":{"1min":1.107,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":6.1550000000000002,"5min":513.15200000000004,"15min":513.15200000000004},"last":2.8420000000000001}]},{"osd":5,"last update":"Wed Jan 27 09:53:34 2021","interfaces":[{"interface":"back","average":{"1min":2.2040000000000002,"5min":2.0600000000000001,"15min":2.5640000000000001},"min":{"1min":0.85799999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":5.1929999999999996,"5min":5.5910000000000002,"15min":5.5910000000000002},"last":1.6519999999999999},{"interface":"front","average":{"1min":2.4620000000000002,"5min":2.1499999999999999,"15min":2.7280000000000002},"min":{"1min":1.2849999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":5.2889999999999997,"5min":5.2889999999999997,"15min":6.194},"last":1.782}]},{"osd":7,"last update":"Wed Jan 27 09:53:40 2021","interfaces":[{"interface":"back","average":{"1min":2.4670000000000001,"5min":13.202999999999999,"15min":8.9090000000000007},"min":{"1min":1.256,"5min":0.996,"15min":0.996},"max":{"1min":9.5649999999999995,"5min":507.45499999999998,"15min":507.45499999999998},"last":2.2029999999999998},{"interface":"front","average":{"1min":2.702,"5min":63.426000000000002,"15min":34.991},"min":{"1min":1.248,"5min":1.248,"15min":1.1970000000000001},"max":{"1min":8.9120000000000008,"5min":2702.8879999999999,"15min":2702.8879999999999},"last":3.3090000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542263,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81160,"kb_used_data":4416,"kb_used_omap":0,"kb_used_meta":76736,"kb_avail":94290680,"statfs":{"total":96636764160,"available":96553656320,"internally_reserved":0,"allocated":4521984,"data_stored":4330196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":78577664},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:53:46 2021","interfaces":[{"interface":"back","average":{"1min":43.249000000000002,"5min":98.941000000000003,"15min":42.506},"min":{"1min":0.97699999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":397.89699999999999,"5min":1057.0899999999999,"15min":2305.5720000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":20.716000000000001,"5min":123.782,"15min":67.826999999999998},"min":{"1min":0.75800000000000001,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":288.15100000000001,"5min":1931.6790000000001,"15min":2556.7280000000001},"last":1.462}]},{"osd":1,"last update":"Wed Jan 27 09:53:39 2021","interfaces":[{"interface":"back","average":{"1min":3.2810000000000001,"5min":4.2119999999999997,"15min":3.2130000000000001},"min":{"1min":0.73999999999999999,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":15.502000000000001,"5min":240.86600000000001,"15min":240.86600000000001},"last":2.2719999999999998},{"interface":"front","average":{"1min":1.7669999999999999,"5min":4.0650000000000004,"15min":2.9020000000000001},"min":{"1min":0.78500000000000003,"5min":0.65800000000000003,"15min":0.64900000000000002},"max":{"1min":6.3109999999999999,"5min":247.31299999999999,"15min":247.31299999999999},"last":1.5149999999999999}]},{"osd":2,"last update":"Wed Jan 27 09:53:39 2021","interfaces":[{"interface":"back","average":{"1min":1.976,"5min":3.6349999999999998,"15min":2.8900000000000001},"min":{"1min":0.84299999999999997,"5min":0.749,"15min":0.749},"max":{"1min":4.7649999999999997,"5min":125.51000000000001,"15min":125.51000000000001},"last":2.0640000000000001},{"interface":"front","average":{"1min":2.0289999999999999,"5min":3.661,"15min":2.883},"min":{"1min":0.85299999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":4.2000000000000002,"5min":122.705,"15min":122.705},"last":2.7090000000000001}]},{"osd":3,"last update":"Wed Jan 27 09:53:46 2021","interfaces":[{"interface":"back","average":{"1min":3.657,"5min":165.078,"15min":62.859999999999999},"min":{"1min":1.2270000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":21.655999999999999,"5min":2676.6819999999998,"15min":2676.6819999999998},"last":2.7839999999999998},{"interface":"front","average":{"1min":4.2699999999999996,"5min":155.61699999999999,"15min":94.835999999999999},"min":{"1min":1.2589999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":21.068000000000001,"5min":2676.6190000000001,"15min":2676.6190000000001},"last":2.948}]},{"osd":4,"last update":"Wed Jan 27 09:53:39 2021","interfaces":[{"interface":"back","average":{"1min":2.1190000000000002,"5min":5.3929999999999998,"15min":8.2870000000000008},"min":{"1min":0.81599999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":4.1239999999999997,"5min":201.47999999999999,"15min":635.86400000000003},"last":2.4540000000000002},{"interface":"front","average":{"1min":2.4079999999999999,"5min":13.323,"15min":10.824},"min":{"1min":1.01,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":4.202,"5min":352.37599999999998,"15min":525.19600000000003},"last":3.3639999999999999}]},{"osd":6,"last update":"Wed Jan 27 09:53:39 2021","interfaces":[{"interface":"back","average":{"1min":1.9690000000000001,"5min":2.0070000000000001,"15min":2.5510000000000002},"min":{"1min":0.94599999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":3.089,"5min":7.5590000000000002,"15min":7.5590000000000002},"last":3.1230000000000002},{"interface":"front","average":{"1min":2.3599999999999999,"5min":2.2400000000000002,"15min":2.722},"min":{"1min":0.99099999999999999,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":4.0119999999999996,"5min":6.3419999999999996,"15min":6.3419999999999996},"last":3.5760000000000001}]},{"osd":7,"last update":"Wed Jan 27 09:53:39 2021","interfaces":[{"interface":"back","average":{"1min":2.464,"5min":29.141999999999999,"15min":22.472999999999999},"min":{"1min":1.1120000000000001,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":6.3600000000000003,"5min":503.666,"15min":1037.163},"last":2.9860000000000002},{"interface":"front","average":{"1min":2.4359999999999999,"5min":74.584000000000003,"15min":36.448},"min":{"1min":1.002,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":4.5119999999999996,"5min":1580.106,"15min":1580.106},"last":3.1579999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542262,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263752,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":263424,"kb_avail":94108088,"statfs":{"total":96636764160,"available":96366682112,"internally_reserved":0,"allocated":327680,"data_stored":141352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":269746176},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 09:53:42 2021","interfaces":[{"interface":"back","average":{"1min":31.007000000000001,"5min":178.648,"15min":103.289},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":517.53599999999994,"5min":1450.174,"15min":1734.057},"last":1.536},{"interface":"front","average":{"1min":2.8220000000000001,"5min":94.733999999999995,"15min":46.420999999999999},"min":{"1min":0.75800000000000001,"5min":0.68400000000000005,"15min":0.63300000000000001},"max":{"1min":10.228999999999999,"5min":1753.086,"15min":1753.086},"last":1.4470000000000001}]},{"osd":1,"last update":"Wed Jan 27 09:53:42 2021","interfaces":[{"interface":"back","average":{"1min":3.2989999999999999,"5min":20.617999999999999,"15min":8.4809999999999999},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":17.425999999999998,"5min":637.33699999999999,"15min":637.33699999999999},"last":1.462},{"interface":"front","average":{"1min":3.2549999999999999,"5min":11.847,"15min":13.303000000000001},"min":{"1min":0.85399999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":17.553999999999998,"5min":265.786,"15min":517.21100000000001},"last":2.8220000000000001}]},{"osd":2,"last update":"Wed Jan 27 09:53:42 2021","interfaces":[{"interface":"back","average":{"1min":2.8519999999999999,"5min":9.7720000000000002,"15min":12.708},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":10.388999999999999,"5min":265.935,"15min":517.07500000000005},"last":2.4239999999999999},{"interface":"front","average":{"1min":2.1179999999999999,"5min":4.0090000000000003,"15min":6.0549999999999997},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":4.7309999999999999,"5min":182.66,"15min":375.03399999999999},"last":2.0430000000000001}]},{"osd":3,"last update":"Wed Jan 27 09:53:42 2021","interfaces":[{"interface":"back","average":{"1min":7.4020000000000001,"5min":104.36799999999999,"15min":61.338999999999999},"min":{"1min":1.0820000000000001,"5min":0.98899999999999999,"15min":0.97899999999999998},"max":{"1min":87.488,"5min":1265.72,"15min":1265.72},"last":2.5339999999999998},{"interface":"front","average":{"1min":3.8399999999999999,"5min":122.044,"15min":43.006999999999998},"min":{"1min":1.3320000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":15.509,"5min":1872.2360000000001,"15min":1872.2360000000001},"last":3.7559999999999998}]},{"osd":5,"last update":"Wed Jan 27 09:53:36 2021","interfaces":[{"interface":"back","average":{"1min":2.0600000000000001,"5min":17.367000000000001,"15min":7.6470000000000002},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":3.806,"5min":692.52700000000004,"15min":692.52700000000004},"last":4.2069999999999999},{"interface":"front","average":{"1min":2.3919999999999999,"5min":8.6419999999999995,"15min":12.65},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":4.6980000000000004,"5min":265.64800000000002,"15min":516.92399999999998},"last":4.7640000000000002}]},{"osd":6,"last update":"Wed Jan 27 09:53:36 2021","interfaces":[{"interface":"back","average":{"1min":2.4049999999999998,"5min":9.1620000000000008,"15min":13.222},"min":{"1min":0.86199999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":9.8529999999999998,"5min":265.505,"15min":574.76400000000001},"last":2.8919999999999999},{"interface":"front","average":{"1min":2.7069999999999999,"5min":3.1040000000000001,"15min":6.1660000000000004},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":10.651,"5min":65.150999999999996,"15min":375.23599999999999},"last":4.2960000000000003}]},{"osd":7,"last update":"Wed Jan 27 09:53:36 2021","interfaces":[{"interface":"back","average":{"1min":3.1040000000000001,"5min":27.786999999999999,"15min":19.928999999999998},"min":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":10.367000000000001,"5min":563.33299999999997,"15min":738.697},"last":3.8180000000000001},{"interface":"front","average":{"1min":3.169,"5min":43.103999999999999,"15min":35.25},"min":{"1min":1.0620000000000001,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":10.523,"5min":1411.2909999999999,"15min":2337.453},"last":5.1959999999999997}]}]}]}} 2021-01-27T09:54:09.515 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2021-01-27T09:54:09.668 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.661+0000 7f05b0b6b700 1 Processor -- start 2021-01-27T09:54:09.668 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.661+0000 7f05b0b6b700 1 -- start start 2021-01-27T09:54:09.671 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.665+0000 7f05b0b6b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f05ac065640 0x7f05ac0bf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:09.671 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.665+0000 7f05b0b6b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f05ac0bbb20 0x7f05ac0bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:09.672 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.665+0000 7f05b0b6b700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05ac0bf5c0 con 0x7f05ac065260 2021-01-27T09:54:09.672 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.665+0000 7f05b0b6b700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05ac063830 con 0x7f05ac065640 2021-01-27T09:54:09.672 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.665+0000 7f05b0b6b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05ac0bfda0 con 0x7f05ac0bbb20 2021-01-27T09:54:09.673 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.665+0000 7f05a9d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f05ac065640 0x7f05ac0bf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:09.674 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.665+0000 7f05a9d9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f05ac065640 0x7f05ac0bf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:58606/0 (socket says 172.21.15.146:58606) 2021-01-27T09:54:09.675 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.665+0000 7f05a9d9b700 1 -- 172.21.15.146:0/559077143 learned_addr learned my addr 172.21.15.146:0/559077143 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:54:09.675 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.665+0000 7f05aa59c700 1 --1- 172.21.15.146:0/559077143 >> v1:172.21.15.78:6789/0 conn(0x7f05ac065260 0x7f05ac151d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:43336/0 (socket says 172.21.15.146:43336) 2021-01-27T09:54:09.675 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.665+0000 7f05aad9d700 1 --2- 172.21.15.146:0/559077143 >> v2:172.21.15.146:3300/0 conn(0x7f05ac0bbb20 0x7f05ac0bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:09.675 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.665+0000 7f05a9d9b700 1 -- 172.21.15.146:0/559077143 >> v2:172.21.15.146:3300/0 conn(0x7f05ac0bbb20 msgr2=0x7f05ac0bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:54:09.675 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.665+0000 7f05a9d9b700 1 --2- 172.21.15.146:0/559077143 >> v2:172.21.15.146:3300/0 conn(0x7f05ac0bbb20 0x7f05ac0bbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:09.676 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.665+0000 7f05a9d9b700 1 -- 172.21.15.146:0/559077143 >> v1:172.21.15.78:6789/0 conn(0x7f05ac065260 legacy=0x7f05ac151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:09.676 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.665+0000 7f05a9d9b700 1 -- 172.21.15.146:0/559077143 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ac0bf860 con 0x7f05ac065640 2021-01-27T09:54:09.676 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.665+0000 7f05a959a700 1 -- 172.21.15.146:0/559077143 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416550692 0 0) 0x7f05ac0bf5c0 con 0x7f05ac065260 2021-01-27T09:54:09.676 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.665+0000 7f05a9d9b700 1 --2- 172.21.15.146:0/559077143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05ac065640 0x7f05ac0bf010 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f05ac06a530 tx=0x7f05a0006ee0).ready entity=mon.0 client_cookie=645683a84662b5ba server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:09.677 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.669+0000 7f05a959a700 1 -- 172.21.15.146:0/559077143 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a0009800 con 0x7f05ac065640 2021-01-27T09:54:09.677 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.669+0000 7f05a959a700 1 -- 172.21.15.146:0/559077143 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a0009960 con 0x7f05ac065640 2021-01-27T09:54:09.677 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.669+0000 7f05a959a700 1 -- 172.21.15.146:0/559077143 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a0009ce0 con 0x7f05ac065640 2021-01-27T09:54:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.669+0000 7f05b0b6b700 1 -- 172.21.15.146:0/559077143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05ac065640 msgr2=0x7f05ac0bf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.669+0000 7f05b0b6b700 1 --2- 172.21.15.146:0/559077143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05ac065640 0x7f05ac0bf010 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f05ac06a530 tx=0x7f05a0006ee0).stop 2021-01-27T09:54:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.669+0000 7f05b0b6b700 1 -- 172.21.15.146:0/559077143 shutdown_connections 2021-01-27T09:54:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.669+0000 7f05b0b6b700 1 --2- 172.21.15.146:0/559077143 >> v2:172.21.15.146:3300/0 conn(0x7f05ac0bbb20 0x7f05ac0bbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.669+0000 7f05b0b6b700 1 --2- 172.21.15.146:0/559077143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05ac065640 0x7f05ac0bf010 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.669+0000 7f05b0b6b700 1 -- 172.21.15.146:0/559077143 >> 172.21.15.146:0/559077143 conn(0x7f05ac069110 msgr2=0x7f05ac067e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:54:09.680 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.669+0000 7f05b0b6b700 1 -- 172.21.15.146:0/559077143 shutdown_connections 2021-01-27T09:54:09.680 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.669+0000 7f05b0b6b700 1 -- 172.21.15.146:0/559077143 wait complete. 2021-01-27T09:54:09.680 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.673+0000 7f05b0b6b700 1 Processor -- start 2021-01-27T09:54:09.680 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.673+0000 7f05b0b6b700 1 -- start start 2021-01-27T09:54:09.682 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.673+0000 7f05b0b6b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05ac065260 0x7f05ac0bca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:09.683 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.673+0000 7f05b0b6b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05ac065640 0x7f05ac14b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:09.683 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.673+0000 7f05b0b6b700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f05ac0bbb20 0x7f05ac15d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:09.683 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.673+0000 7f05b0b6b700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac0b9370 con 0x7f05ac065640 2021-01-27T09:54:09.683 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.673+0000 7f05b0b6b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac0ba130 con 0x7f05ac065260 2021-01-27T09:54:09.683 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.673+0000 7f05b0b6b700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac14c360 con 0x7f05ac0bbb20 2021-01-27T09:54:09.684 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.673+0000 7f05aad9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f05ac0bbb20 0x7f05ac15d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:09.684 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.673+0000 7f05aa59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05ac065260 0x7f05ac0bca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:09.684 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.673+0000 7f05aad9d700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f05ac0bbb20 0x7f05ac15d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:45222/0 (socket says 172.21.15.146:45222) 2021-01-27T09:54:09.684 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.673+0000 7f05aad9d700 1 -- 172.21.15.146:0/504146995 learned_addr learned my addr 172.21.15.146:0/504146995 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:54:09.685 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.673+0000 7f05a9d9b700 1 --2- 172.21.15.146:0/504146995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05ac065640 0x7f05ac14b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:09.685 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.673+0000 7f05aad9d700 1 -- 172.21.15.146:0/504146995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05ac065260 msgr2=0x7f05ac0bca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:09.685 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.673+0000 7f05aad9d700 1 --2- 172.21.15.146:0/504146995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05ac065260 0x7f05ac0bca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:09.685 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.673+0000 7f05aad9d700 1 -- 172.21.15.146:0/504146995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05ac065640 msgr2=0x7f05ac14b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:09.685 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.673+0000 7f05aad9d700 1 --2- 172.21.15.146:0/504146995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05ac065640 0x7f05ac14b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:09.686 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.673+0000 7f05aad9d700 1 -- 172.21.15.146:0/504146995 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ac161ac0 con 0x7f05ac0bbb20 2021-01-27T09:54:09.686 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.677+0000 7f05a9d9b700 1 --2- 172.21.15.146:0/504146995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05ac065640 0x7f05ac14b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:54:09.686 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.677+0000 7f05aad9d700 1 --2- 172.21.15.146:0/504146995 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f05ac0bbb20 0x7f05ac15d740 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f05a400ed50 tx=0x7f05a4009220).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:09.687 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.677+0000 7f059a7fc700 1 -- 172.21.15.146:0/504146995 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a400eeb0 con 0x7f05ac0bbb20 2021-01-27T09:54:09.687 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.677+0000 7f059a7fc700 1 -- 172.21.15.146:0/504146995 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a400cb80 con 0x7f05ac0bbb20 2021-01-27T09:54:09.687 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.677+0000 7f05b0b6b700 1 -- 172.21.15.146:0/504146995 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05ac14be20 con 0x7f05ac0bbb20 2021-01-27T09:54:09.688 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.677+0000 7f059a7fc700 1 -- 172.21.15.146:0/504146995 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a40123f0 con 0x7f05ac0bbb20 2021-01-27T09:54:09.688 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.677+0000 7f05b0b6b700 1 -- 172.21.15.146:0/504146995 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05ac0b9c90 con 0x7f05ac0bbb20 2021-01-27T09:54:09.689 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.677+0000 7f05b0b6b700 1 -- 172.21.15.146:0/504146995 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05ac0b9ad0 con 0x7f05ac0bbb20 2021-01-27T09:54:09.689 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.677+0000 7f059a7fc700 1 -- 172.21.15.146:0/504146995 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f05a4022070 con 0x7f05ac0bbb20 2021-01-27T09:54:09.689 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.681+0000 7f059a7fc700 1 --2- 172.21.15.146:0/504146995 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0588056230 0x7f05880586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:09.690 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.681+0000 7f059a7fc700 1 -- 172.21.15.146:0/504146995 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7f05a406fc00 con 0x7f05ac0bbb20 2021-01-27T09:54:09.690 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.681+0000 7f05aa59c700 1 --2- 172.21.15.146:0/504146995 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0588056230 0x7f05880586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:09.690 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.681+0000 7f05aa59c700 1 --2- 172.21.15.146:0/504146995 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0588056230 0x7f05880586f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f059c007830 tx=0x7f059c007a50).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:09.693 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.685+0000 7f059a7fc700 1 -- 172.21.15.146:0/504146995 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f05a4075020 con 0x7f05ac0bbb20 2021-01-27T09:54:09.837 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.833+0000 7f05b0b6b700 1 -- 172.21.15.146:0/504146995 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f05ac044ee0 con 0x7f05ac0bbb20 2021-01-27T09:54:09.847 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.841+0000 7f059a7fc700 1 -- 172.21.15.146:0/504146995 <== mon.2 v2:172.21.15.78:3301/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f05a4045230 con 0x7f05ac0bbb20 2021-01-27T09:54:09.851 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.845+0000 7f059a7fc700 1 -- 172.21.15.146:0/504146995 <== mon.2 v2:172.21.15.78:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) v1 ==== 123+0+0 (secure 0 0 0) 0x7f05a4016070 con 0x7f05ac0bbb20 2021-01-27T09:54:09.853 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.849+0000 7f05b0b6b700 1 -- 172.21.15.146:0/504146995 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0588056230 msgr2=0x7f05880586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:09.854 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.849+0000 7f05b0b6b700 1 --2- 172.21.15.146:0/504146995 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0588056230 0x7f05880586f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f059c007830 tx=0x7f059c007a50).stop 2021-01-27T09:54:09.854 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.849+0000 7f05b0b6b700 1 -- 172.21.15.146:0/504146995 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f05ac0bbb20 msgr2=0x7f05ac15d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:09.854 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.849+0000 7f05b0b6b700 1 --2- 172.21.15.146:0/504146995 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f05ac0bbb20 0x7f05ac15d740 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f05a400ed50 tx=0x7f05a4009220).stop 2021-01-27T09:54:09.854 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.849+0000 7f05b0b6b700 1 -- 172.21.15.146:0/504146995 shutdown_connections 2021-01-27T09:54:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.849+0000 7f05b0b6b700 1 --2- 172.21.15.146:0/504146995 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f05ac0bbb20 0x7f05ac15d740 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.849+0000 7f05b0b6b700 1 --2- 172.21.15.146:0/504146995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05ac065640 0x7f05ac14b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.849+0000 7f05b0b6b700 1 --2- 172.21.15.146:0/504146995 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f0588056230 0x7f05880586f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.849+0000 7f05b0b6b700 1 --2- 172.21.15.146:0/504146995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05ac065260 0x7f05ac0bca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.849+0000 7f05b0b6b700 1 -- 172.21.15.146:0/504146995 >> 172.21.15.146:0/504146995 conn(0x7f05ac069110 msgr2=0x7f05ac146cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:54:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.849+0000 7f05b0b6b700 1 -- 172.21.15.146:0/504146995 shutdown_connections 2021-01-27T09:54:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:09.849+0000 7f05b0b6b700 1 -- 172.21.15.146:0/504146995 wait complete. 2021-01-27T09:54:09.878 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2021-01-27T09:54:09.879 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:54:10.036 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.029+0000 7ff3ff184700 1 Processor -- start 2021-01-27T09:54:10.037 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.029+0000 7ff3ff184700 1 -- start start 2021-01-27T09:54:10.039 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.033+0000 7ff3ff184700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3f8064240 0x7ff3f8064620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:10.040 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.033+0000 7ff3ff184700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff3f80637e0 0x7ff3f80b8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:10.040 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.033+0000 7ff3ff184700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f814c580 con 0x7ff3f814bc10 2021-01-27T09:54:10.040 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.033+0000 7ff3ff184700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f814c820 con 0x7ff3f80637e0 2021-01-27T09:54:10.040 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.033+0000 7ff3ff184700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f814cac0 con 0x7ff3f8064240 2021-01-27T09:54:10.041 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.033+0000 7ff3fe182700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3f8064240 0x7ff3f8064620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:10.042 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.033+0000 7ff3fd981700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff3f80637e0 0x7ff3f80b8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:10.042 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.033+0000 7ff3fe182700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3f8064240 0x7ff3f8064620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:45230/0 (socket says 172.21.15.146:45230) 2021-01-27T09:54:10.042 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.033+0000 7ff3fe182700 1 -- 172.21.15.146:0/621162988 learned_addr learned my addr 172.21.15.146:0/621162988 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:54:10.042 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.033+0000 7ff3fe182700 1 -- 172.21.15.146:0/621162988 >> v2:172.21.15.78:3300/0 conn(0x7ff3f80637e0 msgr2=0x7ff3f80b8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:54:10.042 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.033+0000 7ff3fe182700 1 --2- 172.21.15.146:0/621162988 >> v2:172.21.15.78:3300/0 conn(0x7ff3f80637e0 0x7ff3f80b8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.043 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.033+0000 7ff3fe182700 1 -- 172.21.15.146:0/621162988 >> v1:172.21.15.146:6789/0 conn(0x7ff3f814bc10 legacy=0x7ff3f8148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:10.043 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.033+0000 7ff3fe182700 1 -- 172.21.15.146:0/621162988 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f80b83d0 con 0x7ff3f8064240 2021-01-27T09:54:10.043 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.033+0000 7ff3fd180700 1 -- 172.21.15.146:0/621162988 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991156086 0 0) 0x7ff3f814c580 con 0x7ff3f814bc10 2021-01-27T09:54:10.043 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.037+0000 7ff3fe182700 1 --2- 172.21.15.146:0/621162988 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3f8064240 0x7ff3f8064620 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7ff3f400ba70 tx=0x7ff3f4006e80).ready entity=mon.2 client_cookie=43fe3ad0bf96fe1c server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:10.045 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.037+0000 7ff3fd180700 1 -- 172.21.15.146:0/621162988 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4006030 con 0x7ff3f8064240 2021-01-27T09:54:10.045 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.037+0000 7ff3fd180700 1 -- 172.21.15.146:0/621162988 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff3f4006190 con 0x7ff3f8064240 2021-01-27T09:54:10.045 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.037+0000 7ff3fd180700 1 -- 172.21.15.146:0/621162988 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4006510 con 0x7ff3f8064240 2021-01-27T09:54:10.045 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.037+0000 7ff3ff184700 1 -- 172.21.15.146:0/621162988 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3f8064240 msgr2=0x7ff3f8064620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:10.045 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.037+0000 7ff3ff184700 1 --2- 172.21.15.146:0/621162988 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3f8064240 0x7ff3f8064620 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7ff3f400ba70 tx=0x7ff3f4006e80).stop 2021-01-27T09:54:10.046 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.037+0000 7ff3ff184700 1 -- 172.21.15.146:0/621162988 shutdown_connections 2021-01-27T09:54:10.046 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.037+0000 7ff3ff184700 1 --2- 172.21.15.146:0/621162988 >> v2:172.21.15.78:3300/0 conn(0x7ff3f80637e0 0x7ff3f80b8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.046 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.037+0000 7ff3ff184700 1 --2- 172.21.15.146:0/621162988 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3f8064240 0x7ff3f8064620 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.046 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.037+0000 7ff3ff184700 1 -- 172.21.15.146:0/621162988 >> 172.21.15.146:0/621162988 conn(0x7ff3f80652c0 msgr2=0x7ff3f8067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:54:10.047 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.037+0000 7ff3ff184700 1 -- 172.21.15.146:0/621162988 shutdown_connections 2021-01-27T09:54:10.047 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.037+0000 7ff3ff184700 1 -- 172.21.15.146:0/621162988 wait complete. 2021-01-27T09:54:10.048 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.041+0000 7ff3ff184700 1 Processor -- start 2021-01-27T09:54:10.048 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.041+0000 7ff3ff184700 1 -- start start 2021-01-27T09:54:10.048 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.041+0000 7ff3ff184700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3f80637e0 0x7ff3f815e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:10.048 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.041+0000 7ff3ff184700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3f8064240 0x7ff3f814d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.041+0000 7ff3ff184700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3f814bc10 0x7ff3f80bbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.041+0000 7ff3ff184700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f8066c10 con 0x7ff3f80637e0 2021-01-27T09:54:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.041+0000 7ff3ff184700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f815e6b0 con 0x7ff3f8064240 2021-01-27T09:54:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.041+0000 7ff3ff184700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f814d870 con 0x7ff3f814bc10 2021-01-27T09:54:10.051 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.041+0000 7ff3fe182700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3f80637e0 0x7ff3f815e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:10.051 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.041+0000 7ff3fe182700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3f80637e0 0x7ff3f815e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:58624/0 (socket says 172.21.15.146:58624) 2021-01-27T09:54:10.051 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.041+0000 7ff3fe182700 1 -- 172.21.15.146:0/1076204372 learned_addr learned my addr 172.21.15.146:0/1076204372 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:54:10.051 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.041+0000 7ff3fd981700 1 --2- 172.21.15.146:0/1076204372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3f8064240 0x7ff3f814d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:10.052 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.041+0000 7ff3fe983700 1 --2- 172.21.15.146:0/1076204372 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3f814bc10 0x7ff3f80bbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:10.052 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.041+0000 7ff3fe182700 1 -- 172.21.15.146:0/1076204372 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3f814bc10 msgr2=0x7ff3f80bbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:10.052 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.041+0000 7ff3fe182700 1 --2- 172.21.15.146:0/1076204372 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3f814bc10 0x7ff3f80bbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.052 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.041+0000 7ff3fe182700 1 -- 172.21.15.146:0/1076204372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3f8064240 msgr2=0x7ff3f814d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:10.052 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.041+0000 7ff3fe182700 1 --2- 172.21.15.146:0/1076204372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3f8064240 0x7ff3f814d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.053 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.045+0000 7ff3fe182700 1 -- 172.21.15.146:0/1076204372 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f8143ce0 con 0x7ff3f80637e0 2021-01-27T09:54:10.053 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.045+0000 7ff3fd981700 1 --2- 172.21.15.146:0/1076204372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3f8064240 0x7ff3f814d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:54:10.053 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.045+0000 7ff3fe182700 1 --2- 172.21.15.146:0/1076204372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3f80637e0 0x7ff3f815e1c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7ff3f4009340 tx=0x7ff3f4006e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:10.053 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.045+0000 7ff3e67fc700 1 -- 172.21.15.146:0/1076204372 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4005910 con 0x7ff3f80637e0 2021-01-27T09:54:10.053 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.045+0000 7ff3e67fc700 1 -- 172.21.15.146:0/1076204372 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff3f4005a70 con 0x7ff3f80637e0 2021-01-27T09:54:10.054 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.045+0000 7ff3e67fc700 1 -- 172.21.15.146:0/1076204372 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4005e50 con 0x7ff3f80637e0 2021-01-27T09:54:10.054 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.045+0000 7ff3ff184700 1 -- 172.21.15.146:0/1076204372 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f814daf0 con 0x7ff3f80637e0 2021-01-27T09:54:10.054 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.045+0000 7ff3ff184700 1 -- 172.21.15.146:0/1076204372 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f8065f90 con 0x7ff3f80637e0 2021-01-27T09:54:10.055 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.045+0000 7ff3ff184700 1 -- 172.21.15.146:0/1076204372 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f80b6000 con 0x7ff3f80637e0 2021-01-27T09:54:10.055 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.049+0000 7ff3e67fc700 1 -- 172.21.15.146:0/1076204372 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7ff3f4025030 con 0x7ff3f80637e0 2021-01-27T09:54:10.055 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.049+0000 7ff3e67fc700 1 --2- 172.21.15.146:0/1076204372 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff3d80561e0 0x7ff3d80586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:10.056 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.049+0000 7ff3e67fc700 1 -- 172.21.15.146:0/1076204372 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7ff3f4071430 con 0x7ff3f80637e0 2021-01-27T09:54:10.056 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.049+0000 7ff3fd981700 1 --2- 172.21.15.146:0/1076204372 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff3d80561e0 0x7ff3d80586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:10.056 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.049+0000 7ff3fd981700 1 --2- 172.21.15.146:0/1076204372 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff3d80561e0 0x7ff3d80586a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7ff3f81484f0 tx=0x7ff3e8006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:10.059 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.053+0000 7ff3e67fc700 1 -- 172.21.15.146:0/1076204372 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7ff3f4046a00 con 0x7ff3f80637e0 2021-01-27T09:54:10.237 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.229+0000 7ff3ff184700 1 -- 172.21.15.146:0/1076204372 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3f8044680 con 0x7ff3f80637e0 2021-01-27T09:54:10.238 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.233+0000 7ff3e67fc700 1 -- 172.21.15.146:0/1076204372 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+3581 (secure 0 0 0) 0x7ff3f402d020 con 0x7ff3f80637e0 2021-01-27T09:54:10.239 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:54:10.239 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4835,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.78:6837/546715319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":546715319},{"type":"v1","addr":"172.21.15.78:6837","nonce":546715319}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:53:16.707583+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5040,"mds_1":4287,"mds_2":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[0],"features":4540138297136906239,"flags":0},"gid_4971":{"gid":4971,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[0],"features":4540138297136906239,"flags":0},"gid_5040":{"gid":5040,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":41,"addr":"172.21.15.146:6835/3537280353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3537280353},{"type":"v1","addr":"172.21.15.146:6835","nonce":3537280353}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:54:10.241 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.233+0000 7ff3ff184700 1 -- 172.21.15.146:0/1076204372 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff3d80561e0 msgr2=0x7ff3d80586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:10.241 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.233+0000 7ff3ff184700 1 --2- 172.21.15.146:0/1076204372 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff3d80561e0 0x7ff3d80586a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7ff3f81484f0 tx=0x7ff3e8006e20).stop 2021-01-27T09:54:10.241 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.233+0000 7ff3ff184700 1 -- 172.21.15.146:0/1076204372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3f80637e0 msgr2=0x7ff3f815e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:10.241 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.233+0000 7ff3ff184700 1 --2- 172.21.15.146:0/1076204372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3f80637e0 0x7ff3f815e1c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7ff3f4009340 tx=0x7ff3f4006e80).stop 2021-01-27T09:54:10.242 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.233+0000 7ff3ff184700 1 -- 172.21.15.146:0/1076204372 shutdown_connections 2021-01-27T09:54:10.242 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.233+0000 7ff3ff184700 1 --2- 172.21.15.146:0/1076204372 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3f814bc10 0x7ff3f80bbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.242 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.233+0000 7ff3ff184700 1 --2- 172.21.15.146:0/1076204372 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7ff3d80561e0 0x7ff3d80586a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.242 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.233+0000 7ff3ff184700 1 --2- 172.21.15.146:0/1076204372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3f8064240 0x7ff3f814d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.243 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.233+0000 7ff3ff184700 1 --2- 172.21.15.146:0/1076204372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3f80637e0 0x7ff3f815e1c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.243 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.233+0000 7ff3ff184700 1 -- 172.21.15.146:0/1076204372 >> 172.21.15.146:0/1076204372 conn(0x7ff3f80652c0 msgr2=0x7ff3f8149ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:54:10.243 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.237+0000 7ff3ff184700 1 -- 172.21.15.146:0/1076204372 shutdown_connections 2021-01-27T09:54:10.243 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.237+0000 7ff3ff184700 1 -- 172.21.15.146:0/1076204372 wait complete. 2021-01-27T09:54:10.244 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 36 2021-01-27T09:54:10.268 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-01-27T09:54:10.428 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.421+0000 7fadd26c3700 1 Processor -- start 2021-01-27T09:54:10.429 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.421+0000 7fadd26c3700 1 -- start start 2021-01-27T09:54:10.430 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.425+0000 7fadd26c3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fadcc0629b0 0x7fadcc069910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:10.430 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.425+0000 7fadd26c3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadcc062d90 0x7fadcc0bb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:10.431 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.425+0000 7fadd26c3700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadcc06a0c0 con 0x7fadcc152070 2021-01-27T09:54:10.431 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.425+0000 7fadd26c3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadcc06a360 con 0x7fadcc0629b0 2021-01-27T09:54:10.431 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.425+0000 7fadd26c3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc1513f0 con 0x7fadcc062d90 2021-01-27T09:54:10.432 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.425+0000 7fadd0c60700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadcc062d90 0x7fadcc0bb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:10.432 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.425+0000 7fadcbfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fadcc0629b0 0x7fadcc069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:10.433 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.425+0000 7fadd0c60700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadcc062d90 0x7fadcc0bb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:45246/0 (socket says 172.21.15.146:45246) 2021-01-27T09:54:10.433 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.425+0000 7fadd0c60700 1 -- 172.21.15.146:0/3010443582 learned_addr learned my addr 172.21.15.146:0/3010443582 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:54:10.433 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.425+0000 7fadd0c60700 1 -- 172.21.15.146:0/3010443582 >> v2:172.21.15.146:3300/0 conn(0x7fadcc0629b0 msgr2=0x7fadcc069910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:54:10.433 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.425+0000 7fadd0c60700 1 --2- 172.21.15.146:0/3010443582 >> v2:172.21.15.146:3300/0 conn(0x7fadcc0629b0 0x7fadcc069910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.433 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.425+0000 7fadcaffd700 1 -- 172.21.15.146:0/3010443582 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049825938 0 0) 0x7fadcc06a0c0 con 0x7fadcc152070 2021-01-27T09:54:10.434 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.425+0000 7fadd0c60700 1 -- 172.21.15.146:0/3010443582 >> v1:172.21.15.78:6789/0 conn(0x7fadcc152070 legacy=0x7fadcc14de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:10.434 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.425+0000 7fadd0c60700 1 -- 172.21.15.146:0/3010443582 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc151690 con 0x7fadcc062d90 2021-01-27T09:54:10.434 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.425+0000 7fadcbfff700 1 --2- 172.21.15.146:0/3010443582 >> v2:172.21.15.146:3300/0 conn(0x7fadcc0629b0 0x7fadcc069910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:54:10.434 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.425+0000 7fadd0c60700 1 --2- 172.21.15.146:0/3010443582 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadcc062d90 0x7fadcc0bb020 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fadc4009d90 tx=0x7fadc40092d0).ready entity=mon.2 client_cookie=afebbd04fbe0f416 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:10.435 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.425+0000 7fadcaffd700 1 -- 172.21.15.146:0/3010443582 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc400bbf0 con 0x7fadcc062d90 2021-01-27T09:54:10.436 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.425+0000 7fadcaffd700 1 -- 172.21.15.146:0/3010443582 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fadc400bd50 con 0x7fadcc062d90 2021-01-27T09:54:10.436 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.425+0000 7fadcaffd700 1 -- 172.21.15.146:0/3010443582 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc4011610 con 0x7fadcc062d90 2021-01-27T09:54:10.436 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.429+0000 7fadd26c3700 1 -- 172.21.15.146:0/3010443582 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadcc062d90 msgr2=0x7fadcc0bb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:10.437 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.429+0000 7fadd26c3700 1 --2- 172.21.15.146:0/3010443582 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadcc062d90 0x7fadcc0bb020 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fadc4009d90 tx=0x7fadc40092d0).stop 2021-01-27T09:54:10.437 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.429+0000 7fadd26c3700 1 -- 172.21.15.146:0/3010443582 shutdown_connections 2021-01-27T09:54:10.437 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.429+0000 7fadd26c3700 1 --2- 172.21.15.146:0/3010443582 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadcc062d90 0x7fadcc0bb020 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.438 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.429+0000 7fadd26c3700 1 --2- 172.21.15.146:0/3010443582 >> v2:172.21.15.146:3300/0 conn(0x7fadcc0629b0 0x7fadcc069910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.438 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.429+0000 7fadd26c3700 1 -- 172.21.15.146:0/3010443582 >> 172.21.15.146:0/3010443582 conn(0x7fadcc0bf6f0 msgr2=0x7fadcc067230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:54:10.438 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.429+0000 7fadd26c3700 1 -- 172.21.15.146:0/3010443582 shutdown_connections 2021-01-27T09:54:10.438 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.429+0000 7fadd26c3700 1 -- 172.21.15.146:0/3010443582 wait complete. 2021-01-27T09:54:10.438 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.429+0000 7fadd26c3700 1 Processor -- start 2021-01-27T09:54:10.440 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.429+0000 7fadd26c3700 1 -- start start 2021-01-27T09:54:10.440 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.433+0000 7fadd26c3700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadcc0629b0 0x7fadcc061100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:10.441 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.433+0000 7fadd26c3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadcc062d90 0x7fadcc0615f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:10.441 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.433+0000 7fadd26c3700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadcc152070 0x7fadcc13bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:10.441 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.433+0000 7fadd26c3700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc143480 con 0x7fadcc0629b0 2021-01-27T09:54:10.441 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.433+0000 7fadd26c3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc142000 con 0x7fadcc062d90 2021-01-27T09:54:10.441 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.433+0000 7fadd26c3700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc1422a0 con 0x7fadcc152070 2021-01-27T09:54:10.442 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.433+0000 7fadcbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadcc0629b0 0x7fadcc061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:10.442 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.433+0000 7fadcb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadcc062d90 0x7fadcc0615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:10.442 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.433+0000 7fadcbfff700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadcc0629b0 0x7fadcc061100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:58638/0 (socket says 172.21.15.146:58638) 2021-01-27T09:54:10.442 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.433+0000 7fadcbfff700 1 -- 172.21.15.146:0/2466611359 learned_addr learned my addr 172.21.15.146:0/2466611359 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:54:10.443 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.433+0000 7fadd0c60700 1 --2- 172.21.15.146:0/2466611359 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadcc152070 0x7fadcc13bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:10.443 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.433+0000 7fadcb7fe700 1 -- 172.21.15.146:0/2466611359 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadcc152070 msgr2=0x7fadcc13bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:10.443 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.433+0000 7fadcb7fe700 1 --2- 172.21.15.146:0/2466611359 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadcc152070 0x7fadcc13bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.443 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.433+0000 7fadcb7fe700 1 -- 172.21.15.146:0/2466611359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadcc0629b0 msgr2=0x7fadcc061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:10.443 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.433+0000 7fadcb7fe700 1 --2- 172.21.15.146:0/2466611359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadcc0629b0 0x7fadcc061100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.444 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.433+0000 7fadcb7fe700 1 -- 172.21.15.146:0/2466611359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc14fcc0 con 0x7fadcc062d90 2021-01-27T09:54:10.444 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.433+0000 7fadcb7fe700 1 --2- 172.21.15.146:0/2466611359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadcc062d90 0x7fadcc0615f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fadcc14ef20 tx=0x7fadc0007a50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:10.444 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.433+0000 7fadb3fff700 1 -- 172.21.15.146:0/2466611359 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0013410 con 0x7fadcc062d90 2021-01-27T09:54:10.444 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.433+0000 7fadb3fff700 1 -- 172.21.15.146:0/2466611359 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fadc0013570 con 0x7fadcc062d90 2021-01-27T09:54:10.444 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.433+0000 7fadd26c3700 1 -- 172.21.15.146:0/2466611359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadcc14ff60 con 0x7fadcc062d90 2021-01-27T09:54:10.445 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.433+0000 7fadb3fff700 1 -- 172.21.15.146:0/2466611359 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0013950 con 0x7fadcc062d90 2021-01-27T09:54:10.445 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.433+0000 7fadd26c3700 1 -- 172.21.15.146:0/2466611359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadcc140720 con 0x7fadcc062d90 2021-01-27T09:54:10.446 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.437+0000 7fadb3fff700 1 -- 172.21.15.146:0/2466611359 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fadc0010030 con 0x7fadcc062d90 2021-01-27T09:54:10.446 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.437+0000 7fadd26c3700 1 -- 172.21.15.146:0/2466611359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadcc1424a0 con 0x7fadcc062d90 2021-01-27T09:54:10.446 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.437+0000 7fadb3fff700 1 --2- 172.21.15.146:0/2466611359 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fadac0561e0 0x7fadac0586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:10.446 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.437+0000 7fadb3fff700 1 -- 172.21.15.146:0/2466611359 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7fadc006f120 con 0x7fadcc062d90 2021-01-27T09:54:10.447 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.437+0000 7fadcbfff700 1 --2- 172.21.15.146:0/2466611359 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fadac0561e0 0x7fadac0586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:10.447 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.437+0000 7fadcbfff700 1 --2- 172.21.15.146:0/2466611359 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fadac0561e0 0x7fadac0586a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fadbc006ac0 tx=0x7fadbc006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:10.448 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.441+0000 7fadb3fff700 1 -- 172.21.15.146:0/2466611359 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fadc0044750 con 0x7fadcc062d90 2021-01-27T09:54:10.620 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.613+0000 7fadd26c3700 1 -- 172.21.15.146:0/2466611359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadcc044ee0 con 0x7fadcc062d90 2021-01-27T09:54:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.617+0000 7fadb3fff700 1 -- 172.21.15.146:0/2466611359 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+3581 (secure 0 0 0) 0x7fadc0001e60 con 0x7fadcc062d90 2021-01-27T09:54:10.622 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:54:10.622 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2572346312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2572346312},{"type":"v1","addr":"172.21.15.78:6835","nonce":2572346312}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/148943173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":148943173},{"type":"v1","addr":"172.21.15.78:6839","nonce":148943173}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3},{"gid":4835,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.78:6837/546715319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":546715319},{"type":"v1","addr":"172.21.15.78:6837","nonce":546715319}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":35}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-27T09:44:29.315988+0000","modified":"2021-01-27T09:53:16.707583+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5040,"mds_1":4287,"mds_2":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.146:6834/2738812606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2738812606},{"type":"v1","addr":"172.21.15.146:6834","nonce":2738812606}]},"join_fscid":-1,"export_targets":[0],"features":4540138297136906239,"flags":0},"gid_4971":{"gid":4971,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.146:6837/3665040070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3665040070},{"type":"v1","addr":"172.21.15.146:6837","nonce":3665040070}]},"join_fscid":-1,"export_targets":[0],"features":4540138297136906239,"flags":0},"gid_5040":{"gid":5040,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":41,"addr":"172.21.15.146:6835/3537280353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3537280353},{"type":"v1","addr":"172.21.15.146:6835","nonce":3537280353}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-27T09:54:10.623 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.617+0000 7fadd26c3700 1 -- 172.21.15.146:0/2466611359 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fadac0561e0 msgr2=0x7fadac0586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:10.624 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.617+0000 7fadd26c3700 1 --2- 172.21.15.146:0/2466611359 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fadac0561e0 0x7fadac0586a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fadbc006ac0 tx=0x7fadbc006e20).stop 2021-01-27T09:54:10.624 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.617+0000 7fadd26c3700 1 -- 172.21.15.146:0/2466611359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadcc062d90 msgr2=0x7fadcc0615f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:10.624 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.617+0000 7fadd26c3700 1 --2- 172.21.15.146:0/2466611359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadcc062d90 0x7fadcc0615f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fadcc14ef20 tx=0x7fadc0007a50).stop 2021-01-27T09:54:10.624 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.617+0000 7fadd26c3700 1 -- 172.21.15.146:0/2466611359 shutdown_connections 2021-01-27T09:54:10.625 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.617+0000 7fadd26c3700 1 --2- 172.21.15.146:0/2466611359 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadcc152070 0x7fadcc13bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.625 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.617+0000 7fadd26c3700 1 --2- 172.21.15.146:0/2466611359 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fadac0561e0 0x7fadac0586a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.625 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.617+0000 7fadd26c3700 1 --2- 172.21.15.146:0/2466611359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadcc062d90 0x7fadcc0615f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.625 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.617+0000 7fadd26c3700 1 --2- 172.21.15.146:0/2466611359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadcc0629b0 0x7fadcc061100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.625 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.617+0000 7fadd26c3700 1 -- 172.21.15.146:0/2466611359 >> 172.21.15.146:0/2466611359 conn(0x7fadcc0bf6f0 msgr2=0x7fadcc0baf20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:54:10.626 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.617+0000 7fadd26c3700 1 -- 172.21.15.146:0/2466611359 shutdown_connections 2021-01-27T09:54:10.626 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.617+0000 7fadd26c3700 1 -- 172.21.15.146:0/2466611359 wait complete. 2021-01-27T09:54:10.628 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 36 2021-01-27T09:54:10.652 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-01-27T09:54:10.820 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.813+0000 7f7f95d2c700 1 Processor -- start 2021-01-27T09:54:10.820 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.813+0000 7f7f95d2c700 1 -- start start 2021-01-27T09:54:10.821 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.813+0000 7f7f95d2c700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7f900692b0 0x7f7f900bcc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:10.821 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.813+0000 7f7f95d2c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f90069690 0x7f7f900bd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.813+0000 7f7f95d2c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7f9014bac0 0x7f7f9014bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.813+0000 7f7f95d2c700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f90152ec0 con 0x7f7f900692b0 2021-01-27T09:54:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.813+0000 7f7f95d2c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f900be1b0 con 0x7f7f9014bac0 2021-01-27T09:54:10.823 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.813+0000 7f7f95d2c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f900be450 con 0x7f7f90069690 2021-01-27T09:54:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f94d2a700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7f900692b0 0x7f7f900bcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:10.825 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f87fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f90069690 0x7f7f900bd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:10.825 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f87fff700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f90069690 0x7f7f900bd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.146:45258/0 (socket says 172.21.15.146:45258) 2021-01-27T09:54:10.825 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f87fff700 1 -- 172.21.15.146:0/390699461 learned_addr learned my addr 172.21.15.146:0/390699461 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:54:10.825 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f9552b700 1 --2- 172.21.15.146:0/390699461 >> v2:172.21.15.146:3300/0 conn(0x7f7f9014bac0 0x7f7f9014bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f94d2a700 1 -- 172.21.15.146:0/390699461 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f90069690 msgr2=0x7f7f900bd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:54:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f94d2a700 1 --2- 172.21.15.146:0/390699461 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f90069690 0x7f7f900bd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f94d2a700 1 -- 172.21.15.146:0/390699461 >> v2:172.21.15.146:3300/0 conn(0x7f7f9014bac0 msgr2=0x7f7f9014bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:54:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f94d2a700 1 --2- 172.21.15.146:0/390699461 >> v2:172.21.15.146:3300/0 conn(0x7f7f9014bac0 0x7f7f9014bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f94d2a700 1 -- 172.21.15.146:0/390699461 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f900be6f0 con 0x7f7f900692b0 2021-01-27T09:54:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f87fff700 1 --2- 172.21.15.146:0/390699461 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f90069690 0x7f7f900bd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:54:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f94d2a700 1 --2- 172.21.15.146:0/390699461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f900692b0 0x7f7f900bcc20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f7f90064dd0 tx=0x7f7f8c009220).ready entity=mon.0 client_cookie=d966370d25bb41e4 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f877fe700 1 -- 172.21.15.146:0/390699461 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c00b930 con 0x7f7f900692b0 2021-01-27T09:54:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f877fe700 1 -- 172.21.15.146:0/390699461 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7f8c00ba90 con 0x7f7f900692b0 2021-01-27T09:54:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f877fe700 1 -- 172.21.15.146:0/390699461 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c00be50 con 0x7f7f900692b0 2021-01-27T09:54:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f95d2c700 1 -- 172.21.15.146:0/390699461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f900692b0 msgr2=0x7f7f900bcc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f95d2c700 1 --2- 172.21.15.146:0/390699461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f900692b0 0x7f7f900bcc20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f7f90064dd0 tx=0x7f7f8c009220).stop 2021-01-27T09:54:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f95d2c700 1 -- 172.21.15.146:0/390699461 shutdown_connections 2021-01-27T09:54:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f95d2c700 1 --2- 172.21.15.146:0/390699461 >> v2:172.21.15.146:3300/0 conn(0x7f7f9014bac0 0x7f7f9014bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f95d2c700 1 --2- 172.21.15.146:0/390699461 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f90069690 0x7f7f900bd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f95d2c700 1 --2- 172.21.15.146:0/390699461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f900692b0 0x7f7f900bcc20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f95d2c700 1 -- 172.21.15.146:0/390699461 >> 172.21.15.146:0/390699461 conn(0x7f7f90064240 msgr2=0x7f7f900601f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:54:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f95d2c700 1 -- 172.21.15.146:0/390699461 shutdown_connections 2021-01-27T09:54:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.817+0000 7f7f95d2c700 1 -- 172.21.15.146:0/390699461 wait complete. 2021-01-27T09:54:10.831 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.821+0000 7f7f95d2c700 1 Processor -- start 2021-01-27T09:54:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.821+0000 7f7f95d2c700 1 -- start start 2021-01-27T09:54:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.821+0000 7f7f95d2c700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f900692b0 0x7f7f90155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.821+0000 7f7f95d2c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f90069690 0x7f7f90154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.821+0000 7f7f95d2c700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f9014bac0 0x7f7f9014d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.821+0000 7f7f95d2c700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9014c970 con 0x7f7f900692b0 2021-01-27T09:54:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.821+0000 7f7f95d2c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9014cc10 con 0x7f7f90069690 2021-01-27T09:54:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.821+0000 7f7f95d2c700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9014ceb0 con 0x7f7f9014bac0 2021-01-27T09:54:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.825+0000 7f7f94d2a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f900692b0 0x7f7f90155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.825+0000 7f7f87fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f90069690 0x7f7f90154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.825+0000 7f7f94d2a700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f900692b0 0x7f7f90155990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:58652/0 (socket says 172.21.15.146:58652) 2021-01-27T09:54:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.825+0000 7f7f94d2a700 1 -- 172.21.15.146:0/3434084436 learned_addr learned my addr 172.21.15.146:0/3434084436 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:54:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.825+0000 7f7f9552b700 1 --2- 172.21.15.146:0/3434084436 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f9014bac0 0x7f7f9014d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:10.835 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.825+0000 7f7f87fff700 1 -- 172.21.15.146:0/3434084436 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f9014bac0 msgr2=0x7f7f9014d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:10.835 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.825+0000 7f7f87fff700 1 --2- 172.21.15.146:0/3434084436 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f9014bac0 0x7f7f9014d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.835 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.825+0000 7f7f87fff700 1 -- 172.21.15.146:0/3434084436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f900692b0 msgr2=0x7f7f90155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:10.835 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.825+0000 7f7f87fff700 1 --2- 172.21.15.146:0/3434084436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f900692b0 0x7f7f90155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.825+0000 7f7f87fff700 1 -- 172.21.15.146:0/3434084436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f90153540 con 0x7f7f90069690 2021-01-27T09:54:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.825+0000 7f7f87fff700 1 --2- 172.21.15.146:0/3434084436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f90069690 0x7f7f90154fc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f7f90069ae0 tx=0x7f7f80008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.825+0000 7f7f84ff9700 1 -- 172.21.15.146:0/3434084436 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8000be30 con 0x7f7f90069690 2021-01-27T09:54:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.825+0000 7f7f84ff9700 1 -- 172.21.15.146:0/3434084436 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7f8000d8f0 con 0x7f7f90069690 2021-01-27T09:54:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.825+0000 7f7f95d2c700 1 -- 172.21.15.146:0/3434084436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f90155f90 con 0x7f7f90069690 2021-01-27T09:54:10.837 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.825+0000 7f7f84ff9700 1 -- 172.21.15.146:0/3434084436 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8000dc90 con 0x7f7f90069690 2021-01-27T09:54:10.837 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.825+0000 7f7f95d2c700 1 -- 172.21.15.146:0/3434084436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f9014dc40 con 0x7f7f90069690 2021-01-27T09:54:10.838 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.825+0000 7f7f95d2c700 1 -- 172.21.15.146:0/3434084436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f90063d90 con 0x7f7f90069690 2021-01-27T09:54:10.838 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.829+0000 7f7f84ff9700 1 -- 172.21.15.146:0/3434084436 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f7f80023070 con 0x7f7f90069690 2021-01-27T09:54:10.838 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.829+0000 7f7f84ff9700 1 --2- 172.21.15.146:0/3434084436 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f7f700561b0 0x7f7f70058670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:10.839 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.829+0000 7f7f84ff9700 1 -- 172.21.15.146:0/3434084436 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7f7f8006fa20 con 0x7f7f90069690 2021-01-27T09:54:10.839 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.829+0000 7f7f94d2a700 1 --2- 172.21.15.146:0/3434084436 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f7f700561b0 0x7f7f70058670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:10.839 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.829+0000 7f7f94d2a700 1 --2- 172.21.15.146:0/3434084436 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f7f700561b0 0x7f7f70058670 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f7f8c009b40 tx=0x7f7f8c009220).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:10.840 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.833+0000 7f7f84ff9700 1 -- 172.21.15.146:0/3434084436 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f7f80045050 con 0x7f7f90069690 2021-01-27T09:54:10.984 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.977+0000 7f7f95d2c700 1 -- 172.21.15.146:0/3434084436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f90044680 con 0x7f7f90069690 2021-01-27T09:54:10.985 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.977+0000 7f7f84ff9700 1 -- 172.21.15.146:0/3434084436 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19029 (secure 0 0 0) 0x7f7f80017020 con 0x7f7f90069690 2021-01-27T09:54:10.986 INFO:teuthology.orchestra.run.smithi146.stdout: 2021-01-27T09:54:10.986 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"fsid":"968a1bec-aac5-444e-b70f-7770587be945","created":"2021-01-27T09:44:13.797940+0000","modified":"2021-01-27T09:51:48.650675+0000","last_up_change":"2021-01-27T09:44:23.479967+0000","last_in_change":"2021-01-27T09:44:23.479967+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T09:44:18.497521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-27T09:44:24.550303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-27T09:44:27.607542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-27T09:44:28.331389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2021-01-27T09:44:31.378452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"25441909-a40b-4d82-828d-326685513ec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":14470},{"type":"v1","addr":"172.21.15.146:6801","nonce":14470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":14470},{"type":"v1","addr":"172.21.15.146:6803","nonce":14470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":14470},{"type":"v1","addr":"172.21.15.146:6810","nonce":14470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6805","nonce":14470},{"type":"v1","addr":"172.21.15.146:6807","nonce":14470}]},"public_addr":"172.21.15.146:6801/14470","cluster_addr":"172.21.15.146:6803/14470","heartbeat_back_addr":"172.21.15.146:6810/14470","heartbeat_front_addr":"172.21.15.146:6807/14470","state":["exists","up"]},{"osd":1,"uuid":"825bbc51-2ffe-4612-a300-00960e48be02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":14472},{"type":"v1","addr":"172.21.15.146:6817","nonce":14472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":14472},{"type":"v1","addr":"172.21.15.146:6819","nonce":14472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":14472},{"type":"v1","addr":"172.21.15.146:6827","nonce":14472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":14472},{"type":"v1","addr":"172.21.15.146:6823","nonce":14472}]},"public_addr":"172.21.15.146:6817/14472","cluster_addr":"172.21.15.146:6819/14472","heartbeat_back_addr":"172.21.15.146:6827/14472","heartbeat_front_addr":"172.21.15.146:6823/14472","state":["exists","up"]},{"osd":2,"uuid":"e568b97a-8e71-4ab9-bd64-056892110b3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":14474},{"type":"v1","addr":"172.21.15.146:6822","nonce":14474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":14474},{"type":"v1","addr":"172.21.15.146:6826","nonce":14474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":14474},{"type":"v1","addr":"172.21.15.146:6831","nonce":14474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":14474},{"type":"v1","addr":"172.21.15.146:6829","nonce":14474}]},"public_addr":"172.21.15.146:6822/14474","cluster_addr":"172.21.15.146:6826/14474","heartbeat_back_addr":"172.21.15.146:6831/14474","heartbeat_front_addr":"172.21.15.146:6829/14474","state":["exists","up"]},{"osd":3,"uuid":"f5d50f63-f74a-4aea-a62d-51c38db4d002","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":14471},{"type":"v1","addr":"172.21.15.146:6806","nonce":14471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6809","nonce":14471},{"type":"v1","addr":"172.21.15.146:6811","nonce":14471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":14471},{"type":"v1","addr":"172.21.15.146:6815","nonce":14471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":14471},{"type":"v1","addr":"172.21.15.146:6813","nonce":14471}]},"public_addr":"172.21.15.146:6806/14471","cluster_addr":"172.21.15.146:6811/14471","heartbeat_back_addr":"172.21.15.146:6815/14471","heartbeat_front_addr":"172.21.15.146:6813/14471","state":["exists","up"]},{"osd":4,"uuid":"782458d7-6f52-48f4-9466-67b61ef27016","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":15826},{"type":"v1","addr":"172.21.15.78:6817","nonce":15826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":15826},{"type":"v1","addr":"172.21.15.78:6819","nonce":15826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":15826},{"type":"v1","addr":"172.21.15.78:6823","nonce":15826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":15826},{"type":"v1","addr":"172.21.15.78:6821","nonce":15826}]},"public_addr":"172.21.15.78:6817/15826","cluster_addr":"172.21.15.78:6819/15826","heartbeat_back_addr":"172.21.15.78:6823/15826","heartbeat_front_addr":"172.21.15.78:6821/15826","state":["exists","up"]},{"osd":5,"uuid":"1fe7ecf2-9eb9-44ce-a58e-4627cb9bf721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":15827},{"type":"v1","addr":"172.21.15.78:6801","nonce":15827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":15827},{"type":"v1","addr":"172.21.15.78:6803","nonce":15827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":15827},{"type":"v1","addr":"172.21.15.78:6807","nonce":15827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":15827},{"type":"v1","addr":"172.21.15.78:6805","nonce":15827}]},"public_addr":"172.21.15.78:6801/15827","cluster_addr":"172.21.15.78:6803/15827","heartbeat_back_addr":"172.21.15.78:6807/15827","heartbeat_front_addr":"172.21.15.78:6805/15827","state":["exists","up"]},{"osd":6,"uuid":"4f7d5eed-f0e9-47b0-a3e4-0bc0d2d1f7ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":15825},{"type":"v1","addr":"172.21.15.78:6809","nonce":15825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":15825},{"type":"v1","addr":"172.21.15.78:6811","nonce":15825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":15825},{"type":"v1","addr":"172.21.15.78:6815","nonce":15825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":15825},{"type":"v1","addr":"172.21.15.78:6813","nonce":15825}]},"public_addr":"172.21.15.78:6809/15825","cluster_addr":"172.21.15.78:6811/15825","heartbeat_back_addr":"172.21.15.78:6815/15825","heartbeat_front_addr":"172.21.15.78:6813/15825","state":["exists","up"]},{"osd":7,"uuid":"851aeaf3-bcdc-4ac6-b578-c42e1bf87c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":15828},{"type":"v1","addr":"172.21.15.78:6825","nonce":15828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":15828},{"type":"v1","addr":"172.21.15.78:6827","nonce":15828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":15828},{"type":"v1","addr":"172.21.15.78:6831","nonce":15828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":15828},{"type":"v1","addr":"172.21.15.78:6829","nonce":15828}]},"public_addr":"172.21.15.78:6825/15828","cluster_addr":"172.21.15.78:6827/15828","heartbeat_back_addr":"172.21.15.78:6831/15828","heartbeat_front_addr":"172.21.15.78:6829/15828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.573930+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.718144+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.641838+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.551598+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.374444+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.171108+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.360910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T09:44:21.356020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6837/1117292103":"2021-01-28T09:51:48.650615+0000","172.21.15.78:6836/1117292103":"2021-01-28T09:51:48.650615+0000","172.21.15.146:6835/1106324127":"2021-01-28T09:49:18.611057+0000","172.21.15.146:6833/1106324127":"2021-01-28T09:49:18.611057+0000","172.21.15.146:6837/745099427":"2021-01-28T09:46:58.569668+0000","172.21.15.146:6836/745099427":"2021-01-28T09:46:58.569668+0000"},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T09:54:10.987 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.981+0000 7f7f95d2c700 1 -- 172.21.15.146:0/3434084436 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f7f700561b0 msgr2=0x7f7f70058670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:10.987 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.981+0000 7f7f95d2c700 1 --2- 172.21.15.146:0/3434084436 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f7f700561b0 0x7f7f70058670 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f7f8c009b40 tx=0x7f7f8c009220).stop 2021-01-27T09:54:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.981+0000 7f7f95d2c700 1 -- 172.21.15.146:0/3434084436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f90069690 msgr2=0x7f7f90154fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.981+0000 7f7f95d2c700 1 --2- 172.21.15.146:0/3434084436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f90069690 0x7f7f90154fc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f7f90069ae0 tx=0x7f7f80008040).stop 2021-01-27T09:54:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.981+0000 7f7f95d2c700 1 -- 172.21.15.146:0/3434084436 shutdown_connections 2021-01-27T09:54:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.981+0000 7f7f95d2c700 1 --2- 172.21.15.146:0/3434084436 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f9014bac0 0x7f7f9014d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.981+0000 7f7f95d2c700 1 --2- 172.21.15.146:0/3434084436 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f7f700561b0 0x7f7f70058670 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.989 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.981+0000 7f7f95d2c700 1 --2- 172.21.15.146:0/3434084436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f90069690 0x7f7f90154fc0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.989 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.981+0000 7f7f95d2c700 1 --2- 172.21.15.146:0/3434084436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f900692b0 0x7f7f90155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:10.989 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.981+0000 7f7f95d2c700 1 -- 172.21.15.146:0/3434084436 >> 172.21.15.146:0/3434084436 conn(0x7f7f90064240 msgr2=0x7f7f90065e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:54:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.981+0000 7f7f95d2c700 1 -- 172.21.15.146:0/3434084436 shutdown_connections 2021-01-27T09:54:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:10.981+0000 7f7f95d2c700 1 -- 172.21.15.146:0/3434084436 wait complete. 2021-01-27T09:54:11.014 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-01-27T09:54:11.181 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.173+0000 7fa27eb42700 1 Processor -- start 2021-01-27T09:54:11.181 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.173+0000 7fa27eb42700 1 -- start start 2021-01-27T09:54:11.182 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27eb42700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa27814c4a0 0x7fa278067560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:11.182 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27eb42700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa27814f1c0 con 0x7fa2780682b0 2021-01-27T09:54:11.183 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27eb42700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa27814f460 con 0x7fa278067ed0 2021-01-27T09:54:11.183 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27eb42700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27814f700 con 0x7fa27814c4a0 2021-01-27T09:54:11.185 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27db40700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa278067ed0 0x7fa2780be070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55360/0 (socket says 172.21.15.146:55360) 2021-01-27T09:54:11.185 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27db40700 1 -- 172.21.15.146:0/1024157356 learned_addr learned my addr 172.21.15.146:0/1024157356 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:54:11.186 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27e341700 1 --2- 172.21.15.146:0/1024157356 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa27814c4a0 0x7fa278067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:11.186 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27cb3e700 1 -- 172.21.15.146:0/1024157356 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882337424 0 0) 0x7fa27814f1c0 con 0x7fa2780682b0 2021-01-27T09:54:11.186 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27cb3e700 1 -- 172.21.15.146:0/1024157356 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa260003270 con 0x7fa2780682b0 2021-01-27T09:54:11.186 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27cb3e700 1 -- 172.21.15.146:0/1024157356 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080838100 0 0) 0x7fa27814f460 con 0x7fa278067ed0 2021-01-27T09:54:11.187 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27cb3e700 1 -- 172.21.15.146:0/1024157356 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa27814f1c0 con 0x7fa278067ed0 2021-01-27T09:54:11.187 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27cb3e700 1 -- 172.21.15.146:0/1024157356 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 724189223 0 0) 0x7fa260003270 con 0x7fa2780682b0 2021-01-27T09:54:11.187 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27cb3e700 1 -- 172.21.15.146:0/1024157356 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa27814c4a0 msgr2=0x7fa278067560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:54:11.187 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27cb3e700 1 --2- 172.21.15.146:0/1024157356 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa27814c4a0 0x7fa278067560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:11.187 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27cb3e700 1 -- 172.21.15.146:0/1024157356 >> v1:172.21.15.146:6789/0 conn(0x7fa278067ed0 legacy=0x7fa2780be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:11.188 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27cb3e700 1 -- 172.21.15.146:0/1024157356 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27814f9a0 con 0x7fa2780682b0 2021-01-27T09:54:11.188 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27cb3e700 1 -- 172.21.15.146:0/1024157356 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3890990827 0 0) 0x7fa268001520 con 0x7fa2780682b0 2021-01-27T09:54:11.188 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27cb3e700 1 -- 172.21.15.146:0/1024157356 >> v1:172.21.15.78:6789/0 conn(0x7fa2780682b0 legacy=0x7fa27814bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:11.188 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27cb3e700 1 --2- 172.21.15.146:0/1024157356 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa260003920 0x7fa260003d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:11.188 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27cb3e700 1 --2- 172.21.15.146:0/1024157356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa260004510 0x7fa260004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:11.189 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27cb3e700 1 --2- 172.21.15.146:0/1024157356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa260004e80 0x7fa26000b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:11.189 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27cb3e700 1 -- 172.21.15.146:0/1024157356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27814f700 con 0x7fa260004e80 2021-01-27T09:54:11.189 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27cb3e700 1 -- 172.21.15.146:0/1024157356 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa260005330 con 0x7fa260004510 2021-01-27T09:54:11.189 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27cb3e700 1 -- 172.21.15.146:0/1024157356 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26000bc50 con 0x7fa260003920 2021-01-27T09:54:11.190 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27e341700 1 --2- 172.21.15.146:0/1024157356 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa27814c4a0 0x7fa278067560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:54:11.190 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27e341700 1 --2- 172.21.15.146:0/1024157356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa260004e80 0x7fa26000b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:11.190 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27db40700 1 --2- 172.21.15.146:0/1024157356 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa260003920 0x7fa260003d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:11.190 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.177+0000 7fa27d33f700 1 --2- 172.21.15.146:0/1024157356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa260004510 0x7fa260004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:11.192 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.181+0000 7fa27e341700 1 -- 172.21.15.146:0/1024157356 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa260003920 msgr2=0x7fa260003d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:54:11.193 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.181+0000 7fa27e341700 1 --2- 172.21.15.146:0/1024157356 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa260003920 0x7fa260003d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:11.193 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.181+0000 7fa27e341700 1 -- 172.21.15.146:0/1024157356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa260004510 msgr2=0x7fa260004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:54:11.193 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.181+0000 7fa27e341700 1 --2- 172.21.15.146:0/1024157356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa260004510 0x7fa260004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:11.193 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.181+0000 7fa27e341700 1 -- 172.21.15.146:0/1024157356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa260003270 con 0x7fa260004e80 2021-01-27T09:54:11.194 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.181+0000 7fa27d33f700 1 --2- 172.21.15.146:0/1024157356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa260004510 0x7fa260004990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:54:11.194 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.181+0000 7fa27e341700 1 --2- 172.21.15.146:0/1024157356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa260004e80 0x7fa26000b760 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fa27814c880 tx=0x7fa270009220).ready entity=mon.0 client_cookie=5183694dcee0b4d server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:11.194 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.181+0000 7fa27cb3e700 1 -- 172.21.15.146:0/1024157356 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27000ec30 con 0x7fa260004e80 2021-01-27T09:54:11.194 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.181+0000 7fa27cb3e700 1 -- 172.21.15.146:0/1024157356 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa27000ed90 con 0x7fa260004e80 2021-01-27T09:54:11.194 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.181+0000 7fa27cb3e700 1 -- 172.21.15.146:0/1024157356 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa270012620 con 0x7fa260004e80 2021-01-27T09:54:11.195 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.181+0000 7fa27eb42700 1 -- 172.21.15.146:0/1024157356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa260004e80 msgr2=0x7fa26000b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:11.195 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.181+0000 7fa27eb42700 1 --2- 172.21.15.146:0/1024157356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa260004e80 0x7fa26000b760 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fa27814c880 tx=0x7fa270009220).stop 2021-01-27T09:54:11.195 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.181+0000 7fa27e341700 1 -- 172.21.15.146:0/1024157356 reap_dead start 2021-01-27T09:54:11.195 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.181+0000 7fa27eb42700 1 -- 172.21.15.146:0/1024157356 shutdown_connections 2021-01-27T09:54:11.195 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.181+0000 7fa27eb42700 1 -- 172.21.15.146:0/1024157356 >> 172.21.15.146:0/1024157356 conn(0x7fa2780bf4c0 msgr2=0x7fa278069110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:54:11.196 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.181+0000 7fa27eb42700 1 -- 172.21.15.146:0/1024157356 shutdown_connections 2021-01-27T09:54:11.196 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.181+0000 7fa27eb42700 1 -- 172.21.15.146:0/1024157356 wait complete. 2021-01-27T09:54:11.196 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.185+0000 7fa27eb42700 1 Processor -- start 2021-01-27T09:54:11.196 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.185+0000 7fa27eb42700 1 -- start start 2021-01-27T09:54:11.196 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.185+0000 7fa27eb42700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2781442d0 0x7fa27814b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:11.197 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.185+0000 7fa27eb42700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2781446b0 0x7fa27815e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:11.197 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.185+0000 7fa27eb42700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa278149850 0x7fa27815ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:11.197 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.185+0000 7fa27eb42700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27814ab60 con 0x7fa2781446b0 2021-01-27T09:54:11.197 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.185+0000 7fa27eb42700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27815f2f0 con 0x7fa2781442d0 2021-01-27T09:54:11.197 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.185+0000 7fa27eb42700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27814b880 con 0x7fa278149850 2021-01-27T09:54:11.198 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.185+0000 7fa27db40700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2781442d0 0x7fa27814b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:11.198 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.185+0000 7fa27db40700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2781442d0 0x7fa27814b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55798/0 (socket says 172.21.15.146:55798) 2021-01-27T09:54:11.198 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.185+0000 7fa27db40700 1 -- 172.21.15.146:0/913027187 learned_addr learned my addr 172.21.15.146:0/913027187 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:54:11.198 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.185+0000 7fa27e341700 1 --2- 172.21.15.146:0/913027187 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa278149850 0x7fa27815ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:11.198 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.185+0000 7fa27d33f700 1 --2- 172.21.15.146:0/913027187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2781446b0 0x7fa27815e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:11.200 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.185+0000 7fa27db40700 1 -- 172.21.15.146:0/913027187 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa278149850 msgr2=0x7fa27815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:11.200 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.185+0000 7fa27db40700 1 --2- 172.21.15.146:0/913027187 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa278149850 0x7fa27815ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:11.200 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.185+0000 7fa27db40700 1 -- 172.21.15.146:0/913027187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2781446b0 msgr2=0x7fa27815e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:11.201 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.185+0000 7fa27db40700 1 --2- 172.21.15.146:0/913027187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2781446b0 0x7fa27815e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:11.201 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.185+0000 7fa27db40700 1 -- 172.21.15.146:0/913027187 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27813a3f0 con 0x7fa2781442d0 2021-01-27T09:54:11.201 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.189+0000 7fa27db40700 1 --2- 172.21.15.146:0/913027187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2781442d0 0x7fa27814b0d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fa274001960 tx=0x7fa274007cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:11.201 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.189+0000 7fa265ffb700 1 -- 172.21.15.146:0/913027187 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27400f5e0 con 0x7fa2781442d0 2021-01-27T09:54:11.202 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.189+0000 7fa265ffb700 1 -- 172.21.15.146:0/913027187 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa27400f740 con 0x7fa2781442d0 2021-01-27T09:54:11.202 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.189+0000 7fa27eb42700 1 -- 172.21.15.146:0/913027187 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa27813a1c0 con 0x7fa2781442d0 2021-01-27T09:54:11.202 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.189+0000 7fa265ffb700 1 -- 172.21.15.146:0/913027187 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27400fb20 con 0x7fa2781442d0 2021-01-27T09:54:11.202 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.189+0000 7fa27eb42700 1 -- 172.21.15.146:0/913027187 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa27815dbd0 con 0x7fa2781442d0 2021-01-27T09:54:11.202 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.189+0000 7fa27eb42700 1 -- 172.21.15.146:0/913027187 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa27806a190 con 0x7fa2781442d0 2021-01-27T09:54:11.203 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.189+0000 7fa265ffb700 1 -- 172.21.15.146:0/913027187 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fa27401b030 con 0x7fa2781442d0 2021-01-27T09:54:11.203 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.193+0000 7fa265ffb700 1 --2- 172.21.15.146:0/913027187 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa258056210 0x7fa2580586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:11.203 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.193+0000 7fa265ffb700 1 -- 172.21.15.146:0/913027187 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7083+0+0 (secure 0 0 0) 0x7fa27406ed10 con 0x7fa2781442d0 2021-01-27T09:54:11.203 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.193+0000 7fa27d33f700 1 --2- 172.21.15.146:0/913027187 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa258056210 0x7fa2580586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:11.203 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.193+0000 7fa27d33f700 1 --2- 172.21.15.146:0/913027187 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa258056210 0x7fa2580586d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fa2680013f0 tx=0x7fa268001010).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:11.204 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.197+0000 7fa265ffb700 1 -- 172.21.15.146:0/913027187 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fa2740442c0 con 0x7fa2781442d0 2021-01-27T09:54:11.372 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.365+0000 7fa27eb42700 1 -- 172.21.15.146:0/913027187 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa27814b5c0 con 0x7fa2781442d0 2021-01-27T09:54:11.873 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.869+0000 7fa265ffb700 1 -- 172.21.15.146:0/913027187 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa2740478e0 con 0x7fa2781442d0 2021-01-27T09:54:11.878 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.873+0000 7fa27eb42700 1 -- 172.21.15.146:0/913027187 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa258056210 msgr2=0x7fa2580586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:11.879 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.873+0000 7fa27eb42700 1 --2- 172.21.15.146:0/913027187 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa258056210 0x7fa2580586d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fa2680013f0 tx=0x7fa268001010).stop 2021-01-27T09:54:11.879 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.873+0000 7fa27eb42700 1 -- 172.21.15.146:0/913027187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2781442d0 msgr2=0x7fa27814b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:11.879 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.873+0000 7fa27eb42700 1 --2- 172.21.15.146:0/913027187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2781442d0 0x7fa27814b0d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fa274001960 tx=0x7fa274007cb0).stop 2021-01-27T09:54:11.879 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.873+0000 7fa27eb42700 1 -- 172.21.15.146:0/913027187 shutdown_connections 2021-01-27T09:54:11.880 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.873+0000 7fa27eb42700 1 --2- 172.21.15.146:0/913027187 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa278149850 0x7fa27815ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:11.880 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.873+0000 7fa27eb42700 1 --2- 172.21.15.146:0/913027187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2781446b0 0x7fa27815e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:11.880 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.873+0000 7fa27eb42700 1 --2- 172.21.15.146:0/913027187 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fa258056210 0x7fa2580586d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:11.880 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.873+0000 7fa27eb42700 1 --2- 172.21.15.146:0/913027187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2781442d0 0x7fa27814b0d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:11.880 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.873+0000 7fa27eb42700 1 -- 172.21.15.146:0/913027187 >> 172.21.15.146:0/913027187 conn(0x7fa2780bf4c0 msgr2=0x7fa27813de80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:54:11.881 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.873+0000 7fa27eb42700 1 -- 172.21.15.146:0/913027187 shutdown_connections 2021-01-27T09:54:11.881 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:11.873+0000 7fa27eb42700 1 -- 172.21.15.146:0/913027187 wait complete. 2021-01-27T09:54:11.882 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-01-27T09:54:11.912 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-01-27T09:54:11.989 INFO:tasks.ceph.mds.e.smithi146.stdout:starting mds.e at 2021-01-27T09:54:11.989 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2021-01-27T09:54:11.990 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2021-01-27T09:54:12.076 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.069+0000 7fbea4b98700 1 Processor -- start 2021-01-27T09:54:12.077 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.069+0000 7fbea4b98700 1 -- start start 2021-01-27T09:54:12.079 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.073+0000 7fbea4b98700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbea0067630 0x7fbea00bd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:12.079 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.073+0000 7fbea4b98700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbea0062f30 0x7fbea014b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:12.079 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.073+0000 7fbea4b98700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea00bb360 con 0x7fbea00bcc50 2021-01-27T09:54:12.080 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.073+0000 7fbea4b98700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea00634a0 con 0x7fbea0062f30 2021-01-27T09:54:12.080 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.073+0000 7fbea4b98700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea0066120 con 0x7fbea0067630 2021-01-27T09:54:12.081 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.073+0000 7fbe9e59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbea00bcc50 0x7fbea00bac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55418/0 (socket says 172.21.15.146:55418) 2021-01-27T09:54:12.081 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.073+0000 7fbe9e59c700 1 -- 172.21.15.146:0/3803984544 learned_addr learned my addr 172.21.15.146:0/3803984544 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:54:12.082 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.073+0000 7fbe9dd9b700 1 --2- 172.21.15.146:0/3803984544 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbea0067630 0x7fbea00bd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:12.082 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.073+0000 7fbe9ed9d700 1 --2- 172.21.15.146:0/3803984544 >> v2:172.21.15.146:3300/0 conn(0x7fbea0062f30 0x7fbea014b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:12.082 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.073+0000 7fbe9dd9b700 1 -- 172.21.15.146:0/3803984544 >> v2:172.21.15.146:3300/0 conn(0x7fbea0062f30 msgr2=0x7fbea014b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:54:12.082 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.073+0000 7fbe9dd9b700 1 --2- 172.21.15.146:0/3803984544 >> v2:172.21.15.146:3300/0 conn(0x7fbea0062f30 0x7fbea014b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:12.082 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.073+0000 7fbe9dd9b700 1 -- 172.21.15.146:0/3803984544 >> v1:172.21.15.146:6789/0 conn(0x7fbea00bcc50 legacy=0x7fbea00bac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:12.083 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.073+0000 7fbe9dd9b700 1 -- 172.21.15.146:0/3803984544 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea00663c0 con 0x7fbea0067630 2021-01-27T09:54:12.083 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.073+0000 7fbe9dd9b700 1 --2- 172.21.15.146:0/3803984544 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbea0067630 0x7fbea00bd030 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fbe9400b9c0 tx=0x7fbe94006e20).ready entity=mon.2 client_cookie=49aa1fbdd96cb915 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:12.083 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.073+0000 7fbe9d59a700 1 -- 172.21.15.146:0/3803984544 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe940097e0 con 0x7fbea0067630 2021-01-27T09:54:12.083 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.077+0000 7fbe9d59a700 1 -- 172.21.15.146:0/3803984544 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbe94009940 con 0x7fbea0067630 2021-01-27T09:54:12.084 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.077+0000 7fbe9d59a700 1 -- 172.21.15.146:0/3803984544 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe94009cc0 con 0x7fbea0067630 2021-01-27T09:54:12.084 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.077+0000 7fbea4b98700 1 -- 172.21.15.146:0/3803984544 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbea0067630 msgr2=0x7fbea00bd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:12.085 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.077+0000 7fbea4b98700 1 --2- 172.21.15.146:0/3803984544 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbea0067630 0x7fbea00bd030 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fbe9400b9c0 tx=0x7fbe94006e20).stop 2021-01-27T09:54:12.085 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.077+0000 7fbea4b98700 1 -- 172.21.15.146:0/3803984544 shutdown_connections 2021-01-27T09:54:12.085 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.077+0000 7fbea4b98700 1 --2- 172.21.15.146:0/3803984544 >> v2:172.21.15.146:3300/0 conn(0x7fbea0062f30 0x7fbea014b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:12.085 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.077+0000 7fbea4b98700 1 --2- 172.21.15.146:0/3803984544 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbea0067630 0x7fbea00bd030 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:12.086 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.077+0000 7fbea4b98700 1 -- 172.21.15.146:0/3803984544 >> 172.21.15.146:0/3803984544 conn(0x7fbea0060910 msgr2=0x7fbea0062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:54:12.086 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.077+0000 7fbea4b98700 1 -- 172.21.15.146:0/3803984544 shutdown_connections 2021-01-27T09:54:12.086 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.077+0000 7fbea4b98700 1 -- 172.21.15.146:0/3803984544 wait complete. 2021-01-27T09:54:12.088 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.077+0000 7fbea4b98700 1 Processor -- start 2021-01-27T09:54:12.088 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.081+0000 7fbea4b98700 1 -- start start 2021-01-27T09:54:12.088 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.081+0000 7fbea4b98700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbea0062f30 0x7fbea00b86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:12.089 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.081+0000 7fbea4b98700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbea0067630 0x7fbea013d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:12.089 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.081+0000 7fbea4b98700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbea00bcc50 0x7fbea0135db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:12.089 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.081+0000 7fbea4b98700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea0160ba0 con 0x7fbea0067630 2021-01-27T09:54:12.089 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.081+0000 7fbea4b98700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea0160dd0 con 0x7fbea0062f30 2021-01-27T09:54:12.089 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.081+0000 7fbea4b98700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea0161070 con 0x7fbea00bcc50 2021-01-27T09:54:12.090 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.081+0000 7fbe9e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbea0062f30 0x7fbea00b86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:12.090 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.081+0000 7fbe9dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbea0067630 0x7fbea013d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:12.090 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.081+0000 7fbe9e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbea0062f30 0x7fbea00b86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55852/0 (socket says 172.21.15.146:55852) 2021-01-27T09:54:12.090 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.081+0000 7fbe9e59c700 1 -- 172.21.15.146:0/3295101756 learned_addr learned my addr 172.21.15.146:0/3295101756 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:54:12.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.081+0000 7fbe9ed9d700 1 --2- 172.21.15.146:0/3295101756 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbea00bcc50 0x7fbea0135db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:12.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.081+0000 7fbe9e59c700 1 -- 172.21.15.146:0/3295101756 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbea00bcc50 msgr2=0x7fbea0135db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:12.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.081+0000 7fbe9e59c700 1 --2- 172.21.15.146:0/3295101756 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbea00bcc50 0x7fbea0135db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:12.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.081+0000 7fbe9e59c700 1 -- 172.21.15.146:0/3295101756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbea0067630 msgr2=0x7fbea013d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:12.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.081+0000 7fbe9e59c700 1 --2- 172.21.15.146:0/3295101756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbea0067630 0x7fbea013d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:12.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.081+0000 7fbe9e59c700 1 -- 172.21.15.146:0/3295101756 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea0161310 con 0x7fbea0062f30 2021-01-27T09:54:12.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.081+0000 7fbe9e59c700 1 --2- 172.21.15.146:0/3295101756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbea0062f30 0x7fbea00b86f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fbe9000c710 tx=0x7fbe90007c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:12.093 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.081+0000 7fbe8e7fc700 1 -- 172.21.15.146:0/3295101756 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe900072e0 con 0x7fbea0062f30 2021-01-27T09:54:12.093 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.081+0000 7fbe8e7fc700 1 -- 172.21.15.146:0/3295101756 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbe90007440 con 0x7fbea0062f30 2021-01-27T09:54:12.093 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.081+0000 7fbea4b98700 1 -- 172.21.15.146:0/3295101756 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea01615b0 con 0x7fbea0062f30 2021-01-27T09:54:12.094 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.081+0000 7fbe8e7fc700 1 -- 172.21.15.146:0/3295101756 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe90005850 con 0x7fbea0062f30 2021-01-27T09:54:12.094 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.081+0000 7fbea4b98700 1 -- 172.21.15.146:0/3295101756 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea0135ac0 con 0x7fbea0062f30 2021-01-27T09:54:12.094 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.085+0000 7fbea4b98700 1 -- 172.21.15.146:0/3295101756 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea00bb500 con 0x7fbea0062f30 2021-01-27T09:54:12.094 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.085+0000 7fbe8e7fc700 1 -- 172.21.15.146:0/3295101756 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7fbe90010070 con 0x7fbea0062f30 2021-01-27T09:54:12.094 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.085+0000 7fbe8e7fc700 1 --2- 172.21.15.146:0/3295101756 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbe7c056210 0x7fbe7c0586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:12.095 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.085+0000 7fbe8e7fc700 1 -- 172.21.15.146:0/3295101756 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 7341+0+0 (secure 0 0 0) 0x7fbe9006ea10 con 0x7fbea0062f30 2021-01-27T09:54:12.095 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.085+0000 7fbe9dd9b700 1 --2- 172.21.15.146:0/3295101756 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbe7c056210 0x7fbe7c0586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:12.095 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.089+0000 7fbe9dd9b700 1 --2- 172.21.15.146:0/3295101756 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbe7c056210 0x7fbe7c0586d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fbe9400b170 tx=0x7fbe94006e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:12.098 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.093+0000 7fbe8e7fc700 1 -- 172.21.15.146:0/3295101756 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7fbea00bb500 con 0x7fbea0062f30 2021-01-27T09:54:12.285 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.277+0000 7fbea4b98700 1 -- 172.21.15.146:0/3295101756 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbea0044ee0 con 0x7fbea0062f30 2021-01-27T09:54:12.882 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.877+0000 7fbe8e7fc700 1 -- 172.21.15.146:0/3295101756 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbe90043f40 con 0x7fbea0062f30 2021-01-27T09:54:12.885 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.877+0000 7fbea4b98700 1 -- 172.21.15.146:0/3295101756 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbe7c056210 msgr2=0x7fbe7c0586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:12.886 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.877+0000 7fbea4b98700 1 --2- 172.21.15.146:0/3295101756 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbe7c056210 0x7fbe7c0586d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fbe9400b170 tx=0x7fbe94006e20).stop 2021-01-27T09:54:12.886 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.877+0000 7fbea4b98700 1 -- 172.21.15.146:0/3295101756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbea0062f30 msgr2=0x7fbea00b86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:12.886 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.877+0000 7fbea4b98700 1 --2- 172.21.15.146:0/3295101756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbea0062f30 0x7fbea00b86f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fbe9000c710 tx=0x7fbe90007c30).stop 2021-01-27T09:54:12.886 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.877+0000 7fbea4b98700 1 -- 172.21.15.146:0/3295101756 shutdown_connections 2021-01-27T09:54:12.887 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.877+0000 7fbea4b98700 1 --2- 172.21.15.146:0/3295101756 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbea00bcc50 0x7fbea0135db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:12.887 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.877+0000 7fbea4b98700 1 --2- 172.21.15.146:0/3295101756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbea0067630 0x7fbea013d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:12.887 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.877+0000 7fbea4b98700 1 --2- 172.21.15.146:0/3295101756 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7fbe7c056210 0x7fbe7c0586d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:12.888 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.877+0000 7fbea4b98700 1 --2- 172.21.15.146:0/3295101756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbea0062f30 0x7fbea00b86f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:12.888 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.877+0000 7fbea4b98700 1 -- 172.21.15.146:0/3295101756 >> 172.21.15.146:0/3295101756 conn(0x7fbea0060910 msgr2=0x7fbea013b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:54:12.888 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.881+0000 7fbea4b98700 1 -- 172.21.15.146:0/3295101756 shutdown_connections 2021-01-27T09:54:12.888 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:12.881+0000 7fbea4b98700 1 -- 172.21.15.146:0/3295101756 wait complete. 2021-01-27T09:54:12.914 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-01-27T09:54:13.086 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.081+0000 7f3dc3e05700 1 Processor -- start 2021-01-27T09:54:13.087 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.081+0000 7f3dc3e05700 1 -- start start 2021-01-27T09:54:13.088 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.081+0000 7f3dc3e05700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dbc064240 0x7f3dbc0694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:13.089 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.081+0000 7f3dc3e05700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3dbc0be280 0x7f3dbc064620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:13.089 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.081+0000 7f3dc3e05700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dbc067ca0 con 0x7f3dbc0b90d0 2021-01-27T09:54:13.089 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.081+0000 7f3dc3e05700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dbc069ac0 con 0x7f3dbc0be280 2021-01-27T09:54:13.089 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.081+0000 7f3dc3e05700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc069d60 con 0x7f3dbc064240 2021-01-27T09:54:13.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.081+0000 7f3dc23a2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3dbc0be280 0x7f3dbc064620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:13.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.085+0000 7f3dc13a0700 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3dbc0b90d0 0x7f3dbc152210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:43470/0 (socket says 172.21.15.146:43470) 2021-01-27T09:54:13.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.085+0000 7f3dc13a0700 1 -- 172.21.15.146:0/1830280313 learned_addr learned my addr 172.21.15.146:0/1830280313 (peer_addr_for_me v1:172.21.15.146:0/0) 2021-01-27T09:54:13.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.085+0000 7f3dc1ba1700 1 --2- 172.21.15.146:0/1830280313 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dbc064240 0x7f3dbc0694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:13.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.085+0000 7f3dc0b9f700 1 -- 172.21.15.146:0/1830280313 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1908918010 0 0) 0x7f3dbc067ca0 con 0x7f3dbc0b90d0 2021-01-27T09:54:13.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.085+0000 7f3dc0b9f700 1 -- 172.21.15.146:0/1830280313 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3da4003270 con 0x7f3dbc0b90d0 2021-01-27T09:54:13.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.085+0000 7f3dc1ba1700 1 -- 172.21.15.146:0/1830280313 >> v2:172.21.15.146:3300/0 conn(0x7f3dbc0be280 msgr2=0x7f3dbc064620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:54:13.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.085+0000 7f3dc1ba1700 1 --2- 172.21.15.146:0/1830280313 >> v2:172.21.15.146:3300/0 conn(0x7f3dbc0be280 0x7f3dbc064620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:13.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.085+0000 7f3dc1ba1700 1 -- 172.21.15.146:0/1830280313 >> v1:172.21.15.78:6789/0 conn(0x7f3dbc0b90d0 legacy=0x7f3dbc152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:13.093 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.085+0000 7f3dc1ba1700 1 -- 172.21.15.146:0/1830280313 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dbc06a000 con 0x7f3dbc064240 2021-01-27T09:54:13.094 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.085+0000 7f3dc1ba1700 1 --2- 172.21.15.146:0/1830280313 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dbc064240 0x7f3dbc0694a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f3db800b9b0 tx=0x7f3db8006dc0).ready entity=mon.2 client_cookie=312596a8f0f6bd90 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:13.094 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.085+0000 7f3dc0b9f700 1 -- 172.21.15.146:0/1830280313 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db8006030 con 0x7f3dbc064240 2021-01-27T09:54:13.094 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.085+0000 7f3dc0b9f700 1 -- 172.21.15.146:0/1830280313 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3db8006190 con 0x7f3dbc064240 2021-01-27T09:54:13.095 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.085+0000 7f3dc0b9f700 1 -- 172.21.15.146:0/1830280313 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db8006510 con 0x7f3dbc064240 2021-01-27T09:54:13.095 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.085+0000 7f3dc3e05700 1 -- 172.21.15.146:0/1830280313 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dbc064240 msgr2=0x7f3dbc0694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:13.095 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.089+0000 7f3dc3e05700 1 --2- 172.21.15.146:0/1830280313 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dbc064240 0x7f3dbc0694a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f3db800b9b0 tx=0x7f3db8006dc0).stop 2021-01-27T09:54:13.095 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.089+0000 7f3dc3e05700 1 -- 172.21.15.146:0/1830280313 shutdown_connections 2021-01-27T09:54:13.096 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.089+0000 7f3dc3e05700 1 --2- 172.21.15.146:0/1830280313 >> v2:172.21.15.146:3300/0 conn(0x7f3dbc0be280 0x7f3dbc064620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:13.096 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.089+0000 7f3dc3e05700 1 --2- 172.21.15.146:0/1830280313 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dbc064240 0x7f3dbc0694a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:13.096 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.089+0000 7f3dc3e05700 1 -- 172.21.15.146:0/1830280313 >> 172.21.15.146:0/1830280313 conn(0x7f3dbc060020 msgr2=0x7f3dbc067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:54:13.097 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.089+0000 7f3dc3e05700 1 -- 172.21.15.146:0/1830280313 shutdown_connections 2021-01-27T09:54:13.097 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.089+0000 7f3dc3e05700 1 -- 172.21.15.146:0/1830280313 wait complete. 2021-01-27T09:54:13.097 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.089+0000 7f3dc3e05700 1 Processor -- start 2021-01-27T09:54:13.097 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.089+0000 7f3dc3e05700 1 -- start start 2021-01-27T09:54:13.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.093+0000 7f3dc3e05700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dbc064240 0x7f3dbc154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:13.100 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.093+0000 7f3dc3e05700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dbc0b90d0 0x7f3dbc164a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:13.100 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.093+0000 7f3dc3e05700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dbc0be280 0x7f3dbc155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:13.100 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.093+0000 7f3dc3e05700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc164f00 con 0x7f3dbc0be280 2021-01-27T09:54:13.100 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.093+0000 7f3dc3e05700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc14a050 con 0x7f3dbc064240 2021-01-27T09:54:13.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.093+0000 7f3dc3e05700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc14a2f0 con 0x7f3dbc0b90d0 2021-01-27T09:54:13.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.093+0000 7f3dc1ba1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dbc064240 0x7f3dbc154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:13.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.093+0000 7f3dc1ba1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dbc064240 0x7f3dbc154050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55866/0 (socket says 172.21.15.146:55866) 2021-01-27T09:54:13.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.093+0000 7f3dc1ba1700 1 -- 172.21.15.146:0/740399322 learned_addr learned my addr 172.21.15.146:0/740399322 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:54:13.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.093+0000 7f3dc13a0700 1 --2- 172.21.15.146:0/740399322 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dbc0b90d0 0x7f3dbc164a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:13.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.093+0000 7f3dc23a2700 1 --2- 172.21.15.146:0/740399322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dbc0be280 0x7f3dbc155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:13.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.093+0000 7f3dc1ba1700 1 -- 172.21.15.146:0/740399322 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dbc0b90d0 msgr2=0x7f3dbc164a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:13.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.093+0000 7f3dc1ba1700 1 --2- 172.21.15.146:0/740399322 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dbc0b90d0 0x7f3dbc164a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:13.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.093+0000 7f3dc1ba1700 1 -- 172.21.15.146:0/740399322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dbc0be280 msgr2=0x7f3dbc155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:13.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.093+0000 7f3dc1ba1700 1 --2- 172.21.15.146:0/740399322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dbc0be280 0x7f3dbc155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:13.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.093+0000 7f3dc1ba1700 1 -- 172.21.15.146:0/740399322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dbc14a590 con 0x7f3dbc064240 2021-01-27T09:54:13.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.093+0000 7f3dc23a2700 1 --2- 172.21.15.146:0/740399322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dbc0be280 0x7f3dbc155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-27T09:54:13.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.093+0000 7f3dc1ba1700 1 --2- 172.21.15.146:0/740399322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dbc064240 0x7f3dbc154050 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f3db800c010 tx=0x7f3db8006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:13.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.093+0000 7f3da9ffb700 1 -- 172.21.15.146:0/740399322 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db80098e0 con 0x7f3dbc064240 2021-01-27T09:54:13.104 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.093+0000 7f3da9ffb700 1 -- 172.21.15.146:0/740399322 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3db8009a60 con 0x7f3dbc064240 2021-01-27T09:54:13.104 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.093+0000 7f3da9ffb700 1 -- 172.21.15.146:0/740399322 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db8009e40 con 0x7f3dbc064240 2021-01-27T09:54:13.104 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.093+0000 7f3dc3e05700 1 -- 172.21.15.146:0/740399322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dbc14a830 con 0x7f3dbc064240 2021-01-27T09:54:13.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.093+0000 7f3dc3e05700 1 -- 172.21.15.146:0/740399322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dbc153bb0 con 0x7f3dbc064240 2021-01-27T09:54:13.106 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.097+0000 7f3dc3e05700 1 -- 172.21.15.146:0/740399322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dbc155cd0 con 0x7f3dbc064240 2021-01-27T09:54:13.106 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.097+0000 7f3da9ffb700 1 -- 172.21.15.146:0/740399322 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f3db800f070 con 0x7f3dbc064240 2021-01-27T09:54:13.106 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.097+0000 7f3da9ffb700 1 --2- 172.21.15.146:0/740399322 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f3d9c056210 0x7f3d9c0586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:13.106 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.097+0000 7f3da9ffb700 1 -- 172.21.15.146:0/740399322 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 7341+0+0 (secure 0 0 0) 0x7f3db80705a0 con 0x7f3dbc064240 2021-01-27T09:54:13.107 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.097+0000 7f3dc13a0700 1 --2- 172.21.15.146:0/740399322 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f3d9c056210 0x7f3d9c0586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:13.107 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.097+0000 7f3dc13a0700 1 --2- 172.21.15.146:0/740399322 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f3d9c056210 0x7f3d9c0586d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f3dbc14fc30 tx=0x7f3dac009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:13.110 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.105+0000 7f3da9ffb700 1 -- 172.21.15.146:0/740399322 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f3db8045b80 con 0x7f3dbc064240 2021-01-27T09:54:13.252 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.245+0000 7f3dc3e05700 1 -- 172.21.15.146:0/740399322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3dbc044ee0 con 0x7f3dbc064240 2021-01-27T09:54:13.886 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.881+0000 7f3da9ffb700 1 -- 172.21.15.146:0/740399322 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3db8022070 con 0x7f3dbc064240 2021-01-27T09:54:13.891 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.885+0000 7f3dc3e05700 1 -- 172.21.15.146:0/740399322 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f3d9c056210 msgr2=0x7f3d9c0586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:13.892 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.885+0000 7f3dc3e05700 1 --2- 172.21.15.146:0/740399322 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f3d9c056210 0x7f3d9c0586d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f3dbc14fc30 tx=0x7f3dac009040).stop 2021-01-27T09:54:13.892 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.885+0000 7f3dc3e05700 1 -- 172.21.15.146:0/740399322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dbc064240 msgr2=0x7f3dbc154050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:13.892 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.885+0000 7f3dc3e05700 1 --2- 172.21.15.146:0/740399322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dbc064240 0x7f3dbc154050 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f3db800c010 tx=0x7f3db8006dc0).stop 2021-01-27T09:54:13.892 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.885+0000 7f3dc3e05700 1 -- 172.21.15.146:0/740399322 shutdown_connections 2021-01-27T09:54:13.893 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.885+0000 7f3dc3e05700 1 --2- 172.21.15.146:0/740399322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dbc0be280 0x7f3dbc155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:13.893 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.885+0000 7f3dc3e05700 1 --2- 172.21.15.146:0/740399322 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dbc0b90d0 0x7f3dbc164a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:13.893 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.885+0000 7f3dc3e05700 1 --2- 172.21.15.146:0/740399322 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f3d9c056210 0x7f3d9c0586d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:13.893 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.885+0000 7f3dc3e05700 1 --2- 172.21.15.146:0/740399322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dbc064240 0x7f3dbc154050 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:13.894 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.885+0000 7f3dc3e05700 1 -- 172.21.15.146:0/740399322 >> 172.21.15.146:0/740399322 conn(0x7f3dbc060020 msgr2=0x7f3dbc0be710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:54:13.894 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.885+0000 7f3dc3e05700 1 -- 172.21.15.146:0/740399322 shutdown_connections 2021-01-27T09:54:13.894 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:13.885+0000 7f3dc3e05700 1 -- 172.21.15.146:0/740399322 wait complete. 2021-01-27T09:54:13.895 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2021-01-27T09:54:13.919 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-01-27T09:54:14.086 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.081+0000 7f8964967700 1 Processor -- start 2021-01-27T09:54:14.087 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.081+0000 7f8964967700 1 -- start start 2021-01-27T09:54:14.090 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.085+0000 7f8964967700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8960066fa0 0x7f89600bbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:14.090 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.085+0000 7f8964967700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89600bbfa0 con 0x7f89600bf590 2021-01-27T09:54:14.090 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.085+0000 7f8964967700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f896014dfc0 con 0x7f89600bf1b0 2021-01-27T09:54:14.090 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.085+0000 7f8964967700 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896014e260 con 0x7f8960066fa0 2021-01-27T09:54:14.091 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.085+0000 7f895dd9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8960066fa0 0x7f89600bbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:14.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.085+0000 7f895dd9b700 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8960066fa0 0x7f89600bbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:58750/0 (socket says 172.21.15.146:58750) 2021-01-27T09:54:14.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.085+0000 7f895dd9b700 1 -- 172.21.15.146:0/1770392892 learned_addr learned my addr 172.21.15.146:0/1770392892 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:54:14.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.085+0000 7f895dd9b700 1 -- 172.21.15.146:0/1770392892 >> v1:172.21.15.146:6789/0 conn(0x7f89600bf1b0 legacy=0x7f8960066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:14.092 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.085+0000 7f895dd9b700 1 -- 172.21.15.146:0/1770392892 >> v1:172.21.15.78:6789/0 conn(0x7f89600bf590 legacy=0x7f896014ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-27T09:54:14.093 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.085+0000 7f895dd9b700 1 -- 172.21.15.146:0/1770392892 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896014e500 con 0x7f8960066fa0 2021-01-27T09:54:14.093 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.085+0000 7f895dd9b700 1 --2- 172.21.15.146:0/1770392892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8960066fa0 0x7f89600bbab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f895400ba50 tx=0x7f8954006ee0).ready entity=mon.0 client_cookie=8fc384329b2d73c server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:14.094 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.085+0000 7f895d59a700 1 -- 172.21.15.146:0/1770392892 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954009850 con 0x7f8960066fa0 2021-01-27T09:54:14.094 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.085+0000 7f895d59a700 1 -- 172.21.15.146:0/1770392892 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f89540099b0 con 0x7f8960066fa0 2021-01-27T09:54:14.094 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.085+0000 7f895d59a700 1 -- 172.21.15.146:0/1770392892 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954009d30 con 0x7f8960066fa0 2021-01-27T09:54:14.094 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.085+0000 7f8964967700 1 -- 172.21.15.146:0/1770392892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8960066fa0 msgr2=0x7f89600bbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:14.095 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.085+0000 7f8964967700 1 --2- 172.21.15.146:0/1770392892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8960066fa0 0x7f89600bbab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f895400ba50 tx=0x7f8954006ee0).stop 2021-01-27T09:54:14.095 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.089+0000 7f8964967700 1 -- 172.21.15.146:0/1770392892 shutdown_connections 2021-01-27T09:54:14.095 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.089+0000 7f8964967700 1 --2- 172.21.15.146:0/1770392892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8960066fa0 0x7f89600bbab0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:14.096 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.089+0000 7f8964967700 1 -- 172.21.15.146:0/1770392892 >> 172.21.15.146:0/1770392892 conn(0x7f8960060910 msgr2=0x7f8960062810 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:54:14.096 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.089+0000 7f8964967700 1 -- 172.21.15.146:0/1770392892 shutdown_connections 2021-01-27T09:54:14.096 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.089+0000 7f8964967700 1 -- 172.21.15.146:0/1770392892 wait complete. 2021-01-27T09:54:14.097 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.089+0000 7f8964967700 1 Processor -- start 2021-01-27T09:54:14.097 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.089+0000 7f8964967700 1 -- start start 2021-01-27T09:54:14.098 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.093+0000 7f8964967700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8960066fa0 0x7f8960143e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.093+0000 7f8964967700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89600bf1b0 0x7f8960160c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.093+0000 7f8964967700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89600bf590 0x7f896014f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.093+0000 7f8964967700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89600c2fb0 con 0x7f89600bf1b0 2021-01-27T09:54:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.093+0000 7f8964967700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896014c610 con 0x7f89600bf590 2021-01-27T09:54:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.093+0000 7f8964967700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89600c52d0 con 0x7f8960066fa0 2021-01-27T09:54:14.100 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.093+0000 7f895dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89600bf1b0 0x7f8960160c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:14.100 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.093+0000 7f895dd9b700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89600bf1b0 0x7f8960160c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:58756/0 (socket says 172.21.15.146:58756) 2021-01-27T09:54:14.100 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.093+0000 7f895dd9b700 1 -- 172.21.15.146:0/33078651 learned_addr learned my addr 172.21.15.146:0/33078651 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:54:14.100 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.093+0000 7f895ed9d700 1 --2- 172.21.15.146:0/33078651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89600bf590 0x7f896014f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:14.100 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.093+0000 7f895e59c700 1 --2- 172.21.15.146:0/33078651 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8960066fa0 0x7f8960143e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:14.101 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.093+0000 7f895dd9b700 1 -- 172.21.15.146:0/33078651 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8960066fa0 msgr2=0x7f8960143e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:14.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.093+0000 7f895dd9b700 1 --2- 172.21.15.146:0/33078651 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8960066fa0 0x7f8960143e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:14.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.093+0000 7f895dd9b700 1 -- 172.21.15.146:0/33078651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89600bf590 msgr2=0x7f896014f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:14.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.093+0000 7f895dd9b700 1 --2- 172.21.15.146:0/33078651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89600bf590 0x7f896014f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:14.102 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.093+0000 7f895dd9b700 1 -- 172.21.15.146:0/33078651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89600c2a70 con 0x7f89600bf1b0 2021-01-27T09:54:14.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.093+0000 7f895dd9b700 1 --2- 172.21.15.146:0/33078651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89600bf1b0 0x7f8960160c80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f895400b9a0 tx=0x7f8954006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:14.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.093+0000 7f894e7fc700 1 -- 172.21.15.146:0/33078651 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895401c420 con 0x7f89600bf1b0 2021-01-27T09:54:14.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.093+0000 7f894e7fc700 1 -- 172.21.15.146:0/33078651 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f895401c5a0 con 0x7f89600bf1b0 2021-01-27T09:54:14.103 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.093+0000 7f894e7fc700 1 -- 172.21.15.146:0/33078651 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895401c980 con 0x7f89600bf1b0 2021-01-27T09:54:14.104 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.093+0000 7f8964967700 1 -- 172.21.15.146:0/33078651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89600c2d10 con 0x7f89600bf1b0 2021-01-27T09:54:14.104 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.093+0000 7f8964967700 1 -- 172.21.15.146:0/33078651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8960161170 con 0x7f89600bf1b0 2021-01-27T09:54:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.097+0000 7f8964967700 1 -- 172.21.15.146:0/33078651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8960044ee0 con 0x7f89600bf1b0 2021-01-27T09:54:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.097+0000 7f894e7fc700 1 -- 172.21.15.146:0/33078651 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f895400f070 con 0x7f89600bf1b0 2021-01-27T09:54:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.097+0000 7f894e7fc700 1 --2- 172.21.15.146:0/33078651 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f893c0561e0 0x7f893c0586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.097+0000 7f894e7fc700 1 -- 172.21.15.146:0/33078651 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6903+0+0 (secure 0 0 0) 0x7f8954070df0 con 0x7f89600bf1b0 2021-01-27T09:54:14.106 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.097+0000 7f895e59c700 1 --2- 172.21.15.146:0/33078651 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f893c0561e0 0x7f893c0586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:14.106 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.101+0000 7f895e59c700 1 --2- 172.21.15.146:0/33078651 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f893c0561e0 0x7f893c0586a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f8950003550 tx=0x7f8950009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:14.113 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.105+0000 7f894e7fc700 1 -- 172.21.15.146:0/33078651 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f8954046450 con 0x7f89600bf1b0 2021-01-27T09:54:14.272 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.265+0000 7f8964967700 1 -- 172.21.15.146:0/33078651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f896005c870 con 0x7f89600bf1b0 2021-01-27T09:54:14.908 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.901+0000 7f894e7fc700 1 -- 172.21.15.146:0/33078651 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8954016070 con 0x7f89600bf1b0 2021-01-27T09:54:14.912 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.905+0000 7f8964967700 1 -- 172.21.15.146:0/33078651 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f893c0561e0 msgr2=0x7f893c0586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:14.912 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.905+0000 7f8964967700 1 --2- 172.21.15.146:0/33078651 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f893c0561e0 0x7f893c0586a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f8950003550 tx=0x7f8950009040).stop 2021-01-27T09:54:14.913 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.905+0000 7f8964967700 1 -- 172.21.15.146:0/33078651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89600bf1b0 msgr2=0x7f8960160c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:14.913 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.905+0000 7f8964967700 1 --2- 172.21.15.146:0/33078651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89600bf1b0 0x7f8960160c80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f895400b9a0 tx=0x7f8954006ee0).stop 2021-01-27T09:54:14.913 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.905+0000 7f8964967700 1 -- 172.21.15.146:0/33078651 shutdown_connections 2021-01-27T09:54:14.913 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.905+0000 7f8964967700 1 --2- 172.21.15.146:0/33078651 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f893c0561e0 0x7f893c0586a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:14.914 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.905+0000 7f8964967700 1 --2- 172.21.15.146:0/33078651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89600bf590 0x7f896014f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:14.914 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.905+0000 7f8964967700 1 --2- 172.21.15.146:0/33078651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89600bf1b0 0x7f8960160c80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:14.914 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.905+0000 7f8964967700 1 --2- 172.21.15.146:0/33078651 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8960066fa0 0x7f8960143e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:14.914 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.905+0000 7f8964967700 1 -- 172.21.15.146:0/33078651 >> 172.21.15.146:0/33078651 conn(0x7f8960060910 msgr2=0x7f896014cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:54:14.914 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.905+0000 7f8964967700 1 -- 172.21.15.146:0/33078651 shutdown_connections 2021-01-27T09:54:14.915 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:14.905+0000 7f8964967700 1 -- 172.21.15.146:0/33078651 wait complete. 2021-01-27T09:54:14.915 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2021-01-27T09:54:14.942 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2021-01-27T09:54:15.122 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.117+0000 7f829cd15700 1 Processor -- start 2021-01-27T09:54:15.122 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.117+0000 7f829cd15700 1 -- start start 2021-01-27T09:54:15.123 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.117+0000 7f829cd15700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f829814bb50 0x7f829814f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:15.123 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.117+0000 7f829cd15700 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829814f610 con 0x7f82980badd0 2021-01-27T09:54:15.124 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.117+0000 7f829cd15700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82980beae0 con 0x7f82980ba9f0 2021-01-27T09:54:15.124 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.117+0000 7f829cd15700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829814f860 con 0x7f829814bb50 2021-01-27T09:54:15.125 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.117+0000 7f8296ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f829814bb50 0x7f829814f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:15.125 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.117+0000 7f8296ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f829814bb50 0x7f829814f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55890/0 (socket says 172.21.15.146:55890) 2021-01-27T09:54:15.125 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.117+0000 7f8296ffd700 1 -- 172.21.15.146:0/27203935 learned_addr learned my addr 172.21.15.146:0/27203935 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:54:15.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.117+0000 7f8297fff700 1 --1- 172.21.15.146:0/27203935 >> v1:172.21.15.78:6789/0 conn(0x7f82980badd0 0x7f82980be3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.146:43498/0 (socket says 172.21.15.146:43498) 2021-01-27T09:54:15.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.117+0000 7f8296ffd700 1 -- 172.21.15.146:0/27203935 >> v1:172.21.15.146:6789/0 conn(0x7f82980ba9f0 legacy=0x7f82980bd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:15.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.117+0000 7f8296ffd700 1 -- 172.21.15.146:0/27203935 >> v1:172.21.15.78:6789/0 conn(0x7f82980badd0 legacy=0x7f82980be3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:15.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.117+0000 7f8296ffd700 1 -- 172.21.15.146:0/27203935 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829814fb00 con 0x7f829814bb50 2021-01-27T09:54:15.126 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.117+0000 7f82967fc700 1 -- 172.21.15.146:0/27203935 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641425586 0 0) 0x7f829814f610 con 0x7f82980badd0 2021-01-27T09:54:15.127 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.121+0000 7f8296ffd700 1 --2- 172.21.15.146:0/27203935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f829814bb50 0x7f829814f120 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f828c00ba20 tx=0x7f828c006ee0).ready entity=mon.1 client_cookie=a92e11647a3a2f47 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:15.128 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.121+0000 7f82967fc700 1 -- 172.21.15.146:0/27203935 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c009840 con 0x7f829814bb50 2021-01-27T09:54:15.128 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.121+0000 7f82967fc700 1 -- 172.21.15.146:0/27203935 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f828c0099a0 con 0x7f829814bb50 2021-01-27T09:54:15.128 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.121+0000 7f82967fc700 1 -- 172.21.15.146:0/27203935 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c009d20 con 0x7f829814bb50 2021-01-27T09:54:15.128 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.121+0000 7f829cd15700 1 -- 172.21.15.146:0/27203935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f829814bb50 msgr2=0x7f829814f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:15.129 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.121+0000 7f829cd15700 1 --2- 172.21.15.146:0/27203935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f829814bb50 0x7f829814f120 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f828c00ba20 tx=0x7f828c006ee0).stop 2021-01-27T09:54:15.129 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.121+0000 7f829cd15700 1 -- 172.21.15.146:0/27203935 shutdown_connections 2021-01-27T09:54:15.129 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.121+0000 7f829cd15700 1 --2- 172.21.15.146:0/27203935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f829814bb50 0x7f829814f120 secure :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0x7f828c00ba20 tx=0x7f828c006ee0).stop 2021-01-27T09:54:15.129 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.121+0000 7f829cd15700 1 -- 172.21.15.146:0/27203935 >> 172.21.15.146:0/27203935 conn(0x7f82980c1cd0 msgr2=0x7f82980bdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:54:15.129 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.121+0000 7f829cd15700 1 -- 172.21.15.146:0/27203935 shutdown_connections 2021-01-27T09:54:15.130 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.121+0000 7f829cd15700 1 -- 172.21.15.146:0/27203935 wait complete. 2021-01-27T09:54:15.132 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.121+0000 7f829cd15700 1 Processor -- start 2021-01-27T09:54:15.132 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.121+0000 7f829cd15700 1 -- start start 2021-01-27T09:54:15.132 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.125+0000 7f829cd15700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82980ba9f0 0x7f829815d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:15.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.125+0000 7f829cd15700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82980badd0 0x7f82980b96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:15.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.125+0000 7f829cd15700 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f82980b1b10 0x7f82980b9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:15.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.125+0000 7f829cd15700 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82980ba0a0 con 0x7f82980ba9f0 2021-01-27T09:54:15.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.125+0000 7f829cd15700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82980b1fe0 con 0x7f82980badd0 2021-01-27T09:54:15.133 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.125+0000 7f829cd15700 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82980b2280 con 0x7f82980b1b10 2021-01-27T09:54:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.125+0000 7f82977fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82980ba9f0 0x7f829815d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.125+0000 7f82977fe700 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82980ba9f0 0x7f829815d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.146:58768/0 (socket says 172.21.15.146:58768) 2021-01-27T09:54:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.125+0000 7f82977fe700 1 -- 172.21.15.146:0/2775882746 learned_addr learned my addr 172.21.15.146:0/2775882746 (peer_addr_for_me v2:172.21.15.146:0/0) 2021-01-27T09:54:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.125+0000 7f8297fff700 1 --2- 172.21.15.146:0/2775882746 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f82980b1b10 0x7f82980b9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:15.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.125+0000 7f8296ffd700 1 --2- 172.21.15.146:0/2775882746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82980badd0 0x7f82980b96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:15.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.125+0000 7f8296ffd700 1 -- 172.21.15.146:0/2775882746 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f82980b1b10 msgr2=0x7f82980b9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:15.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.125+0000 7f8296ffd700 1 --2- 172.21.15.146:0/2775882746 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f82980b1b10 0x7f82980b9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:15.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.125+0000 7f8296ffd700 1 -- 172.21.15.146:0/2775882746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82980ba9f0 msgr2=0x7f829815d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:15.135 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.125+0000 7f8296ffd700 1 --2- 172.21.15.146:0/2775882746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82980ba9f0 0x7f829815d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:15.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.125+0000 7f8296ffd700 1 -- 172.21.15.146:0/2775882746 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82980b2520 con 0x7f82980badd0 2021-01-27T09:54:15.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.125+0000 7f82977fe700 1 --2- 172.21.15.146:0/2775882746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82980ba9f0 0x7f829815d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-27T09:54:15.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.125+0000 7f8296ffd700 1 --2- 172.21.15.146:0/2775882746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82980badd0 0x7f82980b96c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f828c014000 tx=0x7f828c006ee0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:15.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.125+0000 7f827f7fe700 1 -- 172.21.15.146:0/2775882746 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c011e80 con 0x7f82980badd0 2021-01-27T09:54:15.136 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.125+0000 7f827f7fe700 1 -- 172.21.15.146:0/2775882746 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f828c01b410 con 0x7f82980badd0 2021-01-27T09:54:15.137 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.125+0000 7f827f7fe700 1 -- 172.21.15.146:0/2775882746 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c01b7b0 con 0x7f82980badd0 2021-01-27T09:54:15.137 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.125+0000 7f829cd15700 1 -- 172.21.15.146:0/2775882746 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82980b27c0 con 0x7f82980badd0 2021-01-27T09:54:15.137 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.125+0000 7f829cd15700 1 -- 172.21.15.146:0/2775882746 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82980b2d00 con 0x7f82980badd0 2021-01-27T09:54:15.138 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.129+0000 7f829cd15700 1 -- 172.21.15.146:0/2775882746 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82980b8340 con 0x7f82980badd0 2021-01-27T09:54:15.138 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.129+0000 7f827f7fe700 1 -- 172.21.15.146:0/2775882746 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 67164+0+0 (secure 0 0 0) 0x7f828c00f070 con 0x7f82980badd0 2021-01-27T09:54:15.139 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.129+0000 7f827f7fe700 1 --2- 172.21.15.146:0/2775882746 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f82780561e0 0x7f82780586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-27T09:54:15.139 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.129+0000 7f827f7fe700 1 -- 172.21.15.146:0/2775882746 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f828c06ff30 con 0x7f82980badd0 2021-01-27T09:54:15.139 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.129+0000 7f82977fe700 1 --2- 172.21.15.146:0/2775882746 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f82780561e0 0x7f82780586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-27T09:54:15.139 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.129+0000 7f82977fe700 1 --2- 172.21.15.146:0/2775882746 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f82780561e0 0x7f82780586a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f8288001c20 tx=0x7f8288009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-27T09:54:15.140 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.133+0000 7f827f7fe700 1 -- 172.21.15.146:0/2775882746 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148145 (secure 0 0 0) 0x7f828c09b2d0 con 0x7f82980badd0 2021-01-27T09:54:15.279 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.273+0000 7f829cd15700 1 -- 172.21.15.146:0/2775882746 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8298044680 con 0x7f82980badd0 2021-01-27T09:54:15.920 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.913+0000 7f827f7fe700 1 -- 172.21.15.146:0/2775882746 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7f828c021020 con 0x7f82980badd0 2021-01-27T09:54:15.923 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.917+0000 7f829cd15700 1 -- 172.21.15.146:0/2775882746 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f82780561e0 msgr2=0x7f82780586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:15.923 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.917+0000 7f829cd15700 1 --2- 172.21.15.146:0/2775882746 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f82780561e0 0x7f82780586a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f8288001c20 tx=0x7f8288009040).stop 2021-01-27T09:54:15.923 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.917+0000 7f829cd15700 1 -- 172.21.15.146:0/2775882746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82980badd0 msgr2=0x7f82980b96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-27T09:54:15.923 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.917+0000 7f829cd15700 1 --2- 172.21.15.146:0/2775882746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82980badd0 0x7f82980b96c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f828c014000 tx=0x7f828c006ee0).stop 2021-01-27T09:54:15.923 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.917+0000 7f829cd15700 1 -- 172.21.15.146:0/2775882746 shutdown_connections 2021-01-27T09:54:15.924 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.917+0000 7f829cd15700 1 --2- 172.21.15.146:0/2775882746 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f82980b1b10 0x7f82980b9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:15.924 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.917+0000 7f829cd15700 1 --2- 172.21.15.146:0/2775882746 >> [v2:172.21.15.78:6832/15486,v1:172.21.15.78:6833/15486] conn(0x7f82780561e0 0x7f82780586a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:15.924 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.917+0000 7f829cd15700 1 --2- 172.21.15.146:0/2775882746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82980badd0 0x7f82980b96c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:15.924 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.917+0000 7f829cd15700 1 --2- 172.21.15.146:0/2775882746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82980ba9f0 0x7f829815d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-27T09:54:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.917+0000 7f829cd15700 1 -- 172.21.15.146:0/2775882746 >> 172.21.15.146:0/2775882746 conn(0x7f82980c1cd0 msgr2=0x7f82980bd180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-27T09:54:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.917+0000 7f829cd15700 1 -- 172.21.15.146:0/2775882746 shutdown_connections 2021-01-27T09:54:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2021-01-27T09:54:15.917+0000 7f829cd15700 1 -- 172.21.15.146:0/2775882746 wait complete. 2021-01-27T09:54:15.926 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data_ec' removed 2021-01-27T09:54:15.953 INFO:teuthology.misc:Shutting down mds daemons... 2021-01-27T09:54:15.954 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-01-27T09:54:15.954 INFO:teuthology.orchestra.run:waiting for 300 2021-01-27T09:54:15.980 INFO:tasks.ceph.mds.a:Stopped 2021-01-27T09:54:15.981 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-01-27T09:54:15.981 INFO:teuthology.orchestra.run:waiting for 300 2021-01-27T09:54:16.005 INFO:tasks.ceph.mds.c:Stopped 2021-01-27T09:54:16.005 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2021-01-27T09:54:16.006 INFO:teuthology.orchestra.run:waiting for 300 2021-01-27T09:54:16.072 INFO:tasks.ceph.mds.e:Stopped 2021-01-27T09:54:16.073 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-01-27T09:54:16.073 INFO:teuthology.orchestra.run:waiting for 300 2021-01-27T09:54:16.082 INFO:tasks.ceph.mds.b:Stopped 2021-01-27T09:54:16.083 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2021-01-27T09:54:16.083 INFO:teuthology.orchestra.run:waiting for 300 2021-01-27T09:54:16.134 INFO:tasks.ceph.mds.d:Stopped 2021-01-27T09:54:16.135 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2021-01-27T09:54:16.135 INFO:teuthology.orchestra.run:waiting for 300 2021-01-27T09:54:16.144 INFO:tasks.ceph.mds.f:Stopped 2021-01-27T09:54:16.145 INFO:teuthology.misc:Shutting down osd daemons... 2021-01-27T09:54:16.145 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2021-01-27T09:54:16.146 INFO:teuthology.orchestra.run:waiting for 300 2021-01-27T09:54:22.131 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2021-01-27T09:54:22.247 INFO:tasks.ceph.osd.0:Stopped 2021-01-27T09:54:22.249 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2021-01-27T09:54:22.249 INFO:teuthology.orchestra.run:waiting for 300 2021-01-27T09:54:28.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2021-01-27T09:54:28.242 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2021-01-27T09:54:28.352 INFO:tasks.ceph.osd.1:Stopped 2021-01-27T09:54:28.353 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2021-01-27T09:54:28.353 INFO:teuthology.orchestra.run:waiting for 300 2021-01-27T09:54:34.251 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2021-01-27T09:54:34.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2021-01-27T09:54:34.456 INFO:tasks.ceph.osd.2:Stopped 2021-01-27T09:54:34.457 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2021-01-27T09:54:34.457 INFO:teuthology.orchestra.run:waiting for 300 2021-01-27T09:54:40.160 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2021-01-27T09:54:40.160 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2021-01-27T09:54:40.559 INFO:tasks.ceph.osd.3:Stopped 2021-01-27T09:54:40.559 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2021-01-27T09:54:40.560 INFO:teuthology.orchestra.run:waiting for 300 2021-01-27T09:54:40.660 INFO:tasks.ceph.osd.4:Stopped 2021-01-27T09:54:40.661 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2021-01-27T09:54:40.661 INFO:teuthology.orchestra.run:waiting for 300 2021-01-27T09:54:40.760 INFO:tasks.ceph.osd.5:Stopped 2021-01-27T09:54:40.762 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2021-01-27T09:54:40.762 INFO:teuthology.orchestra.run:waiting for 300 2021-01-27T09:54:45.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2021-01-27T09:54:45.768 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2021-01-27T09:54:46.864 INFO:tasks.ceph.osd.6:Stopped 2021-01-27T09:54:46.865 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2021-01-27T09:54:46.866 INFO:teuthology.orchestra.run:waiting for 300 2021-01-27T09:54:51.272 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2021-01-27T09:54:51.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2021-01-27T09:54:52.968 INFO:tasks.ceph.osd.7:Stopped 2021-01-27T09:54:52.969 INFO:teuthology.misc:Shutting down mgr daemons... 2021-01-27T09:54:52.969 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2021-01-27T09:54:52.970 INFO:teuthology.orchestra.run:waiting for 300 2021-01-27T09:54:53.061 INFO:tasks.ceph.mgr.y:Stopped 2021-01-27T09:54:53.061 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2021-01-27T09:54:53.061 INFO:teuthology.orchestra.run:waiting for 300 2021-01-27T09:54:53.085 INFO:tasks.ceph.mgr.x:Stopped 2021-01-27T09:54:53.085 INFO:teuthology.misc:Shutting down mon daemons... 2021-01-27T09:54:53.086 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2021-01-27T09:54:53.086 INFO:teuthology.orchestra.run:waiting for 300 2021-01-27T09:54:53.124 INFO:tasks.ceph.mon.a:Stopped 2021-01-27T09:54:53.125 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2021-01-27T09:54:53.125 INFO:teuthology.orchestra.run:waiting for 300 2021-01-27T09:54:53.144 INFO:tasks.ceph.mon.b:Stopped 2021-01-27T09:54:53.145 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2021-01-27T09:54:53.145 INFO:teuthology.orchestra.run:waiting for 300 2021-01-27T09:54:53.205 INFO:tasks.ceph.mon.c:Stopped 2021-01-27T09:54:53.205 INFO:tasks.ceph:Checking cluster log for badness... 2021-01-27T09:54:53.206 DEBUG:teuthology.orchestra.run.smithi146:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Replacing daemon mds' | egrep -v 'Throttler Limit has been hit. Some message processing may be significantly delayed.' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2021-01-27T09:54:53.304 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi146.front.sepia.ceph.com 2021-01-27T09:54:53.305 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2021-01-27T09:54:53.744 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi146.front.sepia.ceph.com 2021-01-27T09:54:53.744 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2021-01-27T09:54:54.228 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi146.front.sepia.ceph.com 2021-01-27T09:54:54.229 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2021-01-27T09:54:54.628 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi146.front.sepia.ceph.com 2021-01-27T09:54:54.629 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2021-01-27T09:54:55.069 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi078.front.sepia.ceph.com 2021-01-27T09:54:55.069 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2021-01-27T09:54:56.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2021-01-27T09:54:56.310 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi078.front.sepia.ceph.com 2021-01-27T09:54:56.311 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2021-01-27T09:54:56.742 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi078.front.sepia.ceph.com 2021-01-27T09:54:56.742 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2021-01-27T09:54:56.995 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi078.front.sepia.ceph.com 2021-01-27T09:54:56.995 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2021-01-27T09:54:57.212 INFO:tasks.ceph:Archiving mon data... 2021-01-27T09:54:57.213 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/jcollin-2021-01-27_09:11:59-fs-wip-jcollin-dispatch-queue-throttle-test-distro-basic-smithi/5833404/data/mon.a.tgz 2021-01-27T09:54:57.214 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2021-01-27T09:54:57.235 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.ql8HQf04qb 2021-01-27T09:54:57.236 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ql8HQf04qb 2021-01-27T09:54:57.537 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.ql8HQf04qb 2021-01-27T09:54:57.605 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.ql8HQf04qb is 779KB 2021-01-27T09:54:57.692 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.ql8HQf04qb 2021-01-27T09:54:57.712 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/jcollin-2021-01-27_09:11:59-fs-wip-jcollin-dispatch-queue-throttle-test-distro-basic-smithi/5833404/data/mon.b.tgz 2021-01-27T09:54:57.712 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2021-01-27T09:54:57.726 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.8xgH6JV4NY 2021-01-27T09:54:57.726 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.8xgH6JV4NY 2021-01-27T09:54:58.048 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.8xgH6JV4NY 2021-01-27T09:54:58.147 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.8xgH6JV4NY is 776KB 2021-01-27T09:54:58.215 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.8xgH6JV4NY 2021-01-27T09:54:58.223 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/jcollin-2021-01-27_09:11:59-fs-wip-jcollin-dispatch-queue-throttle-test-distro-basic-smithi/5833404/data/mon.c.tgz 2021-01-27T09:54:58.223 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2021-01-27T09:54:58.229 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.eOAVwdmIcq 2021-01-27T09:54:58.230 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.eOAVwdmIcq 2021-01-27T09:54:58.486 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.eOAVwdmIcq 2021-01-27T09:54:58.503 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.eOAVwdmIcq is 779KB 2021-01-27T09:54:58.571 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.eOAVwdmIcq 2021-01-27T09:54:58.578 INFO:tasks.ceph:Cleaning ceph cluster... 2021-01-27T09:54:58.579 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-01-27T09:54:58.581 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-01-27T09:54:58.631 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2021-01-27T09:54:58.632 DEBUG:teuthology.orchestra.run.smithi146:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-01-27T09:54:58.639 DEBUG:teuthology.orchestra.run.smithi078:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-01-27T09:54:58.681 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-01-27T09:54:58.683 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-01-27T09:54:58.728 INFO:tasks.ceph:Archiving crash dumps... 2021-01-27T09:54:58.730 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/crash to /home/teuthworker/archive/jcollin-2021-01-27_09:11:59-fs-wip-jcollin-dispatch-queue-throttle-test-distro-basic-smithi/5833404/remote/smithi146/crash 2021-01-27T09:54:58.731 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-01-27T09:54:58.783 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/crash to /home/teuthworker/archive/jcollin-2021-01-27_09:11:59-fs-wip-jcollin-dispatch-queue-throttle-test-distro-basic-smithi/5833404/remote/smithi078/crash 2021-01-27T09:54:58.784 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-01-27T09:54:58.803 INFO:tasks.ceph:Shutting down logrotate 2021-01-27T21:29:40.209 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2021-01-27T21:29:40.255 DEBUG:teuthology.task.console_log:Killing console logger for smithi146 2021-01-27T21:29:40.257 DEBUG:teuthology.task.console_log:Killing console logger for smithi078 2021-01-27T21:29:40.257 DEBUG:teuthology.task.console_log:Killing console logger for smithi146 2021-01-27T21:29:40.258 DEBUG:teuthology.task.console_log:Killing console logger for smithi078 2021-01-27T21:29:40.258 DEBUG:teuthology.exit:Finished running handlers